Max level shown:
1 [ Jan 17 07:27:00 Enabled. ]
2 [ Jan 17 07:27:00 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 17 07:27:00 Method "start" exited with status 0. ]
4 [ Jan 17 07:27:00 Rereading configuration. ]
5 [ Jan 17 07:27:00 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-17T07:27:00.827ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-17T07:27:00.827ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-17T07:27:00.881ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-17T07:27:00.881ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-17T07:27:00.996ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-17T07:27:01.005ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-17T07:27:01.014ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-17T07:27:01.619ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-01-17T07:27:01.759ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-17T07:27:01.759ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-17T07:27:01.759ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-17T07:27:01.759ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-17T07:27:01.759ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-01-17T07:27:01.759ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-01-17T07:27:01.762ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-17T07:27:01.762ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-17T07:27:01.762ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-17T07:27:01.762ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-17T07:27:01.762ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-17T07:27:01.762ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-17T07:27:01.762ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-17T07:27:01.762ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-17T07:27:01.762ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-17T07:27:01.775ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-17T07:27:01.775ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool)
322025-01-17T07:27:01.875ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal }
332025-01-17T07:27:02.236ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-17T07:27:02.236ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-17T07:27:02.236ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-17T07:27:02.236ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-17T07:27:02.237ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-17T07:27:02.237ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-17T07:27:02.237ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-17T07:27:02.245ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-17T07:27:02.245ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool)
422025-01-17T07:27:02.334ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal }
432025-01-17T07:27:02.695ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-17T07:27:02.695ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-17T07:27:02.695ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-17T07:27:02.695ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-17T07:27:02.695ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-17T07:27:02.695ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-17T07:27:02.695ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-17T07:27:02.695ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-17T07:27:02.695ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
692025-01-17T07:27:02.695ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732025-01-17T07:27:02.695ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
752025-01-17T07:27:02.695ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772025-01-17T07:27:02.695ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
782025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
792025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
802025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-01-17T07:27:02.695ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-01-17T07:27:02.695ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
842025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-17T07:27:02.695ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-17T07:27:02.695ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
902025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-17T07:27:02.695ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-17T07:27:02.695ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-17T07:27:02.695ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-17T07:27:02.695ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002025-01-17T07:27:02.695ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-01-17T07:27:02.695ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-01-17T07:27:02.695ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-17T07:27:02.695ZINFOSledAgent (bootstore): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-01-17T07:27:02.695ZINFOSledAgent (bootstore): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-01-17T07:27:02.695ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-01-17T07:27:02.695ZINFOSledAgent (bootstore): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-01-17T07:27:02.696ZINFOSledAgent (bootstore): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-01-17T07:27:02.696ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-01-17T07:27:02.696ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-17T07:27:02.696ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-17T07:27:02.706ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-17T07:27:02.706ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1332, tv_nsec: 632336337 } time_to_next_cleanup = 599.999927849s
1142025-01-17T07:27:02.706ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-17T07:27:02.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-17T07:27:02.709ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-17T07:27:02.709ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-17T07:27:02.710ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-01-17T07:27:02.711ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-01-17T07:27:02.712ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-17T07:27:02.712ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-17T07:27:02.712ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-17T07:27:02.712ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-17T07:27:02.712ZINFOSledAgent (RSS): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-17T07:27:02.712ZINFOSledAgent (RSS): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-17T07:27:02.712ZINFOSledAgent (RSS): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-17T07:27:02.712ZINFOSledAgent (RSS): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-17T07:27:02.712ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-17T07:27:02.712ZINFOSledAgent (RSS): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-17T07:27:02.712ZINFOSledAgent (RSS): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-17T07:27:02.712ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-17T07:27:02.712ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-17T07:27:02.712ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-17T07:27:02.712ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-17T07:27:02.713ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-01-17T07:27:02.713ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-01-17T07:27:02.713ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-01-17T07:27:02.713ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-01-17T07:27:02.713ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: df37d1c6-999a-4855-92c3-920ccfa9c7b0 (sled), rack_id: 19ed879c-68f3-4f6b-9685-1c07ee4860a9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-01-17T07:27:02.713ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-17T07:27:02.713ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-17T07:27:02.718ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-17T07:27:02.723ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-17T07:27:02.724ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-17T07:27:02.728ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-17T07:27:02.728ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-17T07:27:02.728ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:49132
1482025-01-17T07:27:02.728ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: df37d1c6-999a-4855-92c3-920ccfa9c7b0 (sled), rack_id: 19ed879c-68f3-4f6b-9685-1c07ee4860a9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-17T07:27:02.728ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-17T07:27:02.728ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-17T07:27:02.728ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-17T07:27:02.728ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-17T07:27:02.728ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-17T07:27:02.728ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-17T07:27:02.728ZINFOSledAgent (StorageManager): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-17T07:27:02.728ZINFOSledAgent (StorageManager): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-17T07:27:02.728ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-17T07:27:02.728ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-17T07:27:02.728ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-17T07:27:02.728ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-17T07:27:02.728ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-17T07:27:02.743ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-17T07:27:02.764ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-17T07:27:02.781ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-17T07:27:02.793ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
1662025-01-17T07:27:02.793ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-17T07:27:02.793ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
1682025-01-17T07:27:02.793ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-17T07:27:02.797ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 93.610733ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b9e44c74-a047-479f-9745-da10baf3fe87", "content-length": "124", "date": "Fri, 17 Jan 2025 07:27:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b9e44c74-a047-479f-9745-da10baf3fe87" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-17T07:27:02.807ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_b1a4491e-a24b-4fc6-b2b0-584be9006609/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-17T07:27:02.831ZINFOSledAgent: successfully created encrypted zvol: name="oxi_b1a4491e-a24b-4fc6-b2b0-584be9006609/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-17T07:27:02.831ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_b1a4491e-a24b-4fc6-b2b0-584be9006609/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-17T07:27:02.836ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
1742025-01-17T07:27:02.836ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-17T07:27:02.836ZINFOSledAgent (BackingFs): Ensuring dataset oxi_b1a4491e-a24b-4fc6-b2b0-584be9006609/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-17T07:27:02.892ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-17T07:27:02.892ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 120.342775ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fd001160-cfeb-4172-b95e-922549f539ce", "content-length": "124", "date": "Fri, 17 Jan 2025 07:27:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fd001160-cfeb-4172-b95e-922549f539ce" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-17T07:27:02.904ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-17T07:27:03.013ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-17T07:27:03.014ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 83.277528ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "de38fed5-0ffe-4b40-a6f2-7facfd116c31", "content-length": "124", "date": "Fri, 17 Jan 2025 07:27:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "de38fed5-0ffe-4b40-a6f2-7facfd116c31" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-17T07:27:03.099ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822025-01-17T07:27:03.099ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 192.401819ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "48270863-6e5a-45a1-9c91-0e950d9786ca", "content-length": "124", "date": "Fri, 17 Jan 2025 07:27:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "48270863-6e5a-45a1-9c91-0e950d9786ca" } file = clients/ddm-admin-client/src/lib.rs:177
1832025-01-17T07:27:03.123ZINFOSledAgent (BackingFs): Mounting oxi_b1a4491e-a24b-4fc6-b2b0-584be9006609/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842025-01-17T07:27:03.136ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852025-01-17T07:27:03.136ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862025-01-17T07:27:03.136ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872025-01-17T07:27:03.136ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882025-01-17T07:27:03.293ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-17T07:27:03.293ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 212.232868ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8d1cf8b6-4e54-4842-995b-7b1359778b52", "content-length": "124", "date": "Fri, 17 Jan 2025 07:27:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8d1cf8b6-4e54-4842-995b-7b1359778b52" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-17T07:27:03.507ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-17T07:27:03.507ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 314.898005ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b5b00faa-716a-45f7-ac1a-3d0292568f2b", "content-length": "124", "date": "Fri, 17 Jan 2025 07:27:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b5b00faa-716a-45f7-ac1a-3d0292568f2b" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-17T07:27:03.824ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-17T07:27:03.866ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
1942025-01-17T07:27:03.872ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:51514 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
1952025-01-17T07:27:03.872ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
1962025-01-17T07:27:03.872ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:51514 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
1972025-01-17T07:27:03.873ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 160.010161ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
1982025-01-17T07:27:03.874ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
1992025-01-17T07:27:03.874ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2002025-01-17T07:27:03.874ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2012025-01-17T07:27:03.874ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022025-01-17T07:27:04.035ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 664.742544ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2032025-01-17T07:27:04.702ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.161549265s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2042025-01-17T07:27:05.866ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.502089162s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2052025-01-17T07:27:06.574ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2062025-01-17T07:27:06.574ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2072025-01-17T07:27:06.574ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2082025-01-17T07:27:06.574ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2092025-01-17T07:27:06.574ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2102025-01-17T07:27:06.574ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2112025-01-17T07:27:06.576ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2122025-01-17T07:27:06.577ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2132025-01-17T07:27:06.578ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='0f9dea0b-86c0-436e-a31a-7d56dd26d441'/> <propval type="astring" name="rack_id" value='19ed879c-68f3-4f6b-9685-1c07ee4860a9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe4d:cab5'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='19ed879c-68f3-4f6b-9685-1c07ee4860a9'/> <propval type="astring" name="sled_id" value='df37d1c6-999a-4855-92c3-920ccfa9c7b0'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='df37d1c6-999a-4855-92c3-920ccfa9c7b0'/> <propval type="astring" name="rack_uuid" value='19ed879c-68f3-4f6b-9685-1c07ee4860a9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='df37d1c6-999a-4855-92c3-920ccfa9c7b0'/> <propval type="astring" name="rack_uuid" value='19ed879c-68f3-4f6b-9685-1c07ee4860a9'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-01-17T07:27:06.578ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152025-01-17T07:27:06.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 66.024686ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-01-17T07:27:07.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 142.597684ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-01-17T07:27:07.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 167.647912ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-17T07:27:07.370ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.511739816s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2192025-01-17T07:27:07.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 280.808902ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-01-17T07:27:07.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 950.410602ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-17T07:27:09.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.119343209s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-17T07:27:09.884ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.063369727s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2232025-01-17T07:27:10.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 654.628408ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-01-17T07:27:11.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.227452884s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-01-17T07:27:12.585ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/df37d1c6-999a-4855-92c3-920ccfa9c7b0) file = sled-agent/src/nexus.rs:527 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2262025-01-17T07:27:12.622ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272025-01-17T07:27:12.623ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2282025-01-17T07:27:12.624ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2292025-01-17T07:27:12.624ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302025-01-17T07:27:12.624ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312025-01-17T07:27:12.624ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-01-17T07:27:12.624ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-01-17T07:27:12.624ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342025-01-17T07:27:12.625ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352025-01-17T07:27:12.625ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2362025-01-17T07:27:12.625ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:49132
2372025-01-17T07:27:12.822ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2382025-01-17T07:27:12.822ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2392025-01-17T07:27:12.828ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402025-01-17T07:27:12.828ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2412025-01-17T07:27:12.828ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2422025-01-17T07:27:13.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54455
2432025-01-17T07:27:13.105ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442025-01-17T07:27:13.105ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-01-17T07:27:13.105ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:188
2462025-01-17T07:27:13.105ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-01-17T07:27:13.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54455 req_id = 736cb79a-0738-4eba-80f1-d3f226b0cdf8 response_code = 200 uri = /inventory
2482025-01-17T07:27:13.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37519
2492025-01-17T07:27:13.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37519 req_id = 7234ccfa-96a0-4f44-8ea6-0b7e5a88b99f response_code = 200 uri = /sled-role
2502025-01-17T07:27:13.168ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1c3c61d7-b8f2-4832-a3a4-9e4873c8d5a5 (physical_disk), pool_id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 531d28be-76a9-41dd-8ad2-967e79e083b3 (physical_disk), pool_id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 932eb0c6-3ca8-410c-aff6-76b97e6dc791 (physical_disk), pool_id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a2fa5dd4-cd6a-4d4d-a0ca-90a719eaab78 (physical_disk), pool_id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: cb716fdd-13bb-458b-9f9d-89c170c222af (physical_disk), pool_id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: d81ddb99-516d-4687-b694-6c4aad89e29e (physical_disk), pool_id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d8570cc0-8458-4198-a153-9b0d7060569f (physical_disk), pool_id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e4182060-bd67-447b-bbcd-fcb56d03c9f0 (physical_disk), pool_id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ed143c7a-01d6-43ad-a6a3-fc9cb0a288a3 (physical_disk), pool_id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2512025-01-17T07:27:13.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39080
2522025-01-17T07:27:13.168ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2532025-01-17T07:27:13.168ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1c3c61d7-b8f2-4832-a3a4-9e4873c8d5a5 (physical_disk), pool_id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 531d28be-76a9-41dd-8ad2-967e79e083b3 (physical_disk), pool_id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 932eb0c6-3ca8-410c-aff6-76b97e6dc791 (physical_disk), pool_id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a2fa5dd4-cd6a-4d4d-a0ca-90a719eaab78 (physical_disk), pool_id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: cb716fdd-13bb-458b-9f9d-89c170c222af (physical_disk), pool_id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: d81ddb99-516d-4687-b694-6c4aad89e29e (physical_disk), pool_id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d8570cc0-8458-4198-a153-9b0d7060569f (physical_disk), pool_id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e4182060-bd67-447b-bbcd-fcb56d03c9f0 (physical_disk), pool_id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ed143c7a-01d6-43ad-a6a3-fc9cb0a288a3 (physical_disk), pool_id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2542025-01-17T07:27:13.168ZINFOSledAgent (StorageManager): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552025-01-17T07:27:13.168ZINFOSledAgent (StorageManager): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562025-01-17T07:27:13.168ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2572025-01-17T07:27:13.168ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2582025-01-17T07:27:13.168ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2592025-01-17T07:27:13.168ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2602025-01-17T07:27:13.168ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2612025-01-17T07:27:13.366ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2622025-01-17T07:27:13.366ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool)
2632025-01-17T07:27:13.626ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/df37d1c6-999a-4855-92c3-920ccfa9c7b0) file = sled-agent/src/probe_manager.rs:231 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2642025-01-17T07:27:14.095ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14349206130351978021 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2652025-01-17T07:27:14.095ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17074793336039695850 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2662025-01-17T07:27:14.336ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2672025-01-17T07:27:14.368ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }
2682025-01-17T07:27:14.377ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2692025-01-17T07:27:14.377ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2702025-01-17T07:27:14.377ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2712025-01-17T07:27:14.377ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2722025-01-17T07:27:14.377ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-01-17T07:27:14.377ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742025-01-17T07:27:14.377ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2752025-01-17T07:27:14.411ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762025-01-17T07:27:14.419ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/zone file = sled-storage/src/dataset.rs:302
2772025-01-17T07:27:14.557ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd file = sled-storage/src/dataset.rs:388
2782025-01-17T07:27:14.565ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792025-01-17T07:27:14.565ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802025-01-17T07:27:14.565ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812025-01-17T07:27:14.565ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822025-01-17T07:27:14.565ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832025-01-17T07:27:14.574ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842025-01-17T07:27:14.574ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool)
2852025-01-17T07:27:14.663ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }
2862025-01-17T07:27:14.670ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2872025-01-17T07:27:14.670ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2882025-01-17T07:27:14.670ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2892025-01-17T07:27:14.670ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2902025-01-17T07:27:14.670ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-01-17T07:27:14.670ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-01-17T07:27:14.670ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2932025-01-17T07:27:14.674ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/df37d1c6-999a-4855-92c3-920ccfa9c7b0) file = sled-agent/src/probe_manager.rs:231 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
2942025-01-17T07:27:14.704ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952025-01-17T07:27:14.711ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841/crypt/zone file = sled-storage/src/dataset.rs:302
2962025-01-17T07:27:14.851ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841 file = sled-storage/src/dataset.rs:388
2972025-01-17T07:27:14.859ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982025-01-17T07:27:14.859ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992025-01-17T07:27:14.859ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002025-01-17T07:27:14.859ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012025-01-17T07:27:14.859ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022025-01-17T07:27:14.868ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032025-01-17T07:27:14.868ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool)
3042025-01-17T07:27:14.960ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }
3052025-01-17T07:27:14.968ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062025-01-17T07:27:14.968ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072025-01-17T07:27:14.968ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082025-01-17T07:27:14.968ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092025-01-17T07:27:14.968ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-01-17T07:27:14.968ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112025-01-17T07:27:14.968ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122025-01-17T07:27:15.004ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132025-01-17T07:27:15.013ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/zone file = sled-storage/src/dataset.rs:302
3142025-01-17T07:27:15.152ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e file = sled-storage/src/dataset.rs:388
3152025-01-17T07:27:15.160ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162025-01-17T07:27:15.160ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172025-01-17T07:27:15.160ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182025-01-17T07:27:15.160ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192025-01-17T07:27:15.160ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202025-01-17T07:27:15.170ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212025-01-17T07:27:15.170ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool)
3222025-01-17T07:27:15.264ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }
3232025-01-17T07:27:15.272ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242025-01-17T07:27:15.272ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252025-01-17T07:27:15.272ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262025-01-17T07:27:15.272ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272025-01-17T07:27:15.272ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-01-17T07:27:15.272ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292025-01-17T07:27:15.272ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302025-01-17T07:27:15.308ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312025-01-17T07:27:15.315ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone file = sled-storage/src/dataset.rs:302
3322025-01-17T07:27:15.452ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6 file = sled-storage/src/dataset.rs:388
3332025-01-17T07:27:15.461ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342025-01-17T07:27:15.461ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352025-01-17T07:27:15.461ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362025-01-17T07:27:15.461ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372025-01-17T07:27:15.461ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382025-01-17T07:27:15.471ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392025-01-17T07:27:15.471ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool)
3402025-01-17T07:27:15.563ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }
3412025-01-17T07:27:15.570ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3422025-01-17T07:27:15.570ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3432025-01-17T07:27:15.570ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3442025-01-17T07:27:15.570ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3452025-01-17T07:27:15.570ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-01-17T07:27:15.570ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-01-17T07:27:15.570ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3482025-01-17T07:27:15.604ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492025-01-17T07:27:15.612ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/zone file = sled-storage/src/dataset.rs:302
3502025-01-17T07:27:15.675ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/df37d1c6-999a-4855-92c3-920ccfa9c7b0) file = sled-agent/src/probe_manager.rs:231 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
3512025-01-17T07:27:15.755ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d file = sled-storage/src/dataset.rs:388
3522025-01-17T07:27:15.763ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532025-01-17T07:27:15.763ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542025-01-17T07:27:15.763ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552025-01-17T07:27:15.763ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562025-01-17T07:27:15.763ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572025-01-17T07:27:15.774ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582025-01-17T07:27:15.774ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool)
3592025-01-17T07:27:15.869ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }
3602025-01-17T07:27:15.877ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612025-01-17T07:27:15.877ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622025-01-17T07:27:15.877ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632025-01-17T07:27:15.877ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642025-01-17T07:27:15.877ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-01-17T07:27:15.877ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662025-01-17T07:27:15.877ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672025-01-17T07:27:15.913ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682025-01-17T07:27:15.920ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crypt/zone file = sled-storage/src/dataset.rs:302
3692025-01-17T07:27:16.057ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 file = sled-storage/src/dataset.rs:388
3702025-01-17T07:27:16.065ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712025-01-17T07:27:16.065ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722025-01-17T07:27:16.065ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732025-01-17T07:27:16.065ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742025-01-17T07:27:16.065ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752025-01-17T07:27:16.075ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762025-01-17T07:27:16.075ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool)
3772025-01-17T07:27:16.177ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }
3782025-01-17T07:27:16.184ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792025-01-17T07:27:16.184ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802025-01-17T07:27:16.184ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812025-01-17T07:27:16.184ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822025-01-17T07:27:16.184ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-01-17T07:27:16.185ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842025-01-17T07:27:16.185ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852025-01-17T07:27:16.222ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862025-01-17T07:27:16.231ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone file = sled-storage/src/dataset.rs:302
3872025-01-17T07:27:16.376ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 file = sled-storage/src/dataset.rs:388
3882025-01-17T07:27:16.385ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892025-01-17T07:27:16.385ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902025-01-17T07:27:16.385ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912025-01-17T07:27:16.385ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922025-01-17T07:27:16.385ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932025-01-17T07:27:16.396ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942025-01-17T07:27:16.396ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool)
3952025-01-17T07:27:16.494ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }
3962025-01-17T07:27:16.502ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3972025-01-17T07:27:16.502ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3982025-01-17T07:27:16.502ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3992025-01-17T07:27:16.502ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4002025-01-17T07:27:16.502ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-01-17T07:27:16.502ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-01-17T07:27:16.502ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4032025-01-17T07:27:16.537ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042025-01-17T07:27:16.545ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone file = sled-storage/src/dataset.rs:302
4052025-01-17T07:27:16.678ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/df37d1c6-999a-4855-92c3-920ccfa9c7b0) file = sled-agent/src/probe_manager.rs:231 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4062025-01-17T07:27:16.682ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 file = sled-storage/src/dataset.rs:388
4072025-01-17T07:27:16.690ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082025-01-17T07:27:16.690ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092025-01-17T07:27:16.690ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102025-01-17T07:27:16.690ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112025-01-17T07:27:16.690ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122025-01-17T07:27:16.700ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132025-01-17T07:27:16.700ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool)
4142025-01-17T07:27:16.794ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }
4152025-01-17T07:27:16.804ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162025-01-17T07:27:16.804ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172025-01-17T07:27:16.804ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182025-01-17T07:27:16.804ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192025-01-17T07:27:16.804ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-01-17T07:27:16.804ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212025-01-17T07:27:16.804ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222025-01-17T07:27:16.844ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232025-01-17T07:27:16.852ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/zone file = sled-storage/src/dataset.rs:302
4242025-01-17T07:27:16.996ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b file = sled-storage/src/dataset.rs:388
4252025-01-17T07:27:17.004ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262025-01-17T07:27:17.004ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272025-01-17T07:27:17.004ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282025-01-17T07:27:17.004ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1a4491e-a24b-4fc6-b2b0-584be9006609 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0819f1e6-ddf3-48a6-ad1f-9728962f4834 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292025-01-17T07:27:17.004ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302025-01-17T07:27:17.004ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312025-01-17T07:27:17.004ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322025-01-17T07:27:17.004ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4332025-01-17T07:27:17.004ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342025-01-17T07:27:17.004ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4352025-01-17T07:27:17.004ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4362025-01-17T07:27:17.004ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4372025-01-17T07:27:17.005ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4382025-01-17T07:27:17.005ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4392025-01-17T07:27:17.005ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402025-01-17T07:27:17.005ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4412025-01-17T07:27:17.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3836794 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39080 req_id = 6fff3a7a-5462-4d8c-982e-eb04045f005b response_code = 200 uri = /omicron-physical-disks
4422025-01-17T07:27:17.036ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0a86d2c1-7906-4040-b7a9-f9818f1e6ae4 (dataset): DatasetConfig { id: 0a86d2c1-7906-4040-b7a9-f9818f1e6ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c9a1558-6751-4fef-ac78-a2d65ab9ad0a (dataset): DatasetConfig { id: 0c9a1558-6751-4fef-ac78-a2d65ab9ad0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d03b629-ec0b-4a68-8cb4-d7b052ccc51b (dataset): DatasetConfig { id: 0d03b629-ec0b-4a68-8cb4-d7b052ccc51b (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e618f74-e183-439e-b778-761da6bfe4c0 (dataset): DatasetConfig { id: 0e618f74-e183-439e-b778-761da6bfe4c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ee4185c-44c7-487a-9a7e-77c5306699da (dataset): DatasetConfig { id: 0ee4185c-44c7-487a-9a7e-77c5306699da (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0f5de9c6-3c78-459c-b483-6d570c550604 (dataset): DatasetConfig { id: 0f5de9c6-3c78-459c-b483-6d570c550604 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f8c8ef1-1db5-45b7-a30f-67e2943d8e0b (dataset): DatasetConfig { id: 0f8c8ef1-1db5-45b7-a30f-67e2943d8e0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1088961a-e3bc-464a-be26-9b81b60c3645 (dataset): DatasetConfig { id: 1088961a-e3bc-464a-be26-9b81b60c3645 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 159c09b8-2e81-4d79-81c0-ee71afb61bd6 (dataset): DatasetConfig { id: 159c09b8-2e81-4d79-81c0-ee71afb61bd6 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 183aa757-5e14-4dbc-afdb-a61b322036a8 (dataset): DatasetConfig { id: 183aa757-5e14-4dbc-afdb-a61b322036a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 196bf3c0-5d5a-493e-bd8c-048fff55836b (dataset): DatasetConfig { id: 196bf3c0-5d5a-493e-bd8c-048fff55836b (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2362f9a4-a00b-48f4-b4b5-c202bb424fc0 (dataset): DatasetConfig { id: 2362f9a4-a00b-48f4-b4b5-c202bb424fc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d72486c-39e2-406d-9f45-20fccee96f3c (dataset): DatasetConfig { id: 2d72486c-39e2-406d-9f45-20fccee96f3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2da4ba9f-13ec-41c7-af6c-cbd4c741b08b (dataset): DatasetConfig { id: 2da4ba9f-13ec-41c7-af6c-cbd4c741b08b (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e146497-7508-4996-9662-e7883a7d795d (dataset): DatasetConfig { id: 2e146497-7508-4996-9662-e7883a7d795d (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3329c692-284a-4cf8-a655-4a486ad01bf4 (dataset): DatasetConfig { id: 3329c692-284a-4cf8-a655-4a486ad01bf4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 342cd4a2-daf8-45fb-b9c6-06cc71aa85a7 (dataset): DatasetConfig { id: 342cd4a2-daf8-45fb-b9c6-06cc71aa85a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38982035-2c63-4edd-be33-b59f00e34784 (dataset): DatasetConfig { id: 38982035-2c63-4edd-be33-b59f00e34784 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38c752d7-4b7d-42ae-b334-08b063e82eea (dataset): DatasetConfig { id: 38c752d7-4b7d-42ae-b334-08b063e82eea (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a74edac-66df-447f-91ea-365c8c8a71c8 (dataset): DatasetConfig { id: 3a74edac-66df-447f-91ea-365c8c8a71c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3caef8c8-4c4c-48f8-b300-80fb885eb596 (dataset): DatasetConfig { id: 3caef8c8-4c4c-48f8-b300-80fb885eb596 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4aa70354-cc70-458d-947e-f18cb7b13838 (dataset): DatasetConfig { id: 4aa70354-cc70-458d-947e-f18cb7b13838 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55fb2728-6045-4668-af53-39ed4d3ec430 (dataset): DatasetConfig { id: 55fb2728-6045-4668-af53-39ed4d3ec430 (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a10d45f-c945-4391-a273-145a9ad7392c (dataset): DatasetConfig { id: 5a10d45f-c945-4391-a273-145a9ad7392c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63ba13a3-f9aa-4267-9adf-106184a269eb (dataset): DatasetConfig { id: 63ba13a3-f9aa-4267-9adf-106184a269eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64e1dff1-1c90-4f75-a78a-0c74f928bfba (dataset): DatasetConfig { id: 64e1dff1-1c90-4f75-a78a-0c74f928bfba (dataset), name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 728c9f9b-d49b-4ddd-a924-366493b41072 (dataset): DatasetConfig { id: 728c9f9b-d49b-4ddd-a924-366493b41072 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7404a72e-ab81-4676-902a-0a9ea6b45489 (dataset): DatasetConfig { id: 7404a72e-ab81-4676-902a-0a9ea6b45489 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 741f5009-990e-4509-aa98-fc8f23eb43f4 (dataset): DatasetConfig { id: 741f5009-990e-4509-aa98-fc8f23eb43f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bea3278-247f-4e81-af79-e09e29f04737 (dataset): DatasetConfig { id: 7bea3278-247f-4e81-af79-e09e29f04737 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c840432-864e-468f-98a2-b6ed117c220b (dataset): DatasetConfig { id: 7c840432-864e-468f-98a2-b6ed117c220b (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f897b04-68da-45bf-9257-79c3da60a35d (dataset): DatasetConfig { id: 7f897b04-68da-45bf-9257-79c3da60a35d (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8169b41b-66f1-41d0-bf2b-f93894468bce (dataset): DatasetConfig { id: 8169b41b-66f1-41d0-bf2b-f93894468bce (dataset), name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85309575-dfd4-422d-b455-c6806ab966ec (dataset): DatasetConfig { id: 85309575-dfd4-422d-b455-c6806ab966ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 859f7528-f850-48f1-a891-4e1677998bdf (dataset): DatasetConfig { id: 859f7528-f850-48f1-a891-4e1677998bdf (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 891c5150-142b-40e4-a590-25f8bf7cf66a (dataset): DatasetConfig { id: 891c5150-142b-40e4-a590-25f8bf7cf66a (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ab9129a-903f-4df5-8338-1c05fa1dbb15 (dataset): DatasetConfig { id: 8ab9129a-903f-4df5-8338-1c05fa1dbb15 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b280873-f4dc-49c3-bd87-7ef71db381b7 (dataset): DatasetConfig { id: 8b280873-f4dc-49c3-bd87-7ef71db381b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8dd0f1c2-f952-4ac3-aa58-d149ef730863 (dataset): DatasetConfig { id: 8dd0f1c2-f952-4ac3-aa58-d149ef730863 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 909b860b-0ea9-405e-b77d-c8f94465f0f6 (dataset): DatasetConfig { id: 909b860b-0ea9-405e-b77d-c8f94465f0f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9196d333-2b1d-4dcc-a9ca-d1b96356a279 (dataset): DatasetConfig { id: 9196d333-2b1d-4dcc-a9ca-d1b96356a279 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97de28e1-5c4d-43d8-8b92-0ee853797380 (dataset): DatasetConfig { id: 97de28e1-5c4d-43d8-8b92-0ee853797380 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9beda3a5-8aa5-4ca7-8411-f9045f13c949 (dataset): DatasetConfig { id: 9beda3a5-8aa5-4ca7-8411-f9045f13c949 (dataset), name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9d8446e7-350e-4d4b-af52-df959502af24 (dataset): DatasetConfig { id: 9d8446e7-350e-4d4b-af52-df959502af24 (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e2a849e-3187-4e2e-aa5c-b46389b2245f (dataset): DatasetConfig { id: 9e2a849e-3187-4e2e-aa5c-b46389b2245f (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9ae42ce-89ac-498c-beaa-df35884240ef (dataset): DatasetConfig { id: a9ae42ce-89ac-498c-beaa-df35884240ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, abedf07c-dcb3-40b2-ba98-d22d7dc6a308 (dataset): DatasetConfig { id: abedf07c-dcb3-40b2-ba98-d22d7dc6a308 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae6afad6-ad72-4012-b135-954f01a41772 (dataset): DatasetConfig { id: ae6afad6-ad72-4012-b135-954f01a41772 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0ee34f9-0bc4-4ef7-bf43-6849ceb5e222 (dataset): DatasetConfig { id: b0ee34f9-0bc4-4ef7-bf43-6849ceb5e222 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0f11a24-0508-42bd-becb-285157f4d32b (dataset): DatasetConfig { id: b0f11a24-0508-42bd-becb-285157f4d32b (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b84fa6af-0afc-4779-b0ae-720dd5e097d7 (dataset): DatasetConfig { id: b84fa6af-0afc-4779-b0ae-720dd5e097d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bbf2eec4-7674-4667-a009-5b63768ffa07 (dataset): DatasetConfig { id: bbf2eec4-7674-4667-a009-5b63768ffa07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bebf1c30-7e04-4e41-8290-c8e99f8a58c4 (dataset): DatasetConfig { id: bebf1c30-7e04-4e41-8290-c8e99f8a58c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0c4fdd7-710b-400d-94fa-b4de6b700825 (dataset): DatasetConfig { id: c0c4fdd7-710b-400d-94fa-b4de6b700825 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2242ed1-5ac0-4767-9cac-e752d6d424b9 (dataset): DatasetConfig { id: c2242ed1-5ac0-4767-9cac-e752d6d424b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5448452-ed54-4343-a624-05913d65dbb2 (dataset): DatasetConfig { id: c5448452-ed54-4343-a624-05913d65dbb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c618bace-4861-4291-9763-277ca709f6cd (dataset): DatasetConfig { id: c618bace-4861-4291-9763-277ca709f6cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9bafeab-6656-4b67-a4e3-c00e89a760a7 (dataset): DatasetConfig { id: c9bafeab-6656-4b67-a4e3-c00e89a760a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc6afaed-205a-4536-b873-85aa5b82da19 (dataset): DatasetConfig { id: cc6afaed-205a-4536-b873-85aa5b82da19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6b781ed-0da9-4aba-882b-072942fbaa60 (dataset): DatasetConfig { id: d6b781ed-0da9-4aba-882b-072942fbaa60 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3b3dd53-cd94-4474-9d87-64dfbde400b8 (dataset): DatasetConfig { id: e3b3dd53-cd94-4474-9d87-64dfbde400b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e679d3ce-7944-4e12-be44-d8fba85e8262 (dataset): DatasetConfig { id: e679d3ce-7944-4e12-be44-d8fba85e8262 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f66535f3-f42a-4e2b-80cb-3fc97209a57d (dataset): DatasetConfig { id: f66535f3-f42a-4e2b-80cb-3fc97209a57d (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faf208b8-20cb-4ffd-80df-ed22f4c1f621 (dataset): DatasetConfig { id: faf208b8-20cb-4ffd-80df-ed22f4c1f621 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd5fcbbd-bfde-4431-8d26-381c61a9ea12 (dataset): DatasetConfig { id: fd5fcbbd-bfde-4431-8d26-381c61a9ea12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ffbe84fb-0e3f-4c77-a2a8-b72fb64c9f2a (dataset): DatasetConfig { id: ffbe84fb-0e3f-4c77-a2a8-b72fb64c9f2a (dataset), name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432025-01-17T07:27:17.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43731
4442025-01-17T07:27:17.037ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4452025-01-17T07:27:17.037ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0a86d2c1-7906-4040-b7a9-f9818f1e6ae4 (dataset): DatasetConfig { id: 0a86d2c1-7906-4040-b7a9-f9818f1e6ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c9a1558-6751-4fef-ac78-a2d65ab9ad0a (dataset): DatasetConfig { id: 0c9a1558-6751-4fef-ac78-a2d65ab9ad0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d03b629-ec0b-4a68-8cb4-d7b052ccc51b (dataset): DatasetConfig { id: 0d03b629-ec0b-4a68-8cb4-d7b052ccc51b (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e618f74-e183-439e-b778-761da6bfe4c0 (dataset): DatasetConfig { id: 0e618f74-e183-439e-b778-761da6bfe4c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ee4185c-44c7-487a-9a7e-77c5306699da (dataset): DatasetConfig { id: 0ee4185c-44c7-487a-9a7e-77c5306699da (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0f5de9c6-3c78-459c-b483-6d570c550604 (dataset): DatasetConfig { id: 0f5de9c6-3c78-459c-b483-6d570c550604 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f8c8ef1-1db5-45b7-a30f-67e2943d8e0b (dataset): DatasetConfig { id: 0f8c8ef1-1db5-45b7-a30f-67e2943d8e0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1088961a-e3bc-464a-be26-9b81b60c3645 (dataset): DatasetConfig { id: 1088961a-e3bc-464a-be26-9b81b60c3645 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 159c09b8-2e81-4d79-81c0-ee71afb61bd6 (dataset): DatasetConfig { id: 159c09b8-2e81-4d79-81c0-ee71afb61bd6 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 183aa757-5e14-4dbc-afdb-a61b322036a8 (dataset): DatasetConfig { id: 183aa757-5e14-4dbc-afdb-a61b322036a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 196bf3c0-5d5a-493e-bd8c-048fff55836b (dataset): DatasetConfig { id: 196bf3c0-5d5a-493e-bd8c-048fff55836b (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2362f9a4-a00b-48f4-b4b5-c202bb424fc0 (dataset): DatasetConfig { id: 2362f9a4-a00b-48f4-b4b5-c202bb424fc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d72486c-39e2-406d-9f45-20fccee96f3c (dataset): DatasetConfig { id: 2d72486c-39e2-406d-9f45-20fccee96f3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2da4ba9f-13ec-41c7-af6c-cbd4c741b08b (dataset): DatasetConfig { id: 2da4ba9f-13ec-41c7-af6c-cbd4c741b08b (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e146497-7508-4996-9662-e7883a7d795d (dataset): DatasetConfig { id: 2e146497-7508-4996-9662-e7883a7d795d (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3329c692-284a-4cf8-a655-4a486ad01bf4 (dataset): DatasetConfig { id: 3329c692-284a-4cf8-a655-4a486ad01bf4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 342cd4a2-daf8-45fb-b9c6-06cc71aa85a7 (dataset): DatasetConfig { id: 342cd4a2-daf8-45fb-b9c6-06cc71aa85a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38982035-2c63-4edd-be33-b59f00e34784 (dataset): DatasetConfig { id: 38982035-2c63-4edd-be33-b59f00e34784 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38c752d7-4b7d-42ae-b334-08b063e82eea (dataset): DatasetConfig { id: 38c752d7-4b7d-42ae-b334-08b063e82eea (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a74edac-66df-447f-91ea-365c8c8a71c8 (dataset): DatasetConfig { id: 3a74edac-66df-447f-91ea-365c8c8a71c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3caef8c8-4c4c-48f8-b300-80fb885eb596 (dataset): DatasetConfig { id: 3caef8c8-4c4c-48f8-b300-80fb885eb596 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4aa70354-cc70-458d-947e-f18cb7b13838 (dataset): DatasetConfig { id: 4aa70354-cc70-458d-947e-f18cb7b13838 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55fb2728-6045-4668-af53-39ed4d3ec430 (dataset): DatasetConfig { id: 55fb2728-6045-4668-af53-39ed4d3ec430 (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a10d45f-c945-4391-a273-145a9ad7392c (dataset): DatasetConfig { id: 5a10d45f-c945-4391-a273-145a9ad7392c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63ba13a3-f9aa-4267-9adf-106184a269eb (dataset): DatasetConfig { id: 63ba13a3-f9aa-4267-9adf-106184a269eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64e1dff1-1c90-4f75-a78a-0c74f928bfba (dataset): DatasetConfig { id: 64e1dff1-1c90-4f75-a78a-0c74f928bfba (dataset), name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 728c9f9b-d49b-4ddd-a924-366493b41072 (dataset): DatasetConfig { id: 728c9f9b-d49b-4ddd-a924-366493b41072 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7404a72e-ab81-4676-902a-0a9ea6b45489 (dataset): DatasetConfig { id: 7404a72e-ab81-4676-902a-0a9ea6b45489 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 741f5009-990e-4509-aa98-fc8f23eb43f4 (dataset): DatasetConfig { id: 741f5009-990e-4509-aa98-fc8f23eb43f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bea3278-247f-4e81-af79-e09e29f04737 (dataset): DatasetConfig { id: 7bea3278-247f-4e81-af79-e09e29f04737 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c840432-864e-468f-98a2-b6ed117c220b (dataset): DatasetConfig { id: 7c840432-864e-468f-98a2-b6ed117c220b (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f897b04-68da-45bf-9257-79c3da60a35d (dataset): DatasetConfig { id: 7f897b04-68da-45bf-9257-79c3da60a35d (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8169b41b-66f1-41d0-bf2b-f93894468bce (dataset): DatasetConfig { id: 8169b41b-66f1-41d0-bf2b-f93894468bce (dataset), name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85309575-dfd4-422d-b455-c6806ab966ec (dataset): DatasetConfig { id: 85309575-dfd4-422d-b455-c6806ab966ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 859f7528-f850-48f1-a891-4e1677998bdf (dataset): DatasetConfig { id: 859f7528-f850-48f1-a891-4e1677998bdf (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 891c5150-142b-40e4-a590-25f8bf7cf66a (dataset): DatasetConfig { id: 891c5150-142b-40e4-a590-25f8bf7cf66a (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ab9129a-903f-4df5-8338-1c05fa1dbb15 (dataset): DatasetConfig { id: 8ab9129a-903f-4df5-8338-1c05fa1dbb15 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b280873-f4dc-49c3-bd87-7ef71db381b7 (dataset): DatasetConfig { id: 8b280873-f4dc-49c3-bd87-7ef71db381b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8dd0f1c2-f952-4ac3-aa58-d149ef730863 (dataset): DatasetConfig { id: 8dd0f1c2-f952-4ac3-aa58-d149ef730863 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 909b860b-0ea9-405e-b77d-c8f94465f0f6 (dataset): DatasetConfig { id: 909b860b-0ea9-405e-b77d-c8f94465f0f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9196d333-2b1d-4dcc-a9ca-d1b96356a279 (dataset): DatasetConfig { id: 9196d333-2b1d-4dcc-a9ca-d1b96356a279 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97de28e1-5c4d-43d8-8b92-0ee853797380 (dataset): DatasetConfig { id: 97de28e1-5c4d-43d8-8b92-0ee853797380 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9beda3a5-8aa5-4ca7-8411-f9045f13c949 (dataset): DatasetConfig { id: 9beda3a5-8aa5-4ca7-8411-f9045f13c949 (dataset), name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9d8446e7-350e-4d4b-af52-df959502af24 (dataset): DatasetConfig { id: 9d8446e7-350e-4d4b-af52-df959502af24 (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e2a849e-3187-4e2e-aa5c-b46389b2245f (dataset): DatasetConfig { id: 9e2a849e-3187-4e2e-aa5c-b46389b2245f (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9ae42ce-89ac-498c-beaa-df35884240ef (dataset): DatasetConfig { id: a9ae42ce-89ac-498c-beaa-df35884240ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, abedf07c-dcb3-40b2-ba98-d22d7dc6a308 (dataset): DatasetConfig { id: abedf07c-dcb3-40b2-ba98-d22d7dc6a308 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae6afad6-ad72-4012-b135-954f01a41772 (dataset): DatasetConfig { id: ae6afad6-ad72-4012-b135-954f01a41772 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0ee34f9-0bc4-4ef7-bf43-6849ceb5e222 (dataset): DatasetConfig { id: b0ee34f9-0bc4-4ef7-bf43-6849ceb5e222 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0f11a24-0508-42bd-becb-285157f4d32b (dataset): DatasetConfig { id: b0f11a24-0508-42bd-becb-285157f4d32b (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b84fa6af-0afc-4779-b0ae-720dd5e097d7 (dataset): DatasetConfig { id: b84fa6af-0afc-4779-b0ae-720dd5e097d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bbf2eec4-7674-4667-a009-5b63768ffa07 (dataset): DatasetConfig { id: bbf2eec4-7674-4667-a009-5b63768ffa07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bebf1c30-7e04-4e41-8290-c8e99f8a58c4 (dataset): DatasetConfig { id: bebf1c30-7e04-4e41-8290-c8e99f8a58c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0c4fdd7-710b-400d-94fa-b4de6b700825 (dataset): DatasetConfig { id: c0c4fdd7-710b-400d-94fa-b4de6b700825 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2242ed1-5ac0-4767-9cac-e752d6d424b9 (dataset): DatasetConfig { id: c2242ed1-5ac0-4767-9cac-e752d6d424b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5448452-ed54-4343-a624-05913d65dbb2 (dataset): DatasetConfig { id: c5448452-ed54-4343-a624-05913d65dbb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c618bace-4861-4291-9763-277ca709f6cd (dataset): DatasetConfig { id: c618bace-4861-4291-9763-277ca709f6cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9bafeab-6656-4b67-a4e3-c00e89a760a7 (dataset): DatasetConfig { id: c9bafeab-6656-4b67-a4e3-c00e89a760a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc6afaed-205a-4536-b873-85aa5b82da19 (dataset): DatasetConfig { id: cc6afaed-205a-4536-b873-85aa5b82da19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6b781ed-0da9-4aba-882b-072942fbaa60 (dataset): DatasetConfig { id: d6b781ed-0da9-4aba-882b-072942fbaa60 (dataset), name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3b3dd53-cd94-4474-9d87-64dfbde400b8 (dataset): DatasetConfig { id: e3b3dd53-cd94-4474-9d87-64dfbde400b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e679d3ce-7944-4e12-be44-d8fba85e8262 (dataset): DatasetConfig { id: e679d3ce-7944-4e12-be44-d8fba85e8262 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f66535f3-f42a-4e2b-80cb-3fc97209a57d (dataset): DatasetConfig { id: f66535f3-f42a-4e2b-80cb-3fc97209a57d (dataset), name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faf208b8-20cb-4ffd-80df-ed22f4c1f621 (dataset): DatasetConfig { id: faf208b8-20cb-4ffd-80df-ed22f4c1f621 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd5fcbbd-bfde-4431-8d26-381c61a9ea12 (dataset): DatasetConfig { id: fd5fcbbd-bfde-4431-8d26-381c61a9ea12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ffbe84fb-0e3f-4c77-a2a8-b72fb64c9f2a (dataset): DatasetConfig { id: ffbe84fb-0e3f-4c77-a2a8-b72fb64c9f2a (dataset), name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462025-01-17T07:27:17.037ZINFOSledAgent (StorageManager): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-01-17T07:27:17.037ZINFOSledAgent (StorageManager): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482025-01-17T07:27:17.037ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492025-01-17T07:27:17.053ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502025-01-17T07:27:17.053ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4512025-01-17T07:27:17.053ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4522025-01-17T07:27:17.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532025-01-17T07:27:17.106ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542025-01-17T07:27:17.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/zone/oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f"), full_name: "oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/zone/oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f" } file = sled-storage/src/manager.rs:1431
4552025-01-17T07:27:17.163ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-01-17T07:27:17.163ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4572025-01-17T07:27:17.163ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab" } file = sled-storage/src/manager.rs:1431
4582025-01-17T07:27:17.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-01-17T07:27:17.225ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602025-01-17T07:27:17.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/zone/oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945"), full_name: "oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/zone/oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945" } file = sled-storage/src/manager.rs:1431
4612025-01-17T07:27:17.284ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-17T07:27:17.284ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4632025-01-17T07:27:17.284ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/debug"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/debug" } file = sled-storage/src/manager.rs:1431
4642025-01-17T07:27:17.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-01-17T07:27:17.313ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-01-17T07:27:17.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c" } file = sled-storage/src/manager.rs:1431
4672025-01-17T07:27:17.373ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-17T07:27:17.373ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4692025-01-17T07:27:17.373ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/debug"), full_name: "oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/debug" } file = sled-storage/src/manager.rs:1431
4702025-01-17T07:27:17.401ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-17T07:27:17.401ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4722025-01-17T07:27:17.401ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/zone"), full_name: "oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/zone" } file = sled-storage/src/manager.rs:1431
4732025-01-17T07:27:17.431ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-17T07:27:17.431ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752025-01-17T07:27:17.431ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659" } file = sled-storage/src/manager.rs:1431
4762025-01-17T07:27:17.488ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-17T07:27:17.488ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-01-17T07:27:17.488ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93" } file = sled-storage/src/manager.rs:1431
4792025-01-17T07:27:17.546ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-01-17T07:27:17.546ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-01-17T07:27:17.546ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/zone/oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3"), full_name: "oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/zone/oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3" } file = sled-storage/src/manager.rs:1431
4822025-01-17T07:27:17.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-01-17T07:27:17.603ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842025-01-17T07:27:17.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4852025-01-17T07:27:17.648ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-01-17T07:27:17.648ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4872025-01-17T07:27:17.648ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/debug"), full_name: "oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/debug" } file = sled-storage/src/manager.rs:1431
4882025-01-17T07:27:17.677ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-01-17T07:27:17.677ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4902025-01-17T07:27:17.677ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/zone"), full_name: "oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/zone" } file = sled-storage/src/manager.rs:1431
4912025-01-17T07:27:17.681ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/df37d1c6-999a-4855-92c3-920ccfa9c7b0) file = sled-agent/src/probe_manager.rs:231 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
4922025-01-17T07:27:17.707ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-01-17T07:27:17.707ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942025-01-17T07:27:17.707ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4952025-01-17T07:27:17.755ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-01-17T07:27:17.755ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972025-01-17T07:27:17.755ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5a87517-097c-4a2f-afbf-79d6c9f09841/crypt/zone/oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742"), full_name: "oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841/crypt/zone/oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742" } file = sled-storage/src/manager.rs:1431
4982025-01-17T07:27:17.812ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-01-17T07:27:17.812ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002025-01-17T07:27:17.812ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5012025-01-17T07:27:17.862ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-01-17T07:27:17.862ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-01-17T07:27:17.862ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/zone/oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7"), full_name: "oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/zone/oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7" } file = sled-storage/src/manager.rs:1431
5042025-01-17T07:27:17.917ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-01-17T07:27:17.917ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062025-01-17T07:27:17.917ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone/oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42"), full_name: "oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone/oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42" } file = sled-storage/src/manager.rs:1431
5072025-01-17T07:27:17.979ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-01-17T07:27:17.979ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092025-01-17T07:27:17.979ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841/crucible" } file = sled-storage/src/manager.rs:1431
5102025-01-17T07:27:18.028ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-01-17T07:27:18.028ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122025-01-17T07:27:18.028ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crucible" } file = sled-storage/src/manager.rs:1431
5132025-01-17T07:27:18.077ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-01-17T07:27:18.077ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152025-01-17T07:27:18.077ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crucible" } file = sled-storage/src/manager.rs:1431
5162025-01-17T07:27:18.124ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-01-17T07:27:18.124ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5182025-01-17T07:27:18.124ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5192025-01-17T07:27:18.173ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-01-17T07:27:18.173ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5212025-01-17T07:27:18.173ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac" } file = sled-storage/src/manager.rs:1431
5222025-01-17T07:27:18.234ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-17T07:27:18.234ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-01-17T07:27:18.234ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/zone/oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946"), full_name: "oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/zone/oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946" } file = sled-storage/src/manager.rs:1431
5252025-01-17T07:27:18.292ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-01-17T07:27:18.292ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5272025-01-17T07:27:18.292ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crucible" } file = sled-storage/src/manager.rs:1431
5282025-01-17T07:27:18.340ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-01-17T07:27:18.340ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302025-01-17T07:27:18.340ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone/oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6"), full_name: "oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone/oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6" } file = sled-storage/src/manager.rs:1431
5312025-01-17T07:27:18.398ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-01-17T07:27:18.399ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332025-01-17T07:27:18.399ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/zone/oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21"), full_name: "oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/zone/oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21" } file = sled-storage/src/manager.rs:1431
5342025-01-17T07:27:18.463ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-17T07:27:18.463ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-01-17T07:27:18.463ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crucible" } file = sled-storage/src/manager.rs:1431
5372025-01-17T07:27:18.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-17T07:27:18.512ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5392025-01-17T07:27:18.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone" } file = sled-storage/src/manager.rs:1431
5402025-01-17T07:27:18.542ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-17T07:27:18.542ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-01-17T07:27:18.542ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone/oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc"), full_name: "oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone/oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc" } file = sled-storage/src/manager.rs:1431
5432025-01-17T07:27:18.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-01-17T07:27:18.603ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-01-17T07:27:18.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd/crucible" } file = sled-storage/src/manager.rs:1431
5462025-01-17T07:27:18.651ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-01-17T07:27:18.651ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5482025-01-17T07:27:18.651ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crypt/zone"), full_name: "oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crypt/zone" } file = sled-storage/src/manager.rs:1431
5492025-01-17T07:27:18.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-01-17T07:27:18.680ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-01-17T07:27:18.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f" } file = sled-storage/src/manager.rs:1431
5522025-01-17T07:27:18.684ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/df37d1c6-999a-4855-92c3-920ccfa9c7b0) file = sled-agent/src/probe_manager.rs:231 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
5532025-01-17T07:27:18.742ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-17T07:27:18.742ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5552025-01-17T07:27:18.742ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/debug"), full_name: "oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/debug" } file = sled-storage/src/manager.rs:1431
5562025-01-17T07:27:18.771ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-17T07:27:18.771ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5582025-01-17T07:27:18.771ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe" } file = sled-storage/src/manager.rs:1431
5592025-01-17T07:27:18.832ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-01-17T07:27:18.832ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5612025-01-17T07:27:18.832ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5622025-01-17T07:27:18.882ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-01-17T07:27:18.882ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5642025-01-17T07:27:18.882ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/debug"), full_name: "oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/debug" } file = sled-storage/src/manager.rs:1431
5652025-01-17T07:27:18.912ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-01-17T07:27:18.912ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5672025-01-17T07:27:18.912ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/zone"), full_name: "oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/zone" } file = sled-storage/src/manager.rs:1431
5682025-01-17T07:27:18.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-01-17T07:27:18.943ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-01-17T07:27:18.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crucible" } file = sled-storage/src/manager.rs:1431
5712025-01-17T07:27:18.991ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-01-17T07:27:18.991ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5732025-01-17T07:27:18.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/zone"), full_name: "oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/zone" } file = sled-storage/src/manager.rs:1431
5742025-01-17T07:27:19.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-01-17T07:27:19.021ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762025-01-17T07:27:19.021ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5772025-01-17T07:27:19.071ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782025-01-17T07:27:19.071ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5792025-01-17T07:27:19.071ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crypt/debug"), full_name: "oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crypt/debug" } file = sled-storage/src/manager.rs:1431
5802025-01-17T07:27:19.100ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812025-01-17T07:27:19.100ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5822025-01-17T07:27:19.100ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/zone/oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c"), full_name: "oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/zone/oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c" } file = sled-storage/src/manager.rs:1431
5832025-01-17T07:27:19.163ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-01-17T07:27:19.163ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5852025-01-17T07:27:19.163ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone" } file = sled-storage/src/manager.rs:1431
5862025-01-17T07:27:19.192ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-01-17T07:27:19.192ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5882025-01-17T07:27:19.192ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/zone/oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a"), full_name: "oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/zone/oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a" } file = sled-storage/src/manager.rs:1431
5892025-01-17T07:27:19.251ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-01-17T07:27:19.251ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5912025-01-17T07:27:19.251ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone"), full_name: "oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone" } file = sled-storage/src/manager.rs:1431
5922025-01-17T07:27:19.281ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-01-17T07:27:19.281ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5942025-01-17T07:27:19.281ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5a87517-097c-4a2f-afbf-79d6c9f09841/crypt/zone"), full_name: "oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841/crypt/zone" } file = sled-storage/src/manager.rs:1431
5952025-01-17T07:27:19.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-01-17T07:27:19.310ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-01-17T07:27:19.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/zone/oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa" } file = sled-storage/src/manager.rs:1431
5982025-01-17T07:27:19.372ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-01-17T07:27:19.372ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002025-01-17T07:27:19.372ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crucible" } file = sled-storage/src/manager.rs:1431
6012025-01-17T07:27:19.421ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-17T07:27:19.421ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6032025-01-17T07:27:19.421ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/debug"), full_name: "oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/debug" } file = sled-storage/src/manager.rs:1431
6042025-01-17T07:27:19.451ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-17T07:27:19.451ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-01-17T07:27:19.451ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4" } file = sled-storage/src/manager.rs:1431
6072025-01-17T07:27:19.510ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-01-17T07:27:19.511ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-01-17T07:27:19.511ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone/oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d"), full_name: "oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/zone/oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d" } file = sled-storage/src/manager.rs:1431
6102025-01-17T07:27:19.571ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-01-17T07:27:19.571ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-01-17T07:27:19.571ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6132025-01-17T07:27:19.621ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-01-17T07:27:19.621ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6152025-01-17T07:27:19.621ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5a87517-097c-4a2f-afbf-79d6c9f09841/crypt/debug"), full_name: "oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841/crypt/debug" } file = sled-storage/src/manager.rs:1431
6162025-01-17T07:27:19.649ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-01-17T07:27:19.649ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-01-17T07:27:19.649ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/zone/oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6"), full_name: "oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/zone/oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6" } file = sled-storage/src/manager.rs:1431
6192025-01-17T07:27:19.688ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/df37d1c6-999a-4855-92c3-920ccfa9c7b0) file = sled-agent/src/probe_manager.rs:231 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
6202025-01-17T07:27:19.711ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212025-01-17T07:27:19.711ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222025-01-17T07:27:19.711ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/zone/oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9"), full_name: "oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/zone/oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9" } file = sled-storage/src/manager.rs:1431
6232025-01-17T07:27:19.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242025-01-17T07:27:19.770ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6252025-01-17T07:27:19.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/zone/oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea"), full_name: "oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/zone/oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea" } file = sled-storage/src/manager.rs:1431
6262025-01-17T07:27:19.830ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272025-01-17T07:27:19.830ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6282025-01-17T07:27:19.830ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/zone/oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06" } file = sled-storage/src/manager.rs:1431
6292025-01-17T07:27:19.892ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302025-01-17T07:27:19.892ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6312025-01-17T07:27:19.892ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/zone/oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357"), full_name: "oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/zone/oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357" } file = sled-storage/src/manager.rs:1431
6322025-01-17T07:27:19.952ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332025-01-17T07:27:19.952ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6342025-01-17T07:27:19.952ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crucible" } file = sled-storage/src/manager.rs:1431
6352025-01-17T07:27:20.002ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362025-01-17T07:27:20.002ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6372025-01-17T07:27:20.002ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6382025-01-17T07:27:20.054ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392025-01-17T07:27:20.054ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6402025-01-17T07:27:20.054ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6412025-01-17T07:27:20.105ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422025-01-17T07:27:20.105ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6432025-01-17T07:27:20.105ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6442025-01-17T07:27:20.157ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452025-01-17T07:27:20.157ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6462025-01-17T07:27:20.157ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/debug"), full_name: "oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/debug" } file = sled-storage/src/manager.rs:1431
6472025-01-17T07:27:20.186ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-01-17T07:27:20.186ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492025-01-17T07:27:20.186ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crypt/zone/oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0"), full_name: "oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crypt/zone/oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0" } file = sled-storage/src/manager.rs:1431
6502025-01-17T07:27:20.245ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-01-17T07:27:20.246ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-01-17T07:27:20.246ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
6532025-01-17T07:27:20.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3209872 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43731 req_id = fbcd1967-7e97-4014-855c-91b38b6e938f response_code = 200 uri = /datasets
6542025-01-17T07:27:20.278ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: fab31cae-2ea6-4f97-8611-18d3b56c8ea4 (service), filesystem_pool: Some(ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dbdaece5-9641-48e5-bdfa-a6e53d2ea04c (service), filesystem_pool: Some(ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1f4fed10-b665-48cc-aef3-c72819dc09a6 (service), filesystem_pool: Some(ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6552025-01-17T07:27:20.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33699
6562025-01-17T07:27:20.278ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572025-01-17T07:27:20.278ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582025-01-17T07:27:20.288ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-01-17T07:27:20.288ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-01-17T07:27:20.297ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-01-17T07:27:20.297ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-01-17T07:27:20.305ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6632025-01-17T07:27:20.305ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-01-17T07:27:20.305ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-01-17T07:27:20.305ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-17T07:27:20.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-17T07:27:20.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-17T07:27:20.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-01-17T07:27:20.408ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c file = illumos-utils/src/zone.rs:325
6702025-01-17T07:27:20.412ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4 file = illumos-utils/src/zone.rs:325
6712025-01-17T07:27:20.416ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6 file = illumos-utils/src/zone.rs:325
6722025-01-17T07:27:20.429ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c file = illumos-utils/src/zone.rs:363
6732025-01-17T07:27:20.433ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4 file = illumos-utils/src/zone.rs:363
6742025-01-17T07:27:20.437ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6 file = illumos-utils/src/zone.rs:363
6752025-01-17T07:27:20.690ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/df37d1c6-999a-4855-92c3-920ccfa9c7b0) file = sled-agent/src/probe_manager.rs:231 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
6762025-01-17T07:27:20.949ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 14.989886491s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
6772025-01-17T07:27:22.042ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782025-01-17T07:27:22.042ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6792025-01-17T07:27:22.521ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802025-01-17T07:27:22.587ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4815810790603203322 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
6812025-01-17T07:27:22.587ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8607143573036432723 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
6822025-01-17T07:27:22.903ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6832025-01-17T07:27:22.903ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6842025-01-17T07:27:22.909ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6852025-01-17T07:27:22.909ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6862025-01-17T07:27:22.999ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6872025-01-17T07:27:22.999ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6882025-01-17T07:27:22.999ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
6892025-01-17T07:27:23.003ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6902025-01-17T07:27:23.003ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
6912025-01-17T07:27:23.009ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
6922025-01-17T07:27:23.068ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
6932025-01-17T07:27:23.068ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
6942025-01-17T07:27:23.116ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
6952025-01-17T07:27:23.116ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
6962025-01-17T07:27:23.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 60.369312ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
6972025-01-17T07:27:23.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 49.550659ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
6982025-01-17T07:27:23.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 70.511196ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
6992025-01-17T07:27:23.173ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
7002025-01-17T07:27:23.173ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
7012025-01-17T07:27:23.194ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
7022025-01-17T07:27:23.194ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
7032025-01-17T07:27:23.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 104.751805ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7042025-01-17T07:27:23.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 126.400893ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7052025-01-17T07:27:23.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 269.467665ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7062025-01-17T07:27:23.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 135.943273ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7072025-01-17T07:27:23.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 263.11841ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7082025-01-17T07:27:23.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 189.837872ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7092025-01-17T07:27:23.721ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
7102025-01-17T07:27:23.721ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
7112025-01-17T07:27:23.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 397.916557ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7122025-01-17T07:27:23.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 500.132381ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7132025-01-17T07:27:23.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 298.458147ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7142025-01-17T07:27:23.947ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7152025-01-17T07:27:23.947ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7162025-01-17T07:27:23.998ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7172025-01-17T07:27:24.035ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7182025-01-17T07:27:24.035ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7192025-01-17T07:27:24.036ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7202025-01-17T07:27:24.036ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7212025-01-17T07:27:24.079ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7222025-01-17T07:27:24.100ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14349206130351978021 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
7232025-01-17T07:27:24.100ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17074793336039695850 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
7242025-01-17T07:27:24.138ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7252025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7262025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7272025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7282025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7302025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7322025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7342025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7362025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7382025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7402025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7422025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7442025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7462025-01-17T07:27:24.138ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472025-01-17T07:27:24.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 568.374566ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7482025-01-17T07:27:24.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 1.121459101s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7492025-01-17T07:27:24.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 458.186951ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7502025-01-17T07:27:24.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 643.529932ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7512025-01-17T07:27:24.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 515.935725ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7522025-01-17T07:27:25.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 1.126664622s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7532025-01-17T07:27:25.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 843.053649ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7542025-01-17T07:27:25.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 1.033697374s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7552025-01-17T07:27:26.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 1.282644473s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7562025-01-17T07:27:26.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 722.794696ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7572025-01-17T07:27:26.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 845.789132ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7582025-01-17T07:27:27.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 1.283116046s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7592025-01-17T07:27:27.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 539.210952ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7602025-01-17T07:27:27.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 1.389626824s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7612025-01-17T07:27:27.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 1.180350575s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7622025-01-17T07:27:28.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 967.474166ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7632025-01-17T07:27:28.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6") failed: Property not found. retry in 1.428419806s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7642025-01-17T07:27:29.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 567.077068ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7652025-01-17T07:27:29.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c") failed: Property not found. retry in 970.751544ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7662025-01-17T07:27:29.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4") failed: Property not found. retry in 714.547562ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7672025-01-17T07:27:30.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_dbdaece5-9641-48e5-bdfa-a6e53d2ea04c
7682025-01-17T07:27:30.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_fab31cae-2ea6-4f97-8611-18d3b56c8ea4
7692025-01-17T07:27:30.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_1f4fed10-b665-48cc-aef3-c72819dc09a6
7702025-01-17T07:27:30.450ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7712025-01-17T07:27:30.451ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722025-01-17T07:27:30.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10173090 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33699 req_id = 5ab05445-e3bb-4127-9979-168c5f7ccf0a response_code = 204 uri = /omicron-zones
7732025-01-17T07:27:30.454ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742025-01-17T07:27:31.794ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 97.876672ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7752025-01-17T07:27:31.939ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7762025-01-17T07:27:32.012ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7772025-01-17T07:27:32.089ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7782025-01-17T07:27:32.089ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7792025-01-17T07:27:32.119ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7802025-01-17T07:27:32.120ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7812025-01-17T07:27:32.120ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7822025-01-17T07:27:32.148ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: fab31cae-2ea6-4f97-8611-18d3b56c8ea4 (service), filesystem_pool: Some(ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dbdaece5-9641-48e5-bdfa-a6e53d2ea04c (service), filesystem_pool: Some(ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1f4fed10-b665-48cc-aef3-c72819dc09a6 (service), filesystem_pool: Some(ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 53bbe71b-6682-4ca8-aabc-d16241278ddc (service), filesystem_pool: Some(ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 169d26ba-8832-42cd-bf08-39cd2daa0ef9, kind: Service { id: 53bbe71b-6682-4ca8-aabc-d16241278ddc }, name: Name("ntp-53bbe71b-6682-4ca8-aabc-d16241278ddc"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 77])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7832025-01-17T07:27:32.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50900
7842025-01-17T07:27:32.149ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-01-17T07:27:32.149ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-01-17T07:27:32.160ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872025-01-17T07:27:32.160ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882025-01-17T07:27:32.171ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7892025-01-17T07:27:32.171ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7902025-01-17T07:27:32.181ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7912025-01-17T07:27:32.181ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:177
7922025-01-17T07:27:32.181ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:177
7932025-01-17T07:27:32.181ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7942025-01-17T07:27:32.192ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7952025-01-17T07:27:32.224ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7962025-01-17T07:27:32.226ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7972025-01-17T07:27:32.226ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7982025-01-17T07:27:32.256ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 160, 77]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7992025-01-17T07:27:32.256ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
8002025-01-17T07:27:32.257ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
8012025-01-17T07:27:32.257ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8022025-01-17T07:27:32.257ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8032025-01-17T07:27:32.258ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8042025-01-17T07:27:32.282ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc file = illumos-utils/src/zone.rs:325
8052025-01-17T07:27:32.299ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc file = illumos-utils/src/zone.rs:363
8062025-01-17T07:27:32.589ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4815810790603203322 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8072025-01-17T07:27:32.590ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8607143573036432723 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8082025-01-17T07:27:32.931ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8092025-01-17T07:27:32.932ZINFOSledAgent (ServiceManager): Booting oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8102025-01-17T07:27:33.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 71.100936ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8112025-01-17T07:27:33.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 110.250671ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8122025-01-17T07:27:33.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 150.849ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8132025-01-17T07:27:33.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 557.431298ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8142025-01-17T07:27:34.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 406.763879ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8152025-01-17T07:27:34.103ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14349206130351978021 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8162025-01-17T07:27:34.103ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17074793336039695850 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8172025-01-17T07:27:34.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 1.062259232s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8182025-01-17T07:27:35.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 1.309777526s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8192025-01-17T07:27:36.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 608.971139ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8202025-01-17T07:27:37.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 784.043149ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8212025-01-17T07:27:38.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc") failed: Property not found. retry in 520.890807ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8222025-01-17T07:27:38.764ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc
8232025-01-17T07:27:38.764ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8242025-01-17T07:27:38.764ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8252025-01-17T07:27:38.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6615783 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50900 req_id = 58c990ea-93aa-4920-bf27-12aeeb57d509 response_code = 204 uri = /omicron-zones
8262025-01-17T07:27:38.767ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8272025-01-17T07:27:38.799ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8282025-01-17T07:27:38.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33633
8292025-01-17T07:27:38.810ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8302025-01-17T07:27:38.810ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9895 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33633 req_id = 324cc4d7-318b-4131-bb88-c696deff3f1b response_code = 500 uri = /timesync
8312025-01-17T07:27:38.812ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8322025-01-17T07:27:38.908ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8332025-01-17T07:27:38.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59240
8342025-01-17T07:27:40.393ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1902934489659442629 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8352025-01-17T07:27:40.396ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3509580735823069335 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8362025-01-17T07:27:40.453ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14083501009185061207 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8372025-01-17T07:27:42.592ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4815810790603203322 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8382025-01-17T07:27:42.592ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8607143573036432723 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8392025-01-17T07:27:42.917ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8402025-01-17T07:27:42.917ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008644 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59240 req_id = d9c215ac-d5f8-47c5-b2c7-a6efd6ddd394 response_code = 500 uri = /timesync
8412025-01-17T07:27:42.919ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8422025-01-17T07:27:43.091ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8432025-01-17T07:27:43.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41303
8442025-01-17T07:27:43.100ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8452025-01-17T07:27:43.100ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41303 req_id = b706d750-8851-4ed3-9725-5e4035be4d65 response_code = 500 uri = /timesync
8462025-01-17T07:27:43.102ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8472025-01-17T07:27:43.306ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8482025-01-17T07:27:43.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40666
8492025-01-17T07:27:43.315ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_53bbe71b-6682-4ca8-aabc-d16241278ddc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8502025-01-17T07:27:43.315ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40666 req_id = 2ffe41e1-6605-49d7-ba69-f91a482d235e response_code = 500 uri = /timesync
8512025-01-17T07:27:43.318ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8522025-01-17T07:27:43.466ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8532025-01-17T07:27:43.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60151
8542025-01-17T07:27:44.105ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14349206130351978021 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8552025-01-17T07:27:44.105ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17074793336039695850 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
8562025-01-17T07:27:45.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2008648 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60151 req_id = ee734004-8bbf-4227-b334-84738beafec7 response_code = 200 uri = /timesync
8572025-01-17T07:27:45.478ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8582025-01-17T07:27:45.478ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8592025-01-17T07:27:45.762ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8602025-01-17T07:27:45.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43713
8612025-01-17T07:27:45.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8665 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43713 req_id = c83aa4a8-51d2-4d1a-a2d4-b99970be6498 response_code = 200 uri = /timesync
8622025-01-17T07:27:45.773ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8632025-01-17T07:27:45.773ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8642025-01-17T07:27:46.003ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8652025-01-17T07:27:46.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53279
8662025-01-17T07:27:46.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 21302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53279 req_id = c247a01f-a5a2-4b4e-98fb-afe623ffbeed response_code = 200 uri = /timesync
8672025-01-17T07:27:46.027ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1737098865.8147569, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8682025-01-17T07:27:46.027ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8692025-01-17T07:27:46.057ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: fab31cae-2ea6-4f97-8611-18d3b56c8ea4 (service), filesystem_pool: Some(ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dbdaece5-9641-48e5-bdfa-a6e53d2ea04c (service), filesystem_pool: Some(ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1f4fed10-b665-48cc-aef3-c72819dc09a6 (service), filesystem_pool: Some(ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 53bbe71b-6682-4ca8-aabc-d16241278ddc (service), filesystem_pool: Some(ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 169d26ba-8832-42cd-bf08-39cd2daa0ef9, kind: Service { id: 53bbe71b-6682-4ca8-aabc-d16241278ddc }, name: Name("ntp-53bbe71b-6682-4ca8-aabc-d16241278ddc"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 77])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4896713c-2107-4645-b617-cf29721364ac (service), filesystem_pool: Some(ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 41a13545-c711-4591-980c-7a9e929094fe (service), filesystem_pool: Some(ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 94699704-d43c-40ca-b4ea-83b2aa9ce4b7 (service), filesystem_pool: Some(ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External } } } }, OmicronZoneConfig { id: d22dace2-3272-4105-b8f5-8238f224c946 (service), filesystem_pool: Some(ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External } } } }, OmicronZoneConfig { id: cbf0583b-62a0-4bc5-bb88-92b0d0bb4357 (service), filesystem_pool: Some(ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8702025-01-17T07:27:46.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39254
8712025-01-17T07:27:46.057ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8722025-01-17T07:27:46.057ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8732025-01-17T07:27:46.067ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8742025-01-17T07:27:46.067ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8752025-01-17T07:27:46.078ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8762025-01-17T07:27:46.078ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
8772025-01-17T07:27:46.088ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8782025-01-17T07:27:46.088ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8792025-01-17T07:27:46.098ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8802025-01-17T07:27:46.098ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8812025-01-17T07:27:46.106ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8822025-01-17T07:27:46.107ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Cockroach }, responder: ... }
8832025-01-17T07:27:46.116ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8842025-01-17T07:27:46.116ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8852025-01-17T07:27:46.126ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8862025-01-17T07:27:46.126ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Cockroach }, responder: ... }
8872025-01-17T07:27:46.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8882025-01-17T07:27:46.135ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:177
8892025-01-17T07:27:46.135ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:177
8902025-01-17T07:27:46.135ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8912025-01-17T07:27:46.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8922025-01-17T07:27:46.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8932025-01-17T07:27:46.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8942025-01-17T07:27:46.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8952025-01-17T07:27:46.218ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8962025-01-17T07:27:46.306ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7 file = illumos-utils/src/zone.rs:325
8972025-01-17T07:27:46.310ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946 file = illumos-utils/src/zone.rs:325
8982025-01-17T07:27:46.314ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac file = illumos-utils/src/zone.rs:325
8992025-01-17T07:27:46.318ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe file = illumos-utils/src/zone.rs:325
9002025-01-17T07:27:46.323ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357 file = illumos-utils/src/zone.rs:325
9012025-01-17T07:27:46.327ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7 file = illumos-utils/src/zone.rs:363
9022025-01-17T07:27:46.332ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946 file = illumos-utils/src/zone.rs:363
9032025-01-17T07:27:46.336ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac file = illumos-utils/src/zone.rs:363
9042025-01-17T07:27:46.341ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe file = illumos-utils/src/zone.rs:363
9052025-01-17T07:27:46.346ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357 file = illumos-utils/src/zone.rs:363
9062025-01-17T07:27:49.723ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d22dace2-3272-4105-b8f5-8238f224c946'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9072025-01-17T07:27:49.723ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9082025-01-17T07:27:49.793ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cbf0583b-62a0-4bc5-bb88-92b0d0bb4357'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9092025-01-17T07:27:49.793ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='94699704-d43c-40ca-b4ea-83b2aa9ce4b7'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9102025-01-17T07:27:49.793ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9112025-01-17T07:27:49.799ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9122025-01-17T07:27:49.841ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4896713c-2107-4645-b617-cf29721364ac'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9132025-01-17T07:27:49.841ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='41a13545-c711-4591-980c-7a9e929094fe'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9142025-01-17T07:27:49.841ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9152025-01-17T07:27:49.847ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9162025-01-17T07:27:49.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 63.941612ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9172025-01-17T07:27:49.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 57.5335ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9182025-01-17T07:27:49.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 27.089972ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9192025-01-17T07:27:49.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 124.457353ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9202025-01-17T07:27:49.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 137.392234ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9212025-01-17T07:27:50.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 139.693612ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9222025-01-17T07:27:50.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 49.784209ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9232025-01-17T07:27:50.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 116.029891ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9242025-01-17T07:27:50.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 251.314545ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9252025-01-17T07:27:50.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 61.700685ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9262025-01-17T07:27:50.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 39.362398ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9272025-01-17T07:27:50.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 161.988228ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9282025-01-17T07:27:50.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 556.583928ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9292025-01-17T07:27:50.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 119.594158ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9302025-01-17T07:27:50.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 65.12753ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9312025-01-17T07:27:50.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 568.279255ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9322025-01-17T07:27:51.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 265.890898ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9332025-01-17T07:27:51.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 268.842284ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9342025-01-17T07:27:51.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 317.238044ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9352025-01-17T07:27:51.181ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 294.473447ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
9362025-01-17T07:27:51.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 487.511475ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9372025-01-17T07:27:51.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 644.505324ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9382025-01-17T07:27:51.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 676.585476ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9392025-01-17T07:27:51.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 800.10183ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9402025-01-17T07:27:51.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 878.454161ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9412025-01-17T07:27:51.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 670.542585ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9422025-01-17T07:27:52.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 789.609003ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9432025-01-17T07:27:52.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 1.01366995s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9442025-01-17T07:27:52.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 1.235060414s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9452025-01-17T07:27:52.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 729.022651ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9462025-01-17T07:27:52.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 1.280211957s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9472025-01-17T07:27:52.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 1.367581459s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9482025-01-17T07:27:53.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 1.316193707s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9492025-01-17T07:27:53.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 513.971026ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9502025-01-17T07:27:53.306ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40033
9512025-01-17T07:27:53.306ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40033 req_id = ff1fd2a3-7eaa-46dd-9db2-1b9e31508c97 response_code = 200 uri = /baseboard
9522025-01-17T07:27:53.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 867.750834ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9532025-01-17T07:27:53.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 1.140150243s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9542025-01-17T07:27:53.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 1.21123061s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9552025-01-17T07:27:54.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 1.427292474s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9562025-01-17T07:27:54.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 638.923239ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9572025-01-17T07:27:54.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 1.229516449s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9582025-01-17T07:27:54.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 1.237087597s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9592025-01-17T07:27:55.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 738.279194ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9602025-01-17T07:27:55.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 1.362483036s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9612025-01-17T07:27:55.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 879.52849ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9622025-01-17T07:27:55.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 1.307996786s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9632025-01-17T07:27:55.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 898.900814ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9642025-01-17T07:27:56.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 1.16111058s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9652025-01-17T07:27:56.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 1.413383364s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9662025-01-17T07:27:56.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 1.398263889s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9672025-01-17T07:27:56.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 584.700731ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9682025-01-17T07:27:57.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 1.276149718s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9692025-01-17T07:27:57.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 814.962607ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9702025-01-17T07:27:57.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 702.147417ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9712025-01-17T07:27:57.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 971.541179ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9722025-01-17T07:27:57.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 1.158988689s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9732025-01-17T07:27:58.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 900.522286ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9742025-01-17T07:27:58.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 1.077315102s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9752025-01-17T07:27:58.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 1.305759032s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9762025-01-17T07:27:58.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 1.105684961s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9772025-01-17T07:27:58.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 1.092572215s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9782025-01-17T07:27:59.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 771.72205ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9792025-01-17T07:27:59.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 1.256344311s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9802025-01-17T07:27:59.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 589.772204ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9812025-01-17T07:27:59.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 689.112304ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9822025-01-17T07:27:59.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 982.739992ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9832025-01-17T07:28:00.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 1.030931632s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9842025-01-17T07:28:00.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 622.194389ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9852025-01-17T07:28:00.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 686.830971ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9862025-01-17T07:28:00.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 1.012855198s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9872025-01-17T07:28:00.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 522.766631ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9882025-01-17T07:28:00.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 1.367853744s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9892025-01-17T07:28:01.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 777.45705ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9902025-01-17T07:28:01.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 1.263025125s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9912025-01-17T07:28:01.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 1.26410367s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9922025-01-17T07:28:01.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 604.784793ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9932025-01-17T07:28:01.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe") failed: Property not found. retry in 1.216788594s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
9942025-01-17T07:28:02.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357") failed: Property not found. retry in 1.198014717s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
9952025-01-17T07:28:02.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac") failed: Property not found. retry in 1.106273721s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
9962025-01-17T07:28:02.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7") failed: Property not found. retry in 1.392550156s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9972025-01-17T07:28:02.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946") failed: Property not found. retry in 544.347638ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
9982025-01-17T07:28:03.836ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_94699704-d43c-40ca-b4ea-83b2aa9ce4b7
9992025-01-17T07:28:03.837ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_d22dace2-3272-4105-b8f5-8238f224c946
10002025-01-17T07:28:03.837ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_4896713c-2107-4645-b617-cf29721364ac
10012025-01-17T07:28:03.837ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe
10022025-01-17T07:28:03.837ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_cbf0583b-62a0-4bc5-bb88-92b0d0bb4357
10032025-01-17T07:28:03.837ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10042025-01-17T07:28:03.837ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10052025-01-17T07:28:03.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 17468194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39254 req_id = 6e0da951-9ffb-4874-9800-0486b4d14e0b response_code = 204 uri = /omicron-zones
10062025-01-17T07:28:03.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33796
10072025-01-17T07:28:03.901ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 30219 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 91c6444b-9633-4ee3-8cdd-836ffa0d35dc response_code = 500 uri = /cockroachdb
10082025-01-17T07:28:03.901ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "91c6444b-9633-4ee3-8cdd-836ffa0d35dc", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "91c6444b-9633-4ee3-8cdd-836ffa0d35dc" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 50.467397ms
10092025-01-17T07:28:03.981ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28233 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 642da1b7-0a0d-4c8c-b4bf-dc411c18054a response_code = 500 uri = /cockroachdb
10102025-01-17T07:28:03.981ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "642da1b7-0a0d-4c8c-b4bf-dc411c18054a", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "642da1b7-0a0d-4c8c-b4bf-dc411c18054a" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 152.988664ms
10112025-01-17T07:28:04.163ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = be98912c-ca45-4063-b0be-9d3490036c54 response_code = 500 uri = /cockroachdb
10122025-01-17T07:28:04.164ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "be98912c-ca45-4063-b0be-9d3490036c54", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "be98912c-ca45-4063-b0be-9d3490036c54" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 197.934232ms
10132025-01-17T07:28:04.390ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26185 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 1b0b1872-0094-4600-b5ea-cdb0f75ae107 response_code = 500 uri = /cockroachdb
10142025-01-17T07:28:04.390ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1b0b1872-0094-4600-b5ea-cdb0f75ae107", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1b0b1872-0094-4600-b5ea-cdb0f75ae107" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 253.023613ms
10152025-01-17T07:28:04.670ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 21e46561-d63c-40b3-9a37-50f360cecc93 response_code = 500 uri = /cockroachdb
10162025-01-17T07:28:04.670ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "21e46561-d63c-40b3-9a37-50f360cecc93", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "21e46561-d63c-40b3-9a37-50f360cecc93" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 221.92534ms
10172025-01-17T07:28:04.919ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26106 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 6d12c7d9-42b1-468f-b01e-d7130c01cb19 response_code = 500 uri = /cockroachdb
10182025-01-17T07:28:04.919ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6d12c7d9-42b1-468f-b01e-d7130c01cb19", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6d12c7d9-42b1-468f-b01e-d7130c01cb19" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 279.347507ms
10192025-01-17T07:28:05.225ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25707 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 49b77031-5262-4498-a439-6b509ead0419 response_code = 500 uri = /cockroachdb
10202025-01-17T07:28:05.225ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "49b77031-5262-4498-a439-6b509ead0419", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "49b77031-5262-4498-a439-6b509ead0419" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 231.804795ms
10212025-01-17T07:28:05.484ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26686 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 2e466473-d880-45dc-ba41-a436f4378ae6 response_code = 500 uri = /cockroachdb
10222025-01-17T07:28:05.484ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2e466473-d880-45dc-ba41-a436f4378ae6", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2e466473-d880-45dc-ba41-a436f4378ae6" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 326.23202ms
10232025-01-17T07:28:05.838ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26705 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = edef1e6f-e23e-45f4-a1e4-d2efd2c972ec response_code = 500 uri = /cockroachdb
10242025-01-17T07:28:05.838ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "edef1e6f-e23e-45f4-a1e4-d2efd2c972ec", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "edef1e6f-e23e-45f4-a1e4-d2efd2c972ec" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 292.487919ms
10252025-01-17T07:28:06.158ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26698 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = ca839f62-1554-46a5-9981-279b031c659c response_code = 500 uri = /cockroachdb
10262025-01-17T07:28:06.158ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ca839f62-1554-46a5-9981-279b031c659c", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ca839f62-1554-46a5-9981-279b031c659c" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 514.532479ms
10272025-01-17T07:28:06.516ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 278.679258ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
10282025-01-17T07:28:06.702ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_41a13545-c711-4591-980c-7a9e929094fe /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = f19ce8da-c4c3-4bdd-9550-dde5fc157779 response_code = 500 uri = /cockroachdb
10292025-01-17T07:28:06.702ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f19ce8da-c4c3-4bdd-9550-dde5fc157779", "content-length": "124", "date": "Fri, 17 Jan 2025 07:28:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f19ce8da-c4c3-4bdd-9550-dde5fc157779" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 748.437473ms
10302025-01-17T07:28:07.482ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3752
10312025-01-17T07:28:20.923ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10322025-01-17T07:28:24.714ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10332025-01-17T07:28:24.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 17266967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 07701ae1-87e9-45fe-a1b4-5b7db07ade2d response_code = 204 uri = /cockroachdb
10342025-01-17T07:28:24.721ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48445
10352025-01-17T07:28:24.725ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1661 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48445 req_id = 2ae90a10-71a7-40af-90d7-e64a518120b2 response_code = 200 uri = /baseboard
10362025-01-17T07:28:24.745ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.359012031s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
10372025-01-17T07:28:24.781ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: fab31cae-2ea6-4f97-8611-18d3b56c8ea4 (service), filesystem_pool: Some(ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dbdaece5-9641-48e5-bdfa-a6e53d2ea04c (service), filesystem_pool: Some(ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1f4fed10-b665-48cc-aef3-c72819dc09a6 (service), filesystem_pool: Some(ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 53bbe71b-6682-4ca8-aabc-d16241278ddc (service), filesystem_pool: Some(ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 169d26ba-8832-42cd-bf08-39cd2daa0ef9, kind: Service { id: 53bbe71b-6682-4ca8-aabc-d16241278ddc }, name: Name("ntp-53bbe71b-6682-4ca8-aabc-d16241278ddc"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 77])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4896713c-2107-4645-b617-cf29721364ac (service), filesystem_pool: Some(ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 41a13545-c711-4591-980c-7a9e929094fe (service), filesystem_pool: Some(ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 94699704-d43c-40ca-b4ea-83b2aa9ce4b7 (service), filesystem_pool: Some(ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External } } } }, OmicronZoneConfig { id: d22dace2-3272-4105-b8f5-8238f224c946 (service), filesystem_pool: Some(ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External } } } }, OmicronZoneConfig { id: cbf0583b-62a0-4bc5-bb88-92b0d0bb4357 (service), filesystem_pool: Some(ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External } } } }, OmicronZoneConfig { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f (service), filesystem_pool: Some(ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 (service), filesystem_pool: Some(ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: f16d291f-3318-414c-a9b3-9d3363ece06d (service), filesystem_pool: Some(ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a (service), filesystem_pool: Some(ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 (service), filesystem_pool: Some(ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1ecf123b-443e-4ca2-9ed7-9ec90a108b42 (service), filesystem_pool: Some(ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: df318fbc-9b9a-4388-8fdc-5133a37eac93 (service), filesystem_pool: Some(ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6932ae3c-49c6-471c-891d-407bdf64d9ea (service), filesystem_pool: Some(ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 629180bf-eb2d-4c88-87f4-7bd1ca2619fa (service), filesystem_pool: Some(ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 75bfdfe0-22a1-4105-b0f3-ce0725a4547c (service), filesystem_pool: Some(ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 8678e910-5aed-4627-8dc9-50a93f069a06 (service), filesystem_pool: Some(ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5d58141a-2ebb-4aeb-9024-39f48b947cab (service), filesystem_pool: Some(ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 13b872c3-f37f-4b82-9ccf-395fe26d3d21 (service), filesystem_pool: Some(ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External } } } }, OmicronZoneConfig { id: 89cb2b9b-049a-4e93-a3af-24777b78726f (service), filesystem_pool: Some(ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External } } } }, OmicronZoneConfig { id: d5a24395-204f-48e5-af46-fb7ee00e3945 (service), filesystem_pool: Some(ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External } } } }, OmicronZoneConfig { id: e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6 (service), filesystem_pool: Some(ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External } } } }, OmicronZoneConfig { id: b66f92a5-664e-45ca-9b49-193f78ee03a0 (service), filesystem_pool: Some(ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 05043a18-3dd2-4402-9153-fc0189b36742 (service), filesystem_pool: Some(ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External } } } }, OmicronZoneConfig { id: 411df859-0792-4100-92e7-c89e1c203dd9 (service), filesystem_pool: Some(ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10382025-01-17T07:28:24.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36804
10392025-01-17T07:28:24.785ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10402025-01-17T07:28:24.785ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10412025-01-17T07:28:24.799ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10422025-01-17T07:28:24.799ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10432025-01-17T07:28:24.810ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10442025-01-17T07:28:24.810ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
10452025-01-17T07:28:24.821ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10462025-01-17T07:28:24.821ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472025-01-17T07:28:24.832ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10482025-01-17T07:28:24.832ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492025-01-17T07:28:24.843ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10502025-01-17T07:28:24.843ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Cockroach }, responder: ... }
10512025-01-17T07:28:24.853ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10522025-01-17T07:28:24.853ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10532025-01-17T07:28:24.863ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10542025-01-17T07:28:24.863ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Cockroach }, responder: ... }
10552025-01-17T07:28:24.873ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10562025-01-17T07:28:24.873ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10572025-01-17T07:28:24.884ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10582025-01-17T07:28:24.884ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10592025-01-17T07:28:24.895ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10602025-01-17T07:28:24.895ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10612025-01-17T07:28:24.906ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10622025-01-17T07:28:24.906ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, kind: Crucible }, responder: ... }
10632025-01-17T07:28:24.918ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10642025-01-17T07:28:24.918ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, kind: Crucible }, responder: ... }
10652025-01-17T07:28:24.928ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10662025-01-17T07:28:24.928ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, kind: Crucible }, responder: ... }
10672025-01-17T07:28:24.938ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10682025-01-17T07:28:24.938ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, kind: Crucible }, responder: ... }
10692025-01-17T07:28:24.949ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10702025-01-17T07:28:24.949ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, kind: Crucible }, responder: ... }
10712025-01-17T07:28:24.959ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10722025-01-17T07:28:24.959ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, kind: Crucible }, responder: ... }
10732025-01-17T07:28:24.970ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10742025-01-17T07:28:24.970ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10752025-01-17T07:28:24.981ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10762025-01-17T07:28:24.981ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, kind: Crucible }, responder: ... }
10772025-01-17T07:28:24.990ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10782025-01-17T07:28:24.991ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, kind: Crucible }, responder: ... }
10792025-01-17T07:28:25.001ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10802025-01-17T07:28:25.001ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:177
10812025-01-17T07:28:25.001ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:177
10822025-01-17T07:28:25.002ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10832025-01-17T07:28:25.115ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10842025-01-17T07:28:25.129ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10852025-01-17T07:28:25.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10862025-01-17T07:28:25.131ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10872025-01-17T07:28:25.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10882025-01-17T07:28:25.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10892025-01-17T07:28:25.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10902025-01-17T07:28:25.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10912025-01-17T07:28:25.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10922025-01-17T07:28:25.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10932025-01-17T07:28:25.351ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10942025-01-17T07:28:25.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952025-01-17T07:28:25.404ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10962025-01-17T07:28:25.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10972025-01-17T07:28:25.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10982025-01-17T07:28:25.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10992025-01-17T07:28:25.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11002025-01-17T07:28:25.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11012025-01-17T07:28:25.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11022025-01-17T07:28:25.418ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06 file = illumos-utils/src/zone.rs:325
11032025-01-17T07:28:25.424ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21 file = illumos-utils/src/zone.rs:325
11042025-01-17T07:28:25.428ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f file = illumos-utils/src/zone.rs:325
11052025-01-17T07:28:25.433ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0 file = illumos-utils/src/zone.rs:325
11062025-01-17T07:28:25.439ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa file = illumos-utils/src/zone.rs:325
11072025-01-17T07:28:25.443ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab file = illumos-utils/src/zone.rs:325
11082025-01-17T07:28:25.448ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42 file = illumos-utils/src/zone.rs:325
11092025-01-17T07:28:25.590ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06 file = illumos-utils/src/zone.rs:363
11102025-01-17T07:28:25.595ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21 file = illumos-utils/src/zone.rs:363
11112025-01-17T07:28:25.599ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f file = illumos-utils/src/zone.rs:363
11122025-01-17T07:28:25.603ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0 file = illumos-utils/src/zone.rs:363
11132025-01-17T07:28:25.607ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa file = illumos-utils/src/zone.rs:363
11142025-01-17T07:28:25.612ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab file = illumos-utils/src/zone.rs:363
11152025-01-17T07:28:25.616ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42 file = illumos-utils/src/zone.rs:363
11162025-01-17T07:28:25.622ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea file = illumos-utils/src/zone.rs:325
11172025-01-17T07:28:25.627ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c file = illumos-utils/src/zone.rs:325
11182025-01-17T07:28:25.633ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742 file = illumos-utils/src/zone.rs:325
11192025-01-17T07:28:25.637ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6 file = illumos-utils/src/zone.rs:325
11202025-01-17T07:28:25.643ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93 file = illumos-utils/src/zone.rs:325
11212025-01-17T07:28:25.649ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9 file = illumos-utils/src/zone.rs:325
11222025-01-17T07:28:25.655ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945 file = illumos-utils/src/zone.rs:325
11232025-01-17T07:28:25.721ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11242025-01-17T07:28:25.722ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea file = illumos-utils/src/zone.rs:363
11252025-01-17T07:28:25.731ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c file = illumos-utils/src/zone.rs:363
11262025-01-17T07:28:25.741ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742 file = illumos-utils/src/zone.rs:363
11272025-01-17T07:28:25.752ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6 file = illumos-utils/src/zone.rs:363
11282025-01-17T07:28:25.761ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93 file = illumos-utils/src/zone.rs:363
11292025-01-17T07:28:25.770ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9 file = illumos-utils/src/zone.rs:363
11302025-01-17T07:28:25.779ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945 file = illumos-utils/src/zone.rs:363
11312025-01-17T07:28:25.845ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11322025-01-17T07:28:25.905ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11332025-01-17T07:28:25.964ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11342025-01-17T07:28:26.036ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11352025-01-17T07:28:26.041ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11362025-01-17T07:28:26.041ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11372025-01-17T07:28:26.099ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 201, 217]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11382025-01-17T07:28:26.099ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11392025-01-17T07:28:26.101ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11402025-01-17T07:28:26.101ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11412025-01-17T07:28:26.188ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 129, 185]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11422025-01-17T07:28:26.188ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11432025-01-17T07:28:26.189ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11442025-01-17T07:28:26.189ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11452025-01-17T07:28:26.248ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 199, 162]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11462025-01-17T07:28:26.248ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11472025-01-17T07:28:26.250ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11482025-01-17T07:28:26.250ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11492025-01-17T07:28:26.304ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 187, 218]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11502025-01-17T07:28:26.304ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11512025-01-17T07:28:26.305ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11522025-01-17T07:28:26.305ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11532025-01-17T07:28:26.359ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 182, 50]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11542025-01-17T07:28:26.360ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11552025-01-17T07:28:26.360ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11562025-01-17T07:28:26.360ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11572025-01-17T07:28:26.367ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11582025-01-17T07:28:26.369ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11592025-01-17T07:28:26.369ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11602025-01-17T07:28:26.369ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11612025-01-17T07:28:26.369ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11622025-01-17T07:28:26.369ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11632025-01-17T07:28:26.369ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11642025-01-17T07:28:26.369ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11652025-01-17T07:28:26.369ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11662025-01-17T07:28:26.369ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11672025-01-17T07:28:26.436ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11682025-01-17T07:28:26.440ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11692025-01-17T07:28:26.443ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11702025-01-17T07:28:26.443ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11712025-01-17T07:28:26.443ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11722025-01-17T07:28:26.446ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11732025-01-17T07:28:26.449ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11742025-01-17T07:28:26.451ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11752025-01-17T07:28:26.645ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659 file = illumos-utils/src/zone.rs:325
11762025-01-17T07:28:26.662ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a file = illumos-utils/src/zone.rs:325
11772025-01-17T07:28:26.682ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3 file = illumos-utils/src/zone.rs:325
11782025-01-17T07:28:26.694ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f file = illumos-utils/src/zone.rs:325
11792025-01-17T07:28:26.707ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d file = illumos-utils/src/zone.rs:325
11802025-01-17T07:28:26.718ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659 file = illumos-utils/src/zone.rs:363
11812025-01-17T07:28:26.732ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a file = illumos-utils/src/zone.rs:363
11822025-01-17T07:28:26.741ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3 file = illumos-utils/src/zone.rs:363
11832025-01-17T07:28:26.752ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f file = illumos-utils/src/zone.rs:363
11842025-01-17T07:28:26.764ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d file = illumos-utils/src/zone.rs:363
11852025-01-17T07:28:36.552ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11862025-01-17T07:28:36.656ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11872025-01-17T07:28:36.657ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
11882025-01-17T07:28:36.720ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
11892025-01-17T07:28:36.805ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cc528375-b5bb-4024-b5c2-53b0e9d80742'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902025-01-17T07:28:36.805ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
11912025-01-17T07:28:36.812ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5a58bb15-fc2f-4ce7-b0c7-bbf314ca6aa8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11922025-01-17T07:28:36.812ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3eddbabc-46e7-474d-9670-05a5d5d81f2f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11932025-01-17T07:28:36.813ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='57a3bc9c-c6a6-4d1f-82da-ba1a767d0079'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11942025-01-17T07:28:36.813ZINFOSledAgent (ServiceManager): Booting oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
11952025-01-17T07:28:36.819ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
11962025-01-17T07:28:36.825ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
11972025-01-17T07:28:36.851ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2a8fe751-24ce-475b-bfa6-16e89cc35a1c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982025-01-17T07:28:36.852ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0758153d-b187-4615-8726-534074e7de2b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11992025-01-17T07:28:36.852ZINFOSledAgent (ServiceManager): Booting oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
12002025-01-17T07:28:36.893ZINFOSledAgent (ServiceManager): Booting oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
12012025-01-17T07:28:37.193ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='11b30e1a-39fb-4812-af8d-7378291adff7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12022025-01-17T07:28:37.193ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
12032025-01-17T07:28:37.567ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12042025-01-17T07:28:37.609ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12052025-01-17T07:28:37.609ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
12062025-01-17T07:28:37.622ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
12072025-01-17T07:28:38.806ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12082025-01-17T07:28:38.807ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
12092025-01-17T07:28:38.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 29.449809ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
12102025-01-17T07:28:38.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 25.758523ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
12112025-01-17T07:28:38.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 49.960896ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
12122025-01-17T07:28:38.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 44.621033ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
12132025-01-17T07:28:38.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 45.714639ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
12142025-01-17T07:28:38.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 55.187013ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
12152025-01-17T07:28:38.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 64.067431ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
12162025-01-17T07:28:38.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 32.648545ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
12172025-01-17T07:28:38.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 54.734264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
12182025-01-17T07:28:38.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 85.691239ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
12192025-01-17T07:28:38.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 92.892886ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
12202025-01-17T07:28:38.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 121.058386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
12212025-01-17T07:28:38.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 77.040394ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
12222025-01-17T07:28:38.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 80.243826ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
12232025-01-17T07:28:38.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 45.20434ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
12242025-01-17T07:28:38.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 57.2161ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
12252025-01-17T07:28:38.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 29.380484ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
12262025-01-17T07:28:38.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 59.295112ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
12272025-01-17T07:28:39.009ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='729ac92c-201b-4d5d-8200-244e95b49a81'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12282025-01-17T07:28:39.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 139.172743ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
12292025-01-17T07:28:39.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 289.747095ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
12302025-01-17T07:28:39.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 227.744802ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
12312025-01-17T07:28:39.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 149.133252ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
12322025-01-17T07:28:39.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 173.347197ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
12332025-01-17T07:28:39.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 209.682777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
12342025-01-17T07:28:39.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 140.99134ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
12352025-01-17T07:28:39.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 117.117167ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
12362025-01-17T07:28:39.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 36.05753ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
12372025-01-17T07:28:39.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 269.828808ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
12382025-01-17T07:28:39.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 95.940346ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
12392025-01-17T07:28:39.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 279.19842ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
12402025-01-17T07:28:39.137ZINFOSledAgent (ServiceManager): Booting oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
12412025-01-17T07:28:39.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 84.630813ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
12422025-01-17T07:28:39.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 282.186495ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
12432025-01-17T07:28:39.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 510.40287ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
12442025-01-17T07:28:39.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 131.488762ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
12452025-01-17T07:28:39.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 299.565627ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
12462025-01-17T07:28:39.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 354.468707ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
12472025-01-17T07:28:39.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 120.921174ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
12482025-01-17T07:28:39.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 207.209596ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
12492025-01-17T07:28:39.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 341.717969ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
12502025-01-17T07:28:39.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 569.910035ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
12512025-01-17T07:28:39.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 234.664775ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
12522025-01-17T07:28:39.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 62.896654ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
12532025-01-17T07:28:39.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 588.190786ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
12542025-01-17T07:28:39.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 209.197268ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
12552025-01-17T07:28:39.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 560.661081ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
12562025-01-17T07:28:39.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 229.439306ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
12572025-01-17T07:28:39.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 146.499715ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
12582025-01-17T07:28:39.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 249.099374ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
12592025-01-17T07:28:39.487ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e5187d6e-4a60-4938-b5a0-6f1db9b93697'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12602025-01-17T07:28:39.488ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
12612025-01-17T07:28:39.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 478.383207ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
12622025-01-17T07:28:39.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 596.99651ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
12632025-01-17T07:28:39.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 1.052506257s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
12642025-01-17T07:28:39.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 280.939384ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
12652025-01-17T07:28:39.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 408.005777ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
12662025-01-17T07:28:39.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 584.831573ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
12672025-01-17T07:28:39.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 424.828895ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
12682025-01-17T07:28:39.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 416.027172ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
12692025-01-17T07:28:39.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 65.509007ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
12702025-01-17T07:28:39.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 918.110362ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
12712025-01-17T07:28:39.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 701.606647ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
12722025-01-17T07:28:39.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 101.525414ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
12732025-01-17T07:28:39.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 924.452885ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
12742025-01-17T07:28:39.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 273.780716ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
12752025-01-17T07:28:39.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 163.00977ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
12762025-01-17T07:28:39.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 587.002629ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
12772025-01-17T07:28:39.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 1.12449087s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
12782025-01-17T07:28:40.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 1.12080839s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
12792025-01-17T07:28:40.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 880.260964ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
12802025-01-17T07:28:40.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 200.059284ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
12812025-01-17T07:28:40.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 797.381199ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
12822025-01-17T07:28:40.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 1.347883415s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
12832025-01-17T07:28:40.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 880.444234ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
12842025-01-17T07:28:40.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 788.661178ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
12852025-01-17T07:28:40.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 703.919141ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
12862025-01-17T07:28:40.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 648.405704ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
12872025-01-17T07:28:40.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 1.472530882s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
12882025-01-17T07:28:40.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 1.079538258s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
12892025-01-17T07:28:40.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 1.478950446s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
12902025-01-17T07:28:40.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 512.127705ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
12912025-01-17T07:28:40.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 794.332292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
12922025-01-17T07:28:40.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 1.368554073s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
12932025-01-17T07:28:40.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 827.661718ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
12942025-01-17T07:28:41.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 1.369567641s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
12952025-01-17T07:28:41.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 1.08988848s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
12962025-01-17T07:28:41.155ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='1ecf123b-443e-4ca2-9ed7-9ec90a108b42'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12972025-01-17T07:28:41.155ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
12982025-01-17T07:28:41.216ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.764196679s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
12992025-01-17T07:28:41.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 73.551268ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
13002025-01-17T07:28:41.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 94.609249ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
13012025-01-17T07:28:41.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 566.846813ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
13022025-01-17T07:28:41.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 967.102372ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
13032025-01-17T07:28:41.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 265.972339ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
13042025-01-17T07:28:41.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 860.067503ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
13052025-01-17T07:28:41.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 1.11799923s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
13062025-01-17T07:28:41.612ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13072025-01-17T07:28:41.612ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13082025-01-17T07:28:41.612ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092025-01-17T07:28:41.612ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
13102025-01-17T07:28:41.619ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13112025-01-17T07:28:41.625ZINFOSledAgent (ServiceManager): Booting oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
13122025-01-17T07:28:41.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 1.300138406s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
13132025-01-17T07:28:41.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 872.385909ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
13142025-01-17T07:28:41.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 1.109274315s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
13152025-01-17T07:28:41.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 70.338552ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
13162025-01-17T07:28:41.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 1.247545859s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
13172025-01-17T07:28:41.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 26.380486ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
13182025-01-17T07:28:41.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 41.88508ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13192025-01-17T07:28:41.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 471.148986ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
13202025-01-17T07:28:41.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 122.306873ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
13212025-01-17T07:28:41.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 133.606569ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
13222025-01-17T07:28:41.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 122.507857ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13232025-01-17T07:28:42.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 1.217556789s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
13242025-01-17T07:28:42.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 206.863679ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
13252025-01-17T07:28:42.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 154.918899ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13262025-01-17T07:28:42.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 104.875461ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
13272025-01-17T07:28:42.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 1.467823504s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
13282025-01-17T07:28:42.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 539.192345ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
13292025-01-17T07:28:42.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 419.808047ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13302025-01-17T07:28:42.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 209.081711ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
13312025-01-17T07:28:42.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 1.354012092s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
13322025-01-17T07:28:42.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 883.32922ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
13332025-01-17T07:28:42.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 820.896286ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
13342025-01-17T07:28:42.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 1.47676976s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
13352025-01-17T07:28:42.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 1.452075569s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
13362025-01-17T07:28:42.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 837.551778ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
13372025-01-17T07:28:42.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 1.002893735s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
13382025-01-17T07:28:42.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 1.357580577s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
13392025-01-17T07:28:42.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 626.730436ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
13402025-01-17T07:28:42.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 1.218926854s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
13412025-01-17T07:28:42.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 539.728224ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13422025-01-17T07:28:42.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 672.917526ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
13432025-01-17T07:28:42.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 1.425400506s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
13442025-01-17T07:28:42.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 542.528202ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
13452025-01-17T07:28:42.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 657.413652ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
13462025-01-17T07:28:43.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 785.077349ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
13472025-01-17T07:28:43.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 775.579724ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
13482025-01-17T07:28:43.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 1.388285982s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
13492025-01-17T07:28:43.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 705.297448ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13502025-01-17T07:28:43.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 1.341787496s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
13512025-01-17T07:28:43.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 1.116375243s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
13522025-01-17T07:28:43.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 1.134660475s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
13532025-01-17T07:28:43.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 655.228548ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
13542025-01-17T07:28:43.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 939.280389ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
13552025-01-17T07:28:43.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 673.37055ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
13562025-01-17T07:28:43.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 1.245982593s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
13572025-01-17T07:28:43.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 633.167394ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
13582025-01-17T07:28:43.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 1.441091948s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
13592025-01-17T07:28:43.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 548.286392ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
13602025-01-17T07:28:43.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 1.340173303s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
13612025-01-17T07:28:43.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 887.264558ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
13622025-01-17T07:28:43.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 1.156693791s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
13632025-01-17T07:28:43.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 1.461037322s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
13642025-01-17T07:28:43.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 569.044606ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13652025-01-17T07:28:43.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 1.398290424s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
13662025-01-17T07:28:44.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 855.240655ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
13672025-01-17T07:28:44.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 713.183075ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
13682025-01-17T07:28:44.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 575.666289ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
13692025-01-17T07:28:44.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 691.888455ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
13702025-01-17T07:28:44.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 1.467402059s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
13712025-01-17T07:28:44.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 724.523623ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
13722025-01-17T07:28:44.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 667.53555ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
13732025-01-17T07:28:44.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 795.116768ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
13742025-01-17T07:28:44.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 1.211504695s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13752025-01-17T07:28:44.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 1.098855718s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
13762025-01-17T07:28:44.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 1.481003483s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
13772025-01-17T07:28:44.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 1.120452677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
13782025-01-17T07:28:44.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 1.498174561s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
13792025-01-17T07:28:44.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 791.076772ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
13802025-01-17T07:28:44.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 1.044876945s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
13812025-01-17T07:28:44.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 1.147790061s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
13822025-01-17T07:28:44.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 521.888593ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
13832025-01-17T07:28:45.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 540.225646ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
13842025-01-17T07:28:45.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 1.148216713s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
13852025-01-17T07:28:45.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 1.217910085s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
13862025-01-17T07:28:45.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 1.136780063s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
13872025-01-17T07:28:45.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 832.387011ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
13882025-01-17T07:28:45.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 691.160678ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
13892025-01-17T07:28:45.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 537.798724ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
13902025-01-17T07:28:45.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 727.564082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
13912025-01-17T07:28:45.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 1.278488392s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
13922025-01-17T07:28:45.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 1.362532644s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
13932025-01-17T07:28:45.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 1.351210808s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
13942025-01-17T07:28:45.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 941.914544ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
13952025-01-17T07:28:45.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 954.595493ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
13962025-01-17T07:28:45.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 565.242848ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
13972025-01-17T07:28:45.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 913.24765ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
13982025-01-17T07:28:45.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 1.273185562s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
13992025-01-17T07:28:45.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 1.293184582s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
14002025-01-17T07:28:45.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 1.114545885s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
14012025-01-17T07:28:46.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 1.048819157s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
14022025-01-17T07:28:46.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 644.157111ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
14032025-01-17T07:28:46.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 524.26822ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
14042025-01-17T07:28:46.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 651.804382ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
14052025-01-17T07:28:46.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 634.388172ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
14062025-01-17T07:28:46.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 1.305137829s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
14072025-01-17T07:28:46.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 786.638188ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
14082025-01-17T07:28:46.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 1.16615397s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
14092025-01-17T07:28:46.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 1.324254806s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
14102025-01-17T07:28:46.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 840.465432ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
14112025-01-17T07:28:46.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 507.117017ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
14122025-01-17T07:28:46.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 1.029910053s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
14132025-01-17T07:28:46.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 995.465991ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
14142025-01-17T07:28:46.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 604.969849ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
14152025-01-17T07:28:46.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 583.747378ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
14162025-01-17T07:28:46.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 550.841343ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
14172025-01-17T07:28:46.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 553.641545ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
14182025-01-17T07:28:46.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 977.787624ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
14192025-01-17T07:28:46.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 681.865245ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
14202025-01-17T07:28:47.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 747.968283ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
14212025-01-17T07:28:47.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 1.440149485s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
14222025-01-17T07:28:47.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 1.21651919s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
14232025-01-17T07:28:47.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 804.070083ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
14242025-01-17T07:28:47.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 1.424198163s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
14252025-01-17T07:28:47.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 587.392296ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
14262025-01-17T07:28:47.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 910.707842ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
14272025-01-17T07:28:47.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 777.62897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
14282025-01-17T07:28:47.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 1.213122678s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
14292025-01-17T07:28:47.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 582.138446ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
14302025-01-17T07:28:47.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 571.185912ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
14312025-01-17T07:28:47.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 1.09860362s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
14322025-01-17T07:28:47.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 582.357875ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
14332025-01-17T07:28:47.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 1.158803372s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
14342025-01-17T07:28:47.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 1.238598101s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
14352025-01-17T07:28:47.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 821.391113ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
14362025-01-17T07:28:47.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 1.005626575s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
14372025-01-17T07:28:47.770ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14382025-01-17T07:28:47.771ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
14392025-01-17T07:28:47.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 973.358955ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
14402025-01-17T07:28:47.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 647.915546ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
14412025-01-17T07:28:47.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 529.180497ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
14422025-01-17T07:28:48.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 607.502031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
14432025-01-17T07:28:48.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 733.370264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
14442025-01-17T07:28:48.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 41.140413ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
14452025-01-17T07:28:48.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 1.408763237s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
14462025-01-17T07:28:48.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 142.172198ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
14472025-01-17T07:28:48.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 1.338353828s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
14482025-01-17T07:28:48.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 904.006941ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
14492025-01-17T07:28:48.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 186.323227ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
14502025-01-17T07:28:48.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 743.919258ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
14512025-01-17T07:28:48.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 1.446698483s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
14522025-01-17T07:28:48.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 1.350062435s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
14532025-01-17T07:28:48.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 1.460286836s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
14542025-01-17T07:28:48.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 387.69457ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
14552025-01-17T07:28:48.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 860.411706ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
14562025-01-17T07:28:48.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 1.191393074s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
14572025-01-17T07:28:48.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 902.520606ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
14582025-01-17T07:28:48.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 1.352973474s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
14592025-01-17T07:28:48.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 556.853096ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
14602025-01-17T07:28:48.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 1.229364516s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
14612025-01-17T07:28:48.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 1.232051669s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
14622025-01-17T07:28:48.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 561.360926ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
14632025-01-17T07:28:48.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 1.27122244s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
14642025-01-17T07:28:48.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 656.081483ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
14652025-01-17T07:28:48.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 989.606146ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
14662025-01-17T07:28:48.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 722.811113ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
14672025-01-17T07:28:49.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 685.028039ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
14682025-01-17T07:28:49.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 955.791674ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
14692025-01-17T07:28:49.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 1.313039264s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
14702025-01-17T07:28:49.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 1.208233546s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
14712025-01-17T07:28:49.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 1.474348128s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
14722025-01-17T07:28:49.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 512.064485ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
14732025-01-17T07:28:49.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 1.244244296s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
14742025-01-17T07:28:49.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 992.149476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
14752025-01-17T07:28:49.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 956.539314ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
14762025-01-17T07:28:49.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 1.207548749s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
14772025-01-17T07:28:49.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 955.123535ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
14782025-01-17T07:28:49.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 1.038777582s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
14792025-01-17T07:28:49.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 1.412649449s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
14802025-01-17T07:28:49.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 826.032355ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
14812025-01-17T07:28:49.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 1.203180596s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
14822025-01-17T07:28:49.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 1.426836127s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
14832025-01-17T07:28:50.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 581.053247ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
14842025-01-17T07:28:50.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 1.08760043s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
14852025-01-17T07:28:50.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 768.634463ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
14862025-01-17T07:28:50.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 1.314854398s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
14872025-01-17T07:28:50.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 1.162817507s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
14882025-01-17T07:28:50.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 1.222115348s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
14892025-01-17T07:28:50.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 545.492678ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
14902025-01-17T07:28:50.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 1.197403742s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
14912025-01-17T07:28:50.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 734.609227ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
14922025-01-17T07:28:50.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 1.09244769s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
14932025-01-17T07:28:50.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 948.559793ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
14942025-01-17T07:28:50.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 1.446197066s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
14952025-01-17T07:28:50.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 1.326988676s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
14962025-01-17T07:28:50.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 1.118917644s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
14972025-01-17T07:28:50.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 1.472817117s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
14982025-01-17T07:28:50.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 748.418185ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
14992025-01-17T07:28:50.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 1.282986681s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
15002025-01-17T07:28:50.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 1.097431692s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
15012025-01-17T07:28:51.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 1.093647252s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
15022025-01-17T07:28:51.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 572.636501ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
15032025-01-17T07:28:51.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 1.479919178s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
15042025-01-17T07:28:51.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 958.537989ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
15052025-01-17T07:28:51.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 990.094532ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
15062025-01-17T07:28:51.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 838.165702ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
15072025-01-17T07:28:51.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 1.192929709s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15082025-01-17T07:28:51.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 1.052080081s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
15092025-01-17T07:28:51.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 1.480762131s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
15102025-01-17T07:28:51.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 1.494951161s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
15112025-01-17T07:28:51.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 1.100603675s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
15122025-01-17T07:28:51.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 845.707665ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
15132025-01-17T07:28:51.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 1.253796225s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
15142025-01-17T07:28:51.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 1.380047905s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
15152025-01-17T07:28:51.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 629.434909ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
15162025-01-17T07:28:52.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 894.797738ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
15172025-01-17T07:28:52.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 770.341194ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
15182025-01-17T07:28:52.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 637.231712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
15192025-01-17T07:28:52.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 1.487955332s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
15202025-01-17T07:28:52.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 1.401908122s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
15212025-01-17T07:28:52.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 575.211179ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
15222025-01-17T07:28:52.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 706.317163ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
15232025-01-17T07:28:52.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 875.969636ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
15242025-01-17T07:28:52.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 1.266821677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
15252025-01-17T07:28:52.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 984.090075ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
15262025-01-17T07:28:52.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 1.462396055s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
15272025-01-17T07:28:52.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 617.574893ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
15282025-01-17T07:28:52.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 551.790568ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15292025-01-17T07:28:52.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 1.188062057s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
15302025-01-17T07:28:52.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 787.864419ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
15312025-01-17T07:28:52.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 1.2878558s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
15322025-01-17T07:28:52.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea") failed: Property not found. retry in 1.291667262s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
15332025-01-17T07:28:52.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c") failed: Property not found. retry in 1.356510645s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
15342025-01-17T07:28:52.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab") failed: Property not found. retry in 1.263223673s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
15352025-01-17T07:28:52.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 1.375371758s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
15362025-01-17T07:28:52.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 1.396835869s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
15372025-01-17T07:28:52.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 1.063434857s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
15382025-01-17T07:28:53.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 673.714827ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
15392025-01-17T07:28:53.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 1.167462613s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15402025-01-17T07:28:53.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 1.299854568s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
15412025-01-17T07:28:53.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659") failed: Property not found. retry in 1.353862988s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
15422025-01-17T07:28:53.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 1.167810782s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
15432025-01-17T07:28:53.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 758.783821ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
15442025-01-17T07:28:53.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d") failed: Property not found. retry in 778.145307ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
15452025-01-17T07:28:53.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa") failed: Property not found. retry in 984.650546ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
15462025-01-17T07:28:53.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42") failed: Property not found. retry in 955.564887ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
15472025-01-17T07:28:53.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f") failed: Property not found. retry in 1.235395512s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
15482025-01-17T07:28:53.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9") failed: Property not found. retry in 1.027999062s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
15492025-01-17T07:28:53.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945") failed: Property not found. retry in 855.312929ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
15502025-01-17T07:28:54.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6") failed: Property not found. retry in 1.417533464s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
15512025-01-17T07:28:54.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21") failed: Property not found. retry in 1.106630227s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
15522025-01-17T07:28:54.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a") failed: Property not found. retry in 531.210152ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
15532025-01-17T07:28:54.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3") failed: Property not found. retry in 1.155545851s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
15542025-01-17T07:28:54.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f") failed: Property not found. retry in 579.88739ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
15552025-01-17T07:28:54.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742") failed: Property not found. retry in 1.448737397s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
15562025-01-17T07:28:54.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 849.081081ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15572025-01-17T07:28:54.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0") failed: Property not found. retry in 706.380212ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
15582025-01-17T07:28:54.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06") failed: Property not found. retry in 1.084564733s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
15592025-01-17T07:28:54.782ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47050
15602025-01-17T07:28:54.789ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 675 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47050 req_id = be272d3d-ec53-4665-a513-88d65d86a318 response_code = 200 uri = /baseboard
15612025-01-17T07:28:55.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 1.401360485s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15622025-01-17T07:28:56.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 1.457630566s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15632025-01-17T07:28:58.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 690.325444ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15642025-01-17T07:28:58.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 766.422106ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15652025-01-17T07:28:59.070ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.655925185s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
15662025-01-17T07:28:59.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93") failed: Property not found. retry in 1.362994002s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15672025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_698e9900-c4dc-4c83-a27a-15b855c7d659
15682025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_8678e910-5aed-4627-8dc9-50a93f069a06
15692025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_4556b772-0c65-4b05-a77f-6ccbe1f3923a
15702025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_a8f04023-6d44-4570-ac4a-005dc53e1aa3
15712025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_13b872c3-f37f-4b82-9ccf-395fe26d3d21
15722025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_89cb2b9b-049a-4e93-a3af-24777b78726f
15732025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_b66f92a5-664e-45ca-9b49-193f78ee03a0
15742025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_629180bf-eb2d-4c88-87f4-7bd1ca2619fa
15752025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_5d58141a-2ebb-4aeb-9024-39f48b947cab
15762025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_1ecf123b-443e-4ca2-9ed7-9ec90a108b42
15772025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_6932ae3c-49c6-471c-891d-407bdf64d9ea
15782025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_7f47121b-12fd-4abc-a73f-0730b0912f3f
15792025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_75bfdfe0-22a1-4105-b0f3-ce0725a4547c
15802025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_05043a18-3dd2-4402-9153-fc0189b36742
15812025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_e4d7e6a0-0f15-47a4-a6ef-4c77f1e14ae6
15822025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_df318fbc-9b9a-4388-8fdc-5133a37eac93
15832025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_411df859-0792-4100-92e7-c89e1c203dd9
15842025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_f16d291f-3318-414c-a9b3-9d3363ece06d
15852025-01-17T07:29:01.074ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_d5a24395-204f-48e5-af46-fb7ee00e3945
15862025-01-17T07:29:01.075ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15872025-01-17T07:29:01.076ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15882025-01-17T07:29:01.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36338475 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36804 req_id = aacc162d-9b64-4a93-9a30-1a43915d5aa7 response_code = 204 uri = /omicron-zones
15892025-01-17T07:29:01.134ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
15902025-01-17T07:29:01.219ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
15912025-01-17T07:29:01.222ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:803
15922025-01-17T07:29:01.254ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
15932025-01-17T07:29:01.272ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15942025-01-17T07:29:01.331ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15952025-01-17T07:29:01.423ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15962025-01-17T07:29:01.520ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15972025-01-17T07:29:01.608ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15982025-01-17T07:29:01.895ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15992025-01-17T07:29:02.228ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16002025-01-17T07:29:02.480ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16012025-01-17T07:29:02.998ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16022025-01-17T07:29:03.406ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16032025-01-17T07:29:03.761ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.524362666s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
16042025-01-17T07:29:03.841ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/19ed879c-68f3-4f6b-9685-1c07ee4860a9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16052025-01-17T07:29:05.839ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b8a650d0-d645-4aba-a02d-6fbd3359cbb6", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"19ed879c-68f3-4f6b-9685-1c07ee4860a9\"", request_id: "b8a650d0-d645-4aba-a02d-6fbd3359cbb6" } file = sled-agent/src/rack_setup/service.rs:1079
16062025-01-17T07:29:06.571ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "21d9c4fc-6d9d-4561-b3a8-4aac659ba1b6", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"19ed879c-68f3-4f6b-9685-1c07ee4860a9\"", request_id: "21d9c4fc-6d9d-4561-b3a8-4aac659ba1b6" } file = sled-agent/src/rack_setup/service.rs:1079
16072025-01-17T07:29:07.900ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "154d503f-b907-48c0-838a-1c541136300d", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:07 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"19ed879c-68f3-4f6b-9685-1c07ee4860a9\"", request_id: "154d503f-b907-48c0-838a-1c541136300d" } file = sled-agent/src/rack_setup/service.rs:1079
16082025-01-17T07:29:10.900ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "72638a31-5914-4b54-92c5-2d7f206f6139", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "72638a31-5914-4b54-92c5-2d7f206f6139" } file = sled-agent/src/rack_setup/service.rs:1079
16092025-01-17T07:29:13.062ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "33efe989-8c59-4b37-bc03-846598ba3a20", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "33efe989-8c59-4b37-bc03-846598ba3a20" } file = sled-agent/src/rack_setup/service.rs:1079
16102025-01-17T07:29:15.333ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "970d1dcb-6d3e-4e30-9ac0-30708bbf6e9e", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:15 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "970d1dcb-6d3e-4e30-9ac0-30708bbf6e9e" } file = sled-agent/src/rack_setup/service.rs:1079
16112025-01-17T07:29:18.690ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4d17e4f1-3188-4ca5-a205-d19138f96b21", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "4d17e4f1-3188-4ca5-a205-d19138f96b21" } file = sled-agent/src/rack_setup/service.rs:1079
16122025-01-17T07:29:21.852ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "444a1052-1da1-4d4d-abef-35b15f74d919", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "444a1052-1da1-4d4d-abef-35b15f74d919" } file = sled-agent/src/rack_setup/service.rs:1079
16132025-01-17T07:29:24.256ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c188a5b9-b201-44cd-bdd6-d25dc2844215", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:24 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "c188a5b9-b201-44cd-bdd6-d25dc2844215" } file = sled-agent/src/rack_setup/service.rs:1079
16142025-01-17T07:29:24.824ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35721
16152025-01-17T07:29:24.825ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35721 req_id = 98ec9a2c-d916-43a8-9eea-b55189597c57 response_code = 200 uri = /baseboard
16162025-01-17T07:29:27.472ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4d4bff8b-6a23-4c6b-8bcc-b90409afafc5", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "4d4bff8b-6a23-4c6b-8bcc-b90409afafc5" } file = sled-agent/src/rack_setup/service.rs:1079
16172025-01-17T07:29:31.188ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "07064a59-b64b-439c-b41f-cb14fcdfa9a8", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:31 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "07064a59-b64b-439c-b41f-cb14fcdfa9a8" } file = sled-agent/src/rack_setup/service.rs:1079
16182025-01-17T07:29:38.077ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a57b0dc3-5a7d-43ab-ab6e-945d550656a3", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "a57b0dc3-5a7d-43ab-ab6e-945d550656a3" } file = sled-agent/src/rack_setup/service.rs:1079
16192025-01-17T07:29:45.972ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "49b63395-93be-4be5-8bc2-7afda7705521", "content-length": "173", "date": "Fri, 17 Jan 2025 07:29:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"df37d1c6-999a-4855-92c3-920ccfa9c7b0\"", request_id: "49b63395-93be-4be5-8bc2-7afda7705521" } file = sled-agent/src/rack_setup/service.rs:1079
16202025-01-17T07:29:48.758ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
16212025-01-17T07:29:48.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60978
16222025-01-17T07:29:48.959ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16232025-01-17T07:29:48.959ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16242025-01-17T07:29:48.959ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:177
16252025-01-17T07:29:48.959ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:177
16262025-01-17T07:29:48.970ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16272025-01-17T07:29:48.971ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd
16282025-01-17T07:29:48.991ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16292025-01-17T07:29:48.991ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841
16302025-01-17T07:29:49.012ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16312025-01-17T07:29:49.012ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e
16322025-01-17T07:29:49.034ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16332025-01-17T07:29:49.034ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6
16342025-01-17T07:29:49.054ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16352025-01-17T07:29:49.054ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d
16362025-01-17T07:29:49.076ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16372025-01-17T07:29:49.076ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3
16382025-01-17T07:29:49.097ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16392025-01-17T07:29:49.097ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5
16402025-01-17T07:29:49.118ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16412025-01-17T07:29:49.118ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4
16422025-01-17T07:29:49.139ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16432025-01-17T07:29:49.139ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b
16442025-01-17T07:29:49.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60978 req_id = d2d3dd77-0904-437b-95ae-3bd70846602f response_code = 200 uri = /inventory
16452025-01-17T07:29:50.674ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:51514 remote_addr = [fd00:1122:3344:101::d]:42233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
16462025-01-17T07:29:50.718ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42445 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 84398dd6-b787-4b6f-b4bf-bab495be8f25 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
16472025-01-17T07:29:52.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41538
16482025-01-17T07:29:52.170ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16492025-01-17T07:29:52.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16502025-01-17T07:29:52.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16512025-01-17T07:29:52.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16522025-01-17T07:29:52.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16532025-01-17T07:29:52.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16542025-01-17T07:29:52.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16552025-01-17T07:29:52.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4493 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41538 req_id = 96bab391-9252-497a-a4e5-395acb97ffdf response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16562025-01-17T07:29:52.171ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
16572025-01-17T07:29:52.175ZINFOSledAgent (RSS): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16582025-01-17T07:29:52.176ZINFOSledAgent (RSS): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16592025-01-17T07:29:52.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39547
16602025-01-17T07:29:52.508ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16612025-01-17T07:29:52.508ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16622025-01-17T07:29:52.508ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:177
16632025-01-17T07:29:52.509ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:177
16642025-01-17T07:29:52.521ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16652025-01-17T07:29:52.521ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd
16662025-01-17T07:29:52.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52165
16672025-01-17T07:29:52.528ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16682025-01-17T07:29:52.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16692025-01-17T07:29:52.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16702025-01-17T07:29:52.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16712025-01-17T07:29:52.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16722025-01-17T07:29:52.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16732025-01-17T07:29:52.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16742025-01-17T07:29:52.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52165 req_id = 3817f586-502a-4866-b1c4-3baba09eaa5b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16752025-01-17T07:29:52.545ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16762025-01-17T07:29:52.545ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841
16772025-01-17T07:29:52.567ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16782025-01-17T07:29:52.567ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e
16792025-01-17T07:29:52.591ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16802025-01-17T07:29:52.591ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6
16812025-01-17T07:29:52.612ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16822025-01-17T07:29:52.612ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d
16832025-01-17T07:29:52.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41196
16842025-01-17T07:29:52.627ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16852025-01-17T07:29:52.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16862025-01-17T07:29:52.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16872025-01-17T07:29:52.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16882025-01-17T07:29:52.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16892025-01-17T07:29:52.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16902025-01-17T07:29:52.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16912025-01-17T07:29:52.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3483 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41196 req_id = ecf033c3-a6ba-4e9c-a9cd-677ff123de02 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16922025-01-17T07:29:52.633ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16932025-01-17T07:29:52.633ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3
16942025-01-17T07:29:52.654ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16952025-01-17T07:29:52.654ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5
16962025-01-17T07:29:52.678ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16972025-01-17T07:29:52.678ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4
16982025-01-17T07:29:52.700ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16992025-01-17T07:29:52.700ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b
17002025-01-17T07:29:52.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39547 req_id = 62553d4b-5f3a-4510-9e41-a750e0f8a1ed response_code = 200 uri = /inventory
17012025-01-17T07:29:52.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46696
17022025-01-17T07:29:52.964ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17032025-01-17T07:29:52.964ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17042025-01-17T07:29:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17052025-01-17T07:29:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17062025-01-17T07:29:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17072025-01-17T07:29:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17082025-01-17T07:29:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17092025-01-17T07:29:52.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46696 req_id = 29117b25-a9a2-4e63-9392-fd05f797fd8c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17102025-01-17T07:29:54.860ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45196
17112025-01-17T07:29:54.861ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45196 req_id = 35ceb24b-21ea-46ee-a3b8-61c23de4d289 response_code = 200 uri = /baseboard
17122025-01-17T07:29:57.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40229
17132025-01-17T07:29:57.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 504 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40229 req_id = 247678de-2d5d-4d87-867b-7705cd5c15e7 response_code = 200 uri = /vpc-routes
17142025-01-17T07:29:57.348ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
17152025-01-17T07:29:57.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40229 req_id = 094eb4dd-98d7-4577-9bac-a695cb5af69c response_code = 204 uri = /eip-gateways
17162025-01-17T07:29:57.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2718 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40229 req_id = cb5014c8-a326-419c-84f1-33248315228a response_code = 204 uri = /vpc-routes
17172025-01-17T07:30:09.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46286
17182025-01-17T07:30:09.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46286 req_id = 48fabb26-9b83-449b-8280-a5a8322ce086 response_code = 200 uri = /vpc-routes
17192025-01-17T07:30:09.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51333
17202025-01-17T07:30:09.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51333 req_id = db2826b3-9dd3-41a6-a7e2-d69c8e99608c response_code = 200 uri = /vpc-routes
17212025-01-17T07:30:09.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50868
17222025-01-17T07:30:09.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50868 req_id = ae8a46ca-1fcf-4802-903c-1dec976a540d response_code = 200 uri = /vpc-routes
17232025-01-17T07:30:09.515ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
17242025-01-17T07:30:09.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51333 req_id = c126a57b-07aa-4b03-8dc4-a0899a4b0ead response_code = 204 uri = /eip-gateways
17252025-01-17T07:30:09.515ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
17262025-01-17T07:30:09.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46286 req_id = 7c54e372-d4f5-4eb6-83b8-281588258880 response_code = 204 uri = /eip-gateways
17272025-01-17T07:30:09.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46286 req_id = f6614551-e603-4238-8423-f1fcdf1da15e response_code = 204 uri = /vpc-routes
17282025-01-17T07:30:09.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35442
17292025-01-17T07:30:09.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35442 req_id = 855ef82f-059e-4cd7-9ffa-452f41a454a7 response_code = 200 uri = /v2p
17302025-01-17T07:30:09.589ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
17312025-01-17T07:30:09.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50868 req_id = b026b511-0386-4332-9a58-d00be2a59de7 response_code = 204 uri = /eip-gateways
17322025-01-17T07:30:09.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51333 req_id = 4fabbd91-7a71-467c-a63d-52dd40e6b272 response_code = 204 uri = /vpc-routes
17332025-01-17T07:30:09.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50868 req_id = fb15cfcb-7290-47dd-9185-a66fba04ff17 response_code = 204 uri = /vpc-routes
17342025-01-17T07:30:09.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43760
17352025-01-17T07:30:09.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43760 req_id = 45dbdc43-f16a-436b-bb58-10333fd6824c response_code = 200 uri = /v2p
17362025-01-17T07:30:09.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37747
17372025-01-17T07:30:09.716ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17382025-01-17T07:30:09.779ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17392025-01-17T07:30:09.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125367 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37747 req_id = 05909c26-547b-40ab-8ae1-b35bf10406ac response_code = 204 uri = /switch-ports
17402025-01-17T07:30:09.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41597
17412025-01-17T07:30:09.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17422025-01-17T07:30:09.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37747 req_id = a987a92c-2f85-470d-a24f-9b64c1b8cc29 response_code = 200 uri = /network-bootstore-config
17432025-01-17T07:30:09.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17442025-01-17T07:30:09.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59238
17452025-01-17T07:30:09.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 694 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59238 req_id = d69d0a9e-aefb-423b-afef-b9c9a1258c9c response_code = 200 uri = /v2p
17462025-01-17T07:30:09.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41597 req_id = 8a6995dd-0514-466e-a868-baa4a7cd601a response_code = 204 uri = /switch-ports
17472025-01-17T07:30:09.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41597 req_id = 694c868c-bd87-4151-b0d8-9dba99ca2e44 response_code = 200 uri = /network-bootstore-config
17482025-01-17T07:30:09.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38579
17492025-01-17T07:30:09.968ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17502025-01-17T07:30:10.003ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17512025-01-17T07:30:10.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91658 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38579 req_id = aa0e4919-6640-4b7f-9243-d790e94545ba response_code = 204 uri = /switch-ports
17522025-01-17T07:30:10.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38579 req_id = d6ac7a10-d8d1-488e-b14d-df5e7b052354 response_code = 200 uri = /network-bootstore-config
17532025-01-17T07:30:10.060ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17542025-01-17T07:30:10.061ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17552025-01-17T07:30:10.063ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17562025-01-17T07:30:10.063ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17572025-01-17T07:30:10.063ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17582025-01-17T07:30:10.063ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17592025-01-17T07:30:10.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3699 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41597 req_id = 07ceda93-6506-47d2-b1c1-00df2c91bd40 response_code = 204 uri = /network-bootstore-config
17602025-01-17T07:30:10.064ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17612025-01-17T07:30:10.064ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17622025-01-17T07:30:10.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3948 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37747 req_id = e4441e37-61c4-439f-855e-7f2ddbef8fcf response_code = 204 uri = /network-bootstore-config
17632025-01-17T07:30:20.680ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6901 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = d1fdc9e3-4576-4af4-ac10-5c11003e9951 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
17642025-01-17T07:30:24.895ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60614
17652025-01-17T07:30:24.895ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60614 req_id = 0f774c21-2020-4000-8ffc-84b2bb606d8a response_code = 200 uri = /baseboard
17662025-01-17T07:30:39.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58119
17672025-01-17T07:30:39.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58119 req_id = 248b496c-ace7-4070-8e4f-ac81c51a1ac7 response_code = 200 uri = /vpc-routes
17682025-01-17T07:30:39.309ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
17692025-01-17T07:30:39.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58119 req_id = 1c44b283-6369-4d7d-90e9-3636a28b1eda response_code = 204 uri = /eip-gateways
17702025-01-17T07:30:39.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35729
17712025-01-17T07:30:39.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35729 req_id = e4e080a4-b69a-4561-9b46-fc6c3cd41ace response_code = 200 uri = /v2p
17722025-01-17T07:30:39.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61825
17732025-01-17T07:30:39.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61825 req_id = ae3cc222-37b9-4c6d-89dc-7b75cefc5b99 response_code = 200 uri = /vpc-routes
17742025-01-17T07:30:39.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46895
17752025-01-17T07:30:39.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46895 req_id = 19b38dd3-d523-4b1d-854a-d40a8f54d904 response_code = 200 uri = /v2p
17762025-01-17T07:30:39.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58119 req_id = 19953536-0dbf-49e5-b1f5-dff1a3a807d6 response_code = 204 uri = /vpc-routes
17772025-01-17T07:30:39.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53955
17782025-01-17T07:30:39.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17792025-01-17T07:30:39.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17802025-01-17T07:30:39.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53955 req_id = 29691994-fbce-4568-8e27-6d8d5de5ea8e response_code = 204 uri = /switch-ports
17812025-01-17T07:30:39.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34070
17822025-01-17T07:30:39.503ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
17832025-01-17T07:30:39.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61825 req_id = 786ffb2f-9657-458e-823e-715f7de5fd5d response_code = 204 uri = /eip-gateways
17842025-01-17T07:30:39.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34070 req_id = a5d06a3d-bf77-44aa-a585-2e0676c1702e response_code = 200 uri = /vpc-routes
17852025-01-17T07:30:39.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53955 req_id = 35483fc7-0fb6-4dda-b1a6-537af977a9a2 response_code = 200 uri = /network-bootstore-config
17862025-01-17T07:30:39.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61825 req_id = ecfc55e5-11cd-492d-bc9c-cbc6c14493d1 response_code = 204 uri = /vpc-routes
17872025-01-17T07:30:39.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39401
17882025-01-17T07:30:39.542ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17892025-01-17T07:30:39.580ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17902025-01-17T07:30:39.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91832 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39401 req_id = c4ece5bb-090a-4fbb-abd9-ed289f722e9c response_code = 204 uri = /switch-ports
17912025-01-17T07:30:39.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55810
17922025-01-17T07:30:39.635ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
17932025-01-17T07:30:39.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34070 req_id = 46af137d-9169-40bf-ada0-fff2bc15fc0a response_code = 204 uri = /eip-gateways
17942025-01-17T07:30:39.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39401 req_id = 548635c7-30eb-4eae-b2b3-dc0d78a53988 response_code = 200 uri = /network-bootstore-config
17952025-01-17T07:30:39.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55810 req_id = fb9cba61-3bd7-4e3d-bd97-7fa6c264041f response_code = 200 uri = /v2p
17962025-01-17T07:30:39.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34070 req_id = ab5fc071-ffe8-4dd5-a01b-60abb19f53aa response_code = 204 uri = /vpc-routes
17972025-01-17T07:30:39.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46075
17982025-01-17T07:30:39.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17992025-01-17T07:30:39.731ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18002025-01-17T07:30:39.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87129 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46075 req_id = 0f32ded5-db94-488c-8a5a-13ef3e311d2f response_code = 204 uri = /switch-ports
18012025-01-17T07:30:39.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46075 req_id = d08865a4-fb0f-48d8-85f5-baf1f865cbb2 response_code = 200 uri = /network-bootstore-config
18022025-01-17T07:30:50.681ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8057 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 6c144caa-f965-42d9-8966-03acffd6bbc8 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
18032025-01-17T07:30:54.928ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49045
18042025-01-17T07:30:54.929ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49045 req_id = 17908bf7-77a8-46a9-b99c-373fd236f3d4 response_code = 200 uri = /baseboard
18052025-01-17T07:31:09.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38551
18062025-01-17T07:31:09.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38551 req_id = 355484ba-ef16-4310-9aee-3fee5ebb6074 response_code = 200 uri = /vpc-routes
18072025-01-17T07:31:09.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57710
18082025-01-17T07:31:09.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57710 req_id = 859d89fb-f041-4a6f-bbbb-42476d771a1e response_code = 200 uri = /vpc-routes
18092025-01-17T07:31:09.527ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
18102025-01-17T07:31:09.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38551 req_id = 39789df6-fd6f-48cf-97d4-89c9f5b9ada7 response_code = 204 uri = /eip-gateways
18112025-01-17T07:31:09.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38551 req_id = 9b11547b-c719-4e7a-b2c5-ee312708d7cf response_code = 204 uri = /vpc-routes
18122025-01-17T07:31:09.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48099
18132025-01-17T07:31:09.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48099 req_id = 0a238d4f-d43d-4124-ba28-56041a11d4d8 response_code = 200 uri = /v2p
18142025-01-17T07:31:09.555ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
18152025-01-17T07:31:09.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57710 req_id = f685c4f6-d2ca-4efb-b9ec-9e51097618d3 response_code = 204 uri = /eip-gateways
18162025-01-17T07:31:09.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57710 req_id = 9aefc733-af31-42e6-ab51-2d623f17c3cf response_code = 204 uri = /vpc-routes
18172025-01-17T07:31:09.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60210
18182025-01-17T07:31:09.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60210 req_id = 531fcf3d-57b8-4086-b792-2ef479e4eb52 response_code = 200 uri = /vpc-routes
18192025-01-17T07:31:09.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56882
18202025-01-17T07:31:09.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56882 req_id = 8acb2838-0b0f-4f90-9cff-a5a877ec0f54 response_code = 200 uri = /v2p
18212025-01-17T07:31:09.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56407
18222025-01-17T07:31:09.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56407 req_id = 10c1497b-3d4d-4837-8874-15e5ad5f8694 response_code = 200 uri = /v2p
18232025-01-17T07:31:09.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35448
18242025-01-17T07:31:09.735ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18252025-01-17T07:31:09.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18262025-01-17T07:31:09.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95302 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35448 req_id = 937157b8-5ddb-413e-8c3d-df7d753f4ece response_code = 204 uri = /switch-ports
18272025-01-17T07:31:09.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59628
18282025-01-17T07:31:09.831ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
18292025-01-17T07:31:09.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60210 req_id = e90b9121-e19b-42c4-a73f-7a579dfd5593 response_code = 204 uri = /eip-gateways
18302025-01-17T07:31:09.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60310
18312025-01-17T07:31:09.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35448 req_id = d64df5c8-da44-4213-bb08-745a9d9ea2aa response_code = 200 uri = /network-bootstore-config
18322025-01-17T07:31:09.831ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18332025-01-17T07:31:09.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60210 req_id = 028a4821-ace0-48ac-8b25-2e745322cc6b response_code = 204 uri = /vpc-routes
18342025-01-17T07:31:09.868ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18352025-01-17T07:31:09.921ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18362025-01-17T07:31:09.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59628 req_id = b8c0645f-7d22-46ea-a0fc-a6f90b2217ef response_code = 204 uri = /switch-ports
18372025-01-17T07:31:09.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 374 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59628 req_id = bf9a2163-ed79-41fd-8b61-1df86d896dda response_code = 200 uri = /network-bootstore-config
18382025-01-17T07:31:09.961ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18392025-01-17T07:31:10.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183738 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60310 req_id = 7c15c082-6000-442b-83c4-55ff708f2cdf response_code = 204 uri = /switch-ports
18402025-01-17T07:31:10.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60310 req_id = 37866f5a-fc75-4904-9129-a947439bd71a response_code = 200 uri = /network-bootstore-config
18412025-01-17T07:31:20.680ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6971 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 9862a965-092e-4abb-a778-621db036fd22 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
18422025-01-17T07:31:24.963ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60314
18432025-01-17T07:31:24.963ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60314 req_id = 467279bf-ab5e-4056-bc5a-962cb3cb364c response_code = 200 uri = /baseboard
18442025-01-17T07:31:39.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49914
18452025-01-17T07:31:39.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49914 req_id = 63ac4736-d600-4dcb-860c-16b96414ce89 response_code = 200 uri = /vpc-routes
18462025-01-17T07:31:39.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58423
18472025-01-17T07:31:39.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58423 req_id = 08318ffa-851d-4d19-9617-ffd644672dca response_code = 200 uri = /vpc-routes
18482025-01-17T07:31:39.352ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
18492025-01-17T07:31:39.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58423 req_id = 53adcb35-649b-4892-b5fa-ac7149221df0 response_code = 204 uri = /eip-gateways
18502025-01-17T07:31:39.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58423 req_id = 9292e1a0-4be5-4dfa-949e-353fdec3f5fe response_code = 204 uri = /vpc-routes
18512025-01-17T07:31:39.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39402
18522025-01-17T07:31:39.371ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18532025-01-17T07:31:39.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18542025-01-17T07:31:39.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110917 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39402 req_id = 5d49076f-78c5-4861-a1c9-3a856fdba1a1 response_code = 204 uri = /switch-ports
18552025-01-17T07:31:39.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60141
18562025-01-17T07:31:39.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52341
18572025-01-17T07:31:39.482ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
18582025-01-17T07:31:39.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49914 req_id = ae27f524-6c91-4f3e-8706-5e79f2a247a8 response_code = 204 uri = /eip-gateways
18592025-01-17T07:31:39.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44433
18602025-01-17T07:31:39.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50488
18612025-01-17T07:31:39.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44433 req_id = 5be8b982-a91b-4de6-8b1f-ab5c384e9837 response_code = 200 uri = /v2p
18622025-01-17T07:31:39.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39402 req_id = d0153dde-afb7-43e0-b265-5c49365d43b0 response_code = 200 uri = /network-bootstore-config
18632025-01-17T07:31:39.483ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18642025-01-17T07:31:39.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52341 req_id = e1b45047-2d1d-4ba4-9cf0-3e548e1edaef response_code = 200 uri = /vpc-routes
18652025-01-17T07:31:39.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3959 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60141 req_id = 04b5036c-b876-4c83-abb7-d00d429af50b response_code = 200 uri = /v2p
18662025-01-17T07:31:39.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49914 req_id = 94d42c42-108b-44ae-b98a-46b1db6709eb response_code = 204 uri = /vpc-routes
18672025-01-17T07:31:39.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47167
18682025-01-17T07:31:39.522ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18692025-01-17T07:31:39.579ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18702025-01-17T07:31:39.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96711 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50488 req_id = 09f945df-5447-47f7-985e-3c735d8d89bc response_code = 204 uri = /switch-ports
18712025-01-17T07:31:39.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44151
18722025-01-17T07:31:39.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 414 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50488 req_id = c3bb6b67-3f57-4a17-91f5-fcb80e59758f response_code = 200 uri = /network-bootstore-config
18732025-01-17T07:31:39.584ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
18742025-01-17T07:31:39.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52341 req_id = 5f832e5e-cf82-48ac-9131-4781c0f0de32 response_code = 204 uri = /eip-gateways
18752025-01-17T07:31:39.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44151 req_id = d5ad5d9f-f689-44ff-a384-5f5b0add8aa0 response_code = 200 uri = /v2p
18762025-01-17T07:31:39.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1004 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52341 req_id = 2910c271-8f3e-486e-bf2f-b9e6658f4af0 response_code = 204 uri = /vpc-routes
18772025-01-17T07:31:39.618ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18782025-01-17T07:31:39.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153691 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47167 req_id = e147c12f-4d49-4f88-9294-aa77baed78eb response_code = 204 uri = /switch-ports
18792025-01-17T07:31:39.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47167 req_id = ca35991e-af06-49ce-9365-d742c4067b44 response_code = 200 uri = /network-bootstore-config
18802025-01-17T07:31:50.684ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9552 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = a9e00a6d-9d70-40eb-9e26-565eee455486 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
18812025-01-17T07:31:54.995ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56739
18822025-01-17T07:31:54.996ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56739 req_id = 01f91a9a-24b0-4bf4-9cf6-67955d663008 response_code = 200 uri = /baseboard
18832025-01-17T07:32:09.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51992
18842025-01-17T07:32:09.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51992 req_id = 141782a3-ec6c-42fd-875f-fcb4d1ad3ae9 response_code = 200 uri = /vpc-routes
18852025-01-17T07:32:09.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61078
18862025-01-17T07:32:09.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61078 req_id = a3520b0f-1c70-4391-9c0a-013aef61b7dc response_code = 200 uri = /vpc-routes
18872025-01-17T07:32:09.466ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
18882025-01-17T07:32:09.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51992 req_id = 0296ccaa-0a01-4fd9-8df7-62ef6cdcef97 response_code = 204 uri = /eip-gateways
18892025-01-17T07:32:09.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51992 req_id = 7fd956fb-9d24-4d46-ada0-799283a8bd2a response_code = 204 uri = /vpc-routes
18902025-01-17T07:32:09.491ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
18912025-01-17T07:32:09.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61078 req_id = 05ff3a92-d155-4d9c-9b25-c7ef787012ce response_code = 204 uri = /eip-gateways
18922025-01-17T07:32:09.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61078 req_id = f6dea754-8aad-40ed-9004-740008ca9dc8 response_code = 204 uri = /vpc-routes
18932025-01-17T07:32:09.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62785
18942025-01-17T07:32:09.605ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18952025-01-17T07:32:09.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18962025-01-17T07:32:09.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105028 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62785 req_id = 280a895a-ee8c-44d3-a67d-2a9b0e552ec3 response_code = 204 uri = /switch-ports
18972025-01-17T07:32:09.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34472
18982025-01-17T07:32:09.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54046
18992025-01-17T07:32:09.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62785 req_id = c3198650-04d9-43d8-9a91-d5da2cbd583b response_code = 200 uri = /network-bootstore-config
19002025-01-17T07:32:09.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34472 req_id = ed7e7ce0-4ef4-4fb4-a5c4-43362d59f226 response_code = 200 uri = /v2p
19012025-01-17T07:32:09.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54046 req_id = d574bd76-250a-4645-9fa6-7e1b085160e9 response_code = 200 uri = /v2p
19022025-01-17T07:32:09.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59984
19032025-01-17T07:32:09.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59984 req_id = 2596ef71-087d-4f00-81ce-9231a209eeb7 response_code = 200 uri = /vpc-routes
19042025-01-17T07:32:09.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
19052025-01-17T07:32:09.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59984 req_id = 5a5262e8-aee6-4756-8116-c78fc401fc63 response_code = 204 uri = /eip-gateways
19062025-01-17T07:32:09.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59984 req_id = af2215c4-7962-4d93-89ed-437e658a20e9 response_code = 204 uri = /vpc-routes
19072025-01-17T07:32:09.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63038
19082025-01-17T07:32:09.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19092025-01-17T07:32:09.836ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19102025-01-17T07:32:09.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63038 req_id = 810073c8-492b-437f-a11d-de8eb18551be response_code = 204 uri = /switch-ports
19112025-01-17T07:32:09.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53428
19122025-01-17T07:32:09.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33206
19132025-01-17T07:32:09.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53428 req_id = 30e858e6-456c-4cf5-a4d9-3103a196f013 response_code = 200 uri = /v2p
19142025-01-17T07:32:09.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63038 req_id = fb3b04df-2956-4f35-8d6c-4eedeeb41279 response_code = 200 uri = /network-bootstore-config
19152025-01-17T07:32:09.898ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19162025-01-17T07:32:09.938ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19172025-01-17T07:32:09.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101014 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33206 req_id = 08b90f3b-f0bd-474b-b491-b58455cf119e response_code = 204 uri = /switch-ports
19182025-01-17T07:32:09.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33206 req_id = 3afedbe2-a69c-4d84-a55e-09a269d45bd6 response_code = 200 uri = /network-bootstore-config
19192025-01-17T07:32:17.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19202025-01-17T07:32:20.682ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7298 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 4e4ae62c-e8ed-4998-a926-ab65b48fb151 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
19212025-01-17T07:32:25.033ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39132
19222025-01-17T07:32:25.033ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39132 req_id = f3217842-ba6b-4e9e-8600-8c7a872b94d8 response_code = 200 uri = /baseboard
19232025-01-17T07:32:39.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60976
19242025-01-17T07:32:39.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60976 req_id = 4c601281-4cf2-4fe7-b8e1-c818a45a000c response_code = 200 uri = /vpc-routes
19252025-01-17T07:32:39.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41168
19262025-01-17T07:32:39.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41168 req_id = cbd01609-688e-4807-a3c0-38c5fd51afb8 response_code = 200 uri = /v2p
19272025-01-17T07:32:39.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38070
19282025-01-17T07:32:39.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38070 req_id = be8472d5-0a7a-45f5-941c-0af0690863f1 response_code = 200 uri = /vpc-routes
19292025-01-17T07:32:39.323ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
19302025-01-17T07:32:39.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60976 req_id = 5dc0461f-c8ea-4ee2-9145-605615352a12 response_code = 204 uri = /eip-gateways
19312025-01-17T07:32:39.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60976 req_id = 11087894-80c8-4be3-9783-bc95f0ca981d response_code = 204 uri = /vpc-routes
19322025-01-17T07:32:39.366ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
19332025-01-17T07:32:39.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38070 req_id = e52b82a8-fbba-4a9a-b9d6-5a7cae0de95e response_code = 204 uri = /eip-gateways
19342025-01-17T07:32:39.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40589
19352025-01-17T07:32:39.373ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19362025-01-17T07:32:39.412ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19372025-01-17T07:32:39.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105422 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40589 req_id = e341fb36-5806-4ff0-8e76-2ada7bdec43a response_code = 204 uri = /switch-ports
19382025-01-17T07:32:39.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46108
19392025-01-17T07:32:39.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49931
19402025-01-17T07:32:39.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37792
19412025-01-17T07:32:39.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40589 req_id = 87e80ef6-b700-48eb-9a5a-9c705a5114f2 response_code = 200 uri = /network-bootstore-config
19422025-01-17T07:32:39.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 615 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38070 req_id = b5957753-982f-4e8e-bcd9-3651bb943862 response_code = 204 uri = /vpc-routes
19432025-01-17T07:32:39.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37792 req_id = 830019f0-7a6c-4372-9d60-d87832794e2e response_code = 200 uri = /vpc-routes
19442025-01-17T07:32:39.480ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19452025-01-17T07:32:39.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46108 req_id = 8f2ccc14-9b9e-4db1-92d7-bf8cd03d524c response_code = 200 uri = /v2p
19462025-01-17T07:32:39.495ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
19472025-01-17T07:32:39.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37792 req_id = 2e3184f0-d452-4374-ae06-cabf88647b68 response_code = 204 uri = /eip-gateways
19482025-01-17T07:32:39.519ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19492025-01-17T07:32:39.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39791
19502025-01-17T07:32:39.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39791 req_id = 45d85672-9ce2-4401-8e67-c0c3e1060908 response_code = 200 uri = /v2p
19512025-01-17T07:32:39.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 890 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37792 req_id = 698ba20e-27e8-423d-89ea-c373bf192225 response_code = 204 uri = /vpc-routes
19522025-01-17T07:32:39.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49931 req_id = 9a5f90f8-de66-47bc-bfec-40f6ef6c8ef9 response_code = 204 uri = /switch-ports
19532025-01-17T07:32:39.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49931 req_id = f01728ad-a27c-4777-a24b-be12d9156fe3 response_code = 200 uri = /network-bootstore-config
19542025-01-17T07:32:39.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40145
19552025-01-17T07:32:39.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19562025-01-17T07:32:39.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19572025-01-17T07:32:39.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98137 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40145 req_id = 4cd99e5c-91d2-42b2-9f15-0345e2cff04e response_code = 204 uri = /switch-ports
19582025-01-17T07:32:39.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40145 req_id = 8a40c284-58fd-4215-bec6-3cae80076a9a response_code = 200 uri = /network-bootstore-config
19592025-01-17T07:32:50.681ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6829 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 1a811cf2-1457-4c91-870c-1bd8075ea315 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
19602025-01-17T07:32:55.070ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35707
19612025-01-17T07:32:55.070ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35707 req_id = 0e9f88d2-4b80-45c2-aa30-2246855e203a response_code = 200 uri = /baseboard
19622025-01-17T07:33:09.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62743
19632025-01-17T07:33:09.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62743 req_id = 507c5d15-03c9-4025-969d-e76f8f9b79b7 response_code = 200 uri = /vpc-routes
19642025-01-17T07:33:09.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46472
19652025-01-17T07:33:09.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46472 req_id = 8c6ea5d8-29a6-4824-ba09-93b1aa60a089 response_code = 200 uri = /vpc-routes
19662025-01-17T07:33:09.362ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
19672025-01-17T07:33:09.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62743 req_id = 06c766f1-b3be-4fa5-9dd8-d680d3d6db5a response_code = 204 uri = /eip-gateways
19682025-01-17T07:33:09.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62743 req_id = 59eb0d39-c323-447d-ab94-5b8d7de294d3 response_code = 204 uri = /vpc-routes
19692025-01-17T07:33:09.412ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
19702025-01-17T07:33:09.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46472 req_id = c4ef8949-2ce0-4ed3-8c55-d222649defbd response_code = 204 uri = /eip-gateways
19712025-01-17T07:33:09.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46472 req_id = f6efba30-cdca-47a8-b437-265f375f2e52 response_code = 204 uri = /vpc-routes
19722025-01-17T07:33:09.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37048
19732025-01-17T07:33:09.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37048 req_id = 8f99998e-92a5-4d49-82ed-137414fe3236 response_code = 200 uri = /vpc-routes
19742025-01-17T07:33:09.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35724
19752025-01-17T07:33:09.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35724 req_id = e6e3323f-0d88-4a74-835b-b0565efa9ccf response_code = 200 uri = /v2p
19762025-01-17T07:33:09.562ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
19772025-01-17T07:33:09.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37048 req_id = 79e238bd-964c-4a43-9c4d-82cd95797584 response_code = 204 uri = /eip-gateways
19782025-01-17T07:33:09.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37048 req_id = dfd971aa-55ef-4ff0-bb85-907116b9bfdb response_code = 204 uri = /vpc-routes
19792025-01-17T07:33:09.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58127
19802025-01-17T07:33:09.580ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19812025-01-17T07:33:09.625ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19822025-01-17T07:33:09.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104286 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58127 req_id = a3b5d14a-0f7e-409e-8ad0-3f72514668df response_code = 204 uri = /switch-ports
19832025-01-17T07:33:09.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52486
19842025-01-17T07:33:09.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58127
19852025-01-17T07:33:09.684ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19862025-01-17T07:33:09.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3640 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52486 req_id = 720f7ea5-e394-4419-a70e-9648e3a2696f response_code = 200 uri = /v2p
19872025-01-17T07:33:09.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3835 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58127 req_id = 6a6b64d5-f808-436f-adec-2476966007e7 response_code = 200 uri = /network-bootstore-config
19882025-01-17T07:33:09.719ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19892025-01-17T07:33:09.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58269
19902025-01-17T07:33:09.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58269 req_id = ee9821d6-e4b2-4509-95f1-493ea9381aac response_code = 200 uri = /v2p
19912025-01-17T07:33:09.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85171 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58127 req_id = 0ff8b2ca-4f45-4bcc-9a85-95762f19bb0c response_code = 204 uri = /switch-ports
19922025-01-17T07:33:09.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58127 req_id = 6804214e-53d8-4f48-ac65-63826ecfd450 response_code = 200 uri = /network-bootstore-config
19932025-01-17T07:33:09.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43737
19942025-01-17T07:33:09.818ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19952025-01-17T07:33:09.851ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19962025-01-17T07:33:09.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43737 req_id = 294824e0-16da-4b17-a42b-cb22393f332c response_code = 204 uri = /switch-ports
19972025-01-17T07:33:09.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43737 req_id = c7f2de68-6f88-4231-a857-fc6963d68113 response_code = 200 uri = /network-bootstore-config
19982025-01-17T07:33:20.682ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7864 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 84747e41-8e22-4c47-841c-ec701f31be4c response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
19992025-01-17T07:33:25.102ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59035
20002025-01-17T07:33:25.102ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59035 req_id = 9e365b09-026b-4a6f-8c84-feb658bb8d4c response_code = 200 uri = /baseboard
20012025-01-17T07:33:39.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56703
20022025-01-17T07:33:39.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56703 req_id = 07082b72-fc8a-4401-aaa1-408ebc97b7ec response_code = 200 uri = /vpc-routes
20032025-01-17T07:33:39.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34699
20042025-01-17T07:33:39.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34699 req_id = 234bdd7a-d060-4d66-b225-e53767444f91 response_code = 200 uri = /vpc-routes
20052025-01-17T07:33:39.348ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
20062025-01-17T07:33:39.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56703 req_id = 16917238-4ca1-48ab-907c-9aac26f92e5e response_code = 204 uri = /eip-gateways
20072025-01-17T07:33:39.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56703 req_id = 4218bceb-f315-40dc-95c0-1e3fe6aa1738 response_code = 204 uri = /vpc-routes
20082025-01-17T07:33:39.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40236
20092025-01-17T07:33:39.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40236 req_id = cc6c9f82-eb99-4a55-9eb4-7321eda5f3df response_code = 200 uri = /v2p
20102025-01-17T07:33:39.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51594
20112025-01-17T07:33:39.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51594 req_id = b125fe6d-958c-4320-8ed3-aba55603ec09 response_code = 200 uri = /vpc-routes
20122025-01-17T07:33:39.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47332
20132025-01-17T07:33:39.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40750
20142025-01-17T07:33:39.452ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20152025-01-17T07:33:39.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33543
20162025-01-17T07:33:39.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33543 req_id = 66345d6f-2e6c-421f-813f-768d96d905d9 response_code = 200 uri = /v2p
20172025-01-17T07:33:39.458ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
20182025-01-17T07:33:39.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34699 req_id = c86e43c6-98b4-483f-b92b-2f2da0d79d46 response_code = 204 uri = /eip-gateways
20192025-01-17T07:33:39.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34699 req_id = 6003e12b-ec15-414f-bc90-72e669cdb7ed response_code = 204 uri = /vpc-routes
20202025-01-17T07:33:39.493ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
20212025-01-17T07:33:39.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 802 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51594 req_id = a044833e-6536-4d12-905d-4a7beb214dda response_code = 204 uri = /eip-gateways
20222025-01-17T07:33:39.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51594 req_id = dffdf297-cdab-4942-abbc-286d24152448 response_code = 204 uri = /vpc-routes
20232025-01-17T07:33:39.507ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20242025-01-17T07:33:39.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52137
20252025-01-17T07:33:39.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57250
20262025-01-17T07:33:39.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57250 req_id = ede2deed-0b5b-4ad3-8db9-5f4842577c16 response_code = 200 uri = /v2p
20272025-01-17T07:33:39.586ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20282025-01-17T07:33:39.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134181 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47332 req_id = b107b353-43ac-41fa-9895-1ee4e633239c response_code = 204 uri = /switch-ports
20292025-01-17T07:33:39.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 464 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47332 req_id = fee3db90-a6c2-467d-9e78-71cbf5f46448 response_code = 200 uri = /network-bootstore-config
20302025-01-17T07:33:39.626ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20312025-01-17T07:33:39.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 230974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40750 req_id = 6526e44b-d8de-4058-9274-a404e237157a response_code = 204 uri = /switch-ports
20322025-01-17T07:33:39.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20332025-01-17T07:33:39.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 670 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40750 req_id = 8d3c0ee0-6f8c-42da-b273-c895b9829379 response_code = 200 uri = /network-bootstore-config
20342025-01-17T07:33:39.721ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20352025-01-17T07:33:39.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52137 req_id = 122b3c93-2c3b-491c-a137-063cb9e140aa response_code = 204 uri = /switch-ports
20362025-01-17T07:33:39.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52137 req_id = 2a1243f3-c9f2-4ebf-aec5-6ad554de053b response_code = 200 uri = /network-bootstore-config
20372025-01-17T07:33:50.682ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6767 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = a277f0b9-584b-42e8-b4f6-4dc3af1ce1b2 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
20382025-01-17T07:33:55.135ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32870
20392025-01-17T07:33:55.135ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32870 req_id = 91a6392b-4fb3-4b8b-b909-fa8e26a91318 response_code = 200 uri = /baseboard
20402025-01-17T07:34:09.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56861
20412025-01-17T07:34:09.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56861 req_id = c217de4f-ccf2-4983-8691-ca8774185846 response_code = 200 uri = /vpc-routes
20422025-01-17T07:34:09.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49016
20432025-01-17T07:34:09.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49016 req_id = d5175f30-a028-428c-b56e-0730ce5ee793 response_code = 200 uri = /vpc-routes
20442025-01-17T07:34:09.480ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
20452025-01-17T07:34:09.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56861 req_id = a3411fbe-0203-4cee-9af6-9b2f667fccb4 response_code = 204 uri = /eip-gateways
20462025-01-17T07:34:09.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56861 req_id = d2de030d-da67-4940-bf1b-046a13bd8ede response_code = 204 uri = /vpc-routes
20472025-01-17T07:34:09.503ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
20482025-01-17T07:34:09.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49016 req_id = 19515131-e46d-47cc-a504-e3b87e1c32de response_code = 204 uri = /eip-gateways
20492025-01-17T07:34:09.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49016 req_id = 2a77fdb8-8098-4b14-b2b0-0c82148b3425 response_code = 204 uri = /vpc-routes
20502025-01-17T07:34:09.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44645
20512025-01-17T07:34:09.600ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20522025-01-17T07:34:09.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20532025-01-17T07:34:09.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131526 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44645 req_id = 8d94b217-035a-4a75-8e53-404d4ed6e9d1 response_code = 204 uri = /switch-ports
20542025-01-17T07:34:09.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53464
20552025-01-17T07:34:09.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42144
20562025-01-17T07:34:09.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44852
20572025-01-17T07:34:09.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35415
20582025-01-17T07:34:09.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44645 req_id = d19c2db4-b3a7-44ed-b336-0651b038be7b response_code = 200 uri = /network-bootstore-config
20592025-01-17T07:34:09.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57951
20602025-01-17T07:34:09.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20612025-01-17T07:34:09.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6971 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53464 req_id = bc49324a-0fc1-4148-ae71-347e4b071212 response_code = 200 uri = /vpc-routes
20622025-01-17T07:34:09.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5514 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35415 req_id = 49a296aa-9713-4a78-9df8-a64d7e5f535e response_code = 200 uri = /v2p
20632025-01-17T07:34:09.745ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20642025-01-17T07:34:09.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20652025-01-17T07:34:09.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44852 req_id = 67decc08-b10d-4ee7-af6b-efd7ce7e315a response_code = 200 uri = /v2p
20662025-01-17T07:34:09.746ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20672025-01-17T07:34:09.746ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20682025-01-17T07:34:09.746ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20692025-01-17T07:34:09.746ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20702025-01-17T07:34:09.746ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20712025-01-17T07:34:09.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57951 req_id = 16feb5fe-acb7-4737-82d7-dc5e5b36b285 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20722025-01-17T07:34:09.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45604
20732025-01-17T07:34:09.787ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20742025-01-17T07:34:09.792ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
20752025-01-17T07:34:09.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 715 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53464 req_id = eb995414-9980-4dbf-a972-86917561634e response_code = 204 uri = /eip-gateways
20762025-01-17T07:34:09.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53956
20772025-01-17T07:34:09.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53956 req_id = fb0e6922-2f92-4175-8c99-f4ecc93796d8 response_code = 200 uri = /v2p
20782025-01-17T07:34:09.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53464 req_id = ec9f97a1-2dd3-4d6f-85e1-0b2c445e8d64 response_code = 204 uri = /vpc-routes
20792025-01-17T07:34:09.853ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20802025-01-17T07:34:09.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114206 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42144 req_id = a7ffcba7-144a-4281-9b57-4ef90f7f7f36 response_code = 204 uri = /switch-ports
20812025-01-17T07:34:09.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 772 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42144 req_id = 8fb8eac1-ff4e-42e5-8b20-97cd0b662b38 response_code = 200 uri = /network-bootstore-config
20822025-01-17T07:34:09.892ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20832025-01-17T07:34:09.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41027
20842025-01-17T07:34:09.907ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20852025-01-17T07:34:09.907ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20862025-01-17T07:34:09.907ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20872025-01-17T07:34:09.907ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20882025-01-17T07:34:09.907ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20892025-01-17T07:34:09.907ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20902025-01-17T07:34:09.907ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20912025-01-17T07:34:09.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3754 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41027 req_id = de78e88b-442e-453a-8690-cdabde45b6fd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20922025-01-17T07:34:09.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57129
20932025-01-17T07:34:09.943ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20942025-01-17T07:34:09.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20952025-01-17T07:34:09.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20962025-01-17T07:34:09.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20972025-01-17T07:34:09.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20982025-01-17T07:34:09.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20992025-01-17T07:34:09.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21002025-01-17T07:34:09.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 633 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57129 req_id = 26254616-bb95-48bc-abc9-6c859d51ca17 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21012025-01-17T07:34:09.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188219 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45604 req_id = 4d6cede1-a83b-4d1c-9285-68d18a765089 response_code = 204 uri = /switch-ports
21022025-01-17T07:34:09.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45604 req_id = 81b2a19b-71a6-439a-9c8d-03ba6eadeb56 response_code = 200 uri = /network-bootstore-config
21032025-01-17T07:34:20.683ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7354 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 406d7848-5d1c-4b4a-843f-9240192a1cc8 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
21042025-01-17T07:34:25.168ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42943
21052025-01-17T07:34:25.168ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42943 req_id = 564f8a9f-3dcf-4fba-94a1-4f6ae99accb8 response_code = 200 uri = /baseboard
21062025-01-17T07:34:39.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63394
21072025-01-17T07:34:39.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63394 req_id = 4ce33b9b-0d48-489a-a1ee-6b7653907e50 response_code = 200 uri = /vpc-routes
21082025-01-17T07:34:39.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48024
21092025-01-17T07:34:39.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48024 req_id = 55e0a922-66a4-4236-b3ba-bb20f5230655 response_code = 200 uri = /vpc-routes
21102025-01-17T07:34:39.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
21112025-01-17T07:34:39.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63394 req_id = 2c0aa33d-6f6b-4398-9203-4eedd945b6b1 response_code = 204 uri = /eip-gateways
21122025-01-17T07:34:39.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63394 req_id = 52a43ff1-1041-44f9-b3d4-71557d27b069 response_code = 204 uri = /vpc-routes
21132025-01-17T07:34:39.344ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
21142025-01-17T07:34:39.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48024 req_id = 84f0d0a7-ae40-4dd9-bbf1-6d09cfda89d8 response_code = 204 uri = /eip-gateways
21152025-01-17T07:34:39.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48024 req_id = 95e90fde-b49d-4200-bc64-196d0532338a response_code = 204 uri = /vpc-routes
21162025-01-17T07:34:39.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59884
21172025-01-17T07:34:39.387ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21182025-01-17T07:34:39.429ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21192025-01-17T07:34:39.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103656 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59884 req_id = e8f7013d-6655-474c-aac3-edc5be24e623 response_code = 204 uri = /switch-ports
21202025-01-17T07:34:39.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40119
21212025-01-17T07:34:39.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47446
21222025-01-17T07:34:39.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65284
21232025-01-17T07:34:39.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63241
21242025-01-17T07:34:39.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47446 req_id = afbce48d-1d2d-41c3-92e0-11eb77221c90 response_code = 200 uri = /v2p
21252025-01-17T07:34:39.491ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21262025-01-17T07:34:39.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63241 req_id = 879496e4-2f17-41c9-9910-4c69bb4a153c response_code = 200 uri = /vpc-routes
21272025-01-17T07:34:39.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59884 req_id = 568dd180-d396-4327-a76b-f70f58baea4c response_code = 200 uri = /network-bootstore-config
21282025-01-17T07:34:39.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4072 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40119 req_id = c5050aec-7e9d-4276-b2c1-eaa9413899bc response_code = 200 uri = /v2p
21292025-01-17T07:34:39.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44168
21302025-01-17T07:34:39.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44168 req_id = 80ed2268-f8cb-4f9f-8b36-cf154bc03593 response_code = 200 uri = /v2p
21312025-01-17T07:34:39.530ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21322025-01-17T07:34:39.535ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
21332025-01-17T07:34:39.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63241 req_id = 3a6d00d6-3a0c-48f0-8f7a-eddc82dd2d5a response_code = 204 uri = /eip-gateways
21342025-01-17T07:34:39.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 878 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63241 req_id = f4767390-4460-4b14-8a52-e4a117fc8b24 response_code = 204 uri = /vpc-routes
21352025-01-17T07:34:39.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34099
21362025-01-17T07:34:39.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100077 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65284 req_id = 6e4c5e07-03a8-4d6e-897c-034b2f8b2da7 response_code = 204 uri = /switch-ports
21372025-01-17T07:34:39.591ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21382025-01-17T07:34:39.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65284 req_id = 42f518cb-336a-4ada-8663-44b5f0e5ef27 response_code = 200 uri = /network-bootstore-config
21392025-01-17T07:34:39.631ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21402025-01-17T07:34:39.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34099 req_id = faffa054-6b19-48d3-9a9b-71a04d6346ff response_code = 204 uri = /switch-ports
21412025-01-17T07:34:39.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34099 req_id = 805fe7df-c264-40b7-b662-827b77f57c63 response_code = 200 uri = /network-bootstore-config
21422025-01-17T07:34:50.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10839 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 8211f5d4-aeec-4f17-97f4-164510997d50 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
21432025-01-17T07:34:55.202ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43632
21442025-01-17T07:34:55.202ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43632 req_id = a15341f1-1714-4405-8694-001b0b68c63b response_code = 200 uri = /baseboard
21452025-01-17T07:35:09.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43685
21462025-01-17T07:35:09.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43685 req_id = 618739f2-16fe-45cd-9a91-0bd4ac8cd1fb response_code = 200 uri = /vpc-routes
21472025-01-17T07:35:09.539ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
21482025-01-17T07:35:09.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43685 req_id = dd900e36-80de-4740-b841-d1366cda92a5 response_code = 204 uri = /eip-gateways
21492025-01-17T07:35:09.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43685 req_id = 39b96f43-ba4d-4400-9d3d-2cd1e89d84af response_code = 204 uri = /vpc-routes
21502025-01-17T07:35:09.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42095
21512025-01-17T07:35:09.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42095 req_id = 63239936-098a-4ec2-a7cf-727df4a78c4b response_code = 200 uri = /v2p
21522025-01-17T07:35:09.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44527
21532025-01-17T07:35:09.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44527 req_id = 014783f7-7626-4cb6-ab35-d88ce8218e4e response_code = 200 uri = /vpc-routes
21542025-01-17T07:35:09.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58093
21552025-01-17T07:35:09.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58093 req_id = 646627fc-7e44-4eba-ae46-fe0530bd544c response_code = 200 uri = /v2p
21562025-01-17T07:35:09.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40278
21572025-01-17T07:35:09.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40278 req_id = 48812763-9b62-441d-92e6-778a0a7c2391 response_code = 200 uri = /vpc-routes
21582025-01-17T07:35:09.659ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
21592025-01-17T07:35:09.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44527 req_id = 1089a95c-a0e3-4d34-8947-78e32a4f207a response_code = 204 uri = /eip-gateways
21602025-01-17T07:35:09.661ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
21612025-01-17T07:35:09.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40278 req_id = 8cd89e3a-443c-4f09-b1ca-ad44aae43162 response_code = 204 uri = /eip-gateways
21622025-01-17T07:35:09.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47574
21632025-01-17T07:35:09.668ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21642025-01-17T07:35:09.709ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21652025-01-17T07:35:09.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101938 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47574 req_id = c1581325-3804-4b5a-b4cc-9ef5c25c80ba response_code = 204 uri = /switch-ports
21662025-01-17T07:35:09.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42952
21672025-01-17T07:35:09.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46515
21682025-01-17T07:35:09.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49413
21692025-01-17T07:35:09.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47574 req_id = c7dd0304-606b-4d56-ae3e-76cf9b194161 response_code = 200 uri = /network-bootstore-config
21702025-01-17T07:35:09.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42952 req_id = acea58a8-1236-4421-a28a-f392aff34df4 response_code = 200 uri = /v2p
21712025-01-17T07:35:09.771ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21722025-01-17T07:35:09.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5035 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44527 req_id = 8c4910f2-182b-4761-b469-f4c8cd83f5bf response_code = 204 uri = /vpc-routes
21732025-01-17T07:35:09.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40278 req_id = 14ff397b-225c-4f49-9dc4-5155e5c74673 response_code = 204 uri = /vpc-routes
21742025-01-17T07:35:09.810ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21752025-01-17T07:35:09.867ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21762025-01-17T07:35:09.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96904 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46515 req_id = 3343316e-a067-4439-9080-1b78c1809097 response_code = 204 uri = /switch-ports
21772025-01-17T07:35:09.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 702 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46515 req_id = a0644175-8017-4a13-9ddc-8467426de8a9 response_code = 200 uri = /network-bootstore-config
21782025-01-17T07:35:09.903ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21792025-01-17T07:35:09.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191369 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49413 req_id = 5d8d745e-fd88-4b0a-96b5-098a4a27a4f1 response_code = 204 uri = /switch-ports
21802025-01-17T07:35:09.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49413 req_id = 504fae86-8cd1-4f77-b675-ff5eabeec269 response_code = 200 uri = /network-bootstore-config
21812025-01-17T07:35:20.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8043 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 6c0915e0-8a9c-420d-8cb6-4acb0955a081 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
21822025-01-17T07:35:25.237ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41105
21832025-01-17T07:35:25.237ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41105 req_id = f1b6c987-743c-45ec-8bc9-a0f706c66971 response_code = 200 uri = /baseboard
21842025-01-17T07:35:39.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35064
21852025-01-17T07:35:39.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35064 req_id = ff1bbfdc-9419-48ee-acc9-b7d974574c78 response_code = 200 uri = /vpc-routes
21862025-01-17T07:35:39.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40638
21872025-01-17T07:35:39.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40638 req_id = 7aa268af-7f9b-41ba-b636-af97ebce5b2c response_code = 200 uri = /vpc-routes
21882025-01-17T07:35:39.264ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
21892025-01-17T07:35:39.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35064 req_id = 70ef7acb-c2f3-409e-9612-5fb740e3a728 response_code = 204 uri = /eip-gateways
21902025-01-17T07:35:39.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35064 req_id = cdb83bd3-f922-4368-915b-2177a765f395 response_code = 204 uri = /vpc-routes
21912025-01-17T07:35:39.282ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
21922025-01-17T07:35:39.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40638 req_id = 7635e206-e418-4ab3-ad1e-6f761df28b42 response_code = 204 uri = /eip-gateways
21932025-01-17T07:35:39.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40638 req_id = 74940851-dd87-4600-b43d-58d7da57779c response_code = 204 uri = /vpc-routes
21942025-01-17T07:35:39.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36710
21952025-01-17T07:35:39.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36710 req_id = a0bd3f68-da3c-4252-880a-4df67ff014dc response_code = 200 uri = /v2p
21962025-01-17T07:35:39.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50958
21972025-01-17T07:35:39.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50958 req_id = c4773567-d016-457c-866c-cb3a5f5ba931 response_code = 200 uri = /vpc-routes
21982025-01-17T07:35:39.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39062
21992025-01-17T07:35:39.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39062 req_id = 454ec56c-a60e-4125-85a7-b0be1a5b0cd0 response_code = 200 uri = /v2p
22002025-01-17T07:35:39.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59793
22012025-01-17T07:35:39.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22022025-01-17T07:35:39.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22032025-01-17T07:35:39.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59793 req_id = f0e6e627-973d-4b06-9f06-2978bd216e12 response_code = 204 uri = /switch-ports
22042025-01-17T07:35:39.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45279
22052025-01-17T07:35:39.470ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
22062025-01-17T07:35:39.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50958 req_id = 4bdc1bbb-c11d-4c24-b78e-e0ab10816d55 response_code = 204 uri = /eip-gateways
22072025-01-17T07:35:39.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59618
22082025-01-17T07:35:39.471ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22092025-01-17T07:35:39.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59618 req_id = 12062fc2-2dfe-4bcc-965a-823296af3755 response_code = 200 uri = /v2p
22102025-01-17T07:35:39.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59793 req_id = 86e4bbe1-978f-47c2-9986-7bdab1a7dbfa response_code = 200 uri = /network-bootstore-config
22112025-01-17T07:35:39.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50958 req_id = 4f38cb21-2db0-4edb-8401-e6786c26ca20 response_code = 204 uri = /vpc-routes
22122025-01-17T07:35:39.505ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22132025-01-17T07:35:39.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49548
22142025-01-17T07:35:39.558ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22152025-01-17T07:35:39.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87759 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45279 req_id = c60d7e23-d58a-42c4-99ed-c24e66c9e855 response_code = 204 uri = /switch-ports
22162025-01-17T07:35:39.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 585 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45279 req_id = 7c08e522-584c-46e9-8993-31c251f4b8f3 response_code = 200 uri = /network-bootstore-config
22172025-01-17T07:35:39.590ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22182025-01-17T07:35:39.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120825 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49548 req_id = 3c03689a-0caa-47d7-b864-11deb57a9c09 response_code = 204 uri = /switch-ports
22192025-01-17T07:35:39.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49548 req_id = 8fd726e4-75c0-4228-be9d-8020ea7dbc34 response_code = 200 uri = /network-bootstore-config
22202025-01-17T07:35:50.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7639 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 50b1633e-4e3a-44d3-bdf9-6439892a0249 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
22212025-01-17T07:35:55.270ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42511
22222025-01-17T07:35:55.270ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42511 req_id = 9a394bc4-7350-4db5-ae9e-335b5d5547cc response_code = 200 uri = /baseboard
22232025-01-17T07:36:09.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53172
22242025-01-17T07:36:09.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53172 req_id = d8836c6e-832a-4daa-a47c-29180ea7dcef response_code = 200 uri = /v2p
22252025-01-17T07:36:09.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41797
22262025-01-17T07:36:09.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41797 req_id = 87ae965b-b867-46dd-8d05-f6dc226c1c4c response_code = 200 uri = /vpc-routes
22272025-01-17T07:36:09.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55796
22282025-01-17T07:36:09.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55796 req_id = f7386614-bbb8-42f9-85b4-45fb888f6f2a response_code = 200 uri = /v2p
22292025-01-17T07:36:09.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
22302025-01-17T07:36:09.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41797 req_id = dbafc3f6-50fb-4054-8fbf-dc10be9c4541 response_code = 204 uri = /eip-gateways
22312025-01-17T07:36:09.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58652
22322025-01-17T07:36:09.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58652 req_id = 0d3ebb57-b7da-4588-974a-d83f17e0f317 response_code = 200 uri = /vpc-routes
22332025-01-17T07:36:09.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41797 req_id = a1c9b402-bd3d-425e-a4ee-ccbb82f1780a response_code = 204 uri = /vpc-routes
22342025-01-17T07:36:09.496ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
22352025-01-17T07:36:09.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58652 req_id = ea441e4e-97cb-4b55-87ca-f7c49bfa221b response_code = 204 uri = /eip-gateways
22362025-01-17T07:36:09.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58652 req_id = 3f299de9-aa09-4469-9811-0123db2fd95c response_code = 204 uri = /vpc-routes
22372025-01-17T07:36:09.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46591
22382025-01-17T07:36:09.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46591 req_id = 610c1f99-2c1a-44a6-a48a-461625d7509b response_code = 200 uri = /vpc-routes
22392025-01-17T07:36:09.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47847
22402025-01-17T07:36:09.574ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22412025-01-17T07:36:09.614ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22422025-01-17T07:36:09.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47847 req_id = 658be154-8590-4023-aa7c-9336edadefce response_code = 204 uri = /switch-ports
22432025-01-17T07:36:09.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47847 req_id = 22a8780a-ff78-4e05-b63b-dffb52db69a0 response_code = 200 uri = /network-bootstore-config
22442025-01-17T07:36:09.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39511
22452025-01-17T07:36:09.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39511 req_id = 12c61c73-b2d7-426e-85cd-43c2cc10fd85 response_code = 200 uri = /v2p
22462025-01-17T07:36:09.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63274
22472025-01-17T07:36:09.675ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22482025-01-17T07:36:09.720ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22492025-01-17T07:36:09.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97390 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63274 req_id = 2892db4a-1704-458b-a7a9-26cd8466d632 response_code = 204 uri = /switch-ports
22502025-01-17T07:36:09.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63274 req_id = 11d74200-d2f9-46cb-ba82-3f32057cbe15 response_code = 200 uri = /network-bootstore-config
22512025-01-17T07:36:09.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
22522025-01-17T07:36:09.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46591 req_id = f4f6ccdf-fa80-4c93-897c-6e492b6da670 response_code = 204 uri = /eip-gateways
22532025-01-17T07:36:09.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46591 req_id = bfe47606-ba30-43d1-a875-a9794b32004a response_code = 204 uri = /vpc-routes
22542025-01-17T07:36:09.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65142
22552025-01-17T07:36:09.865ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22562025-01-17T07:36:09.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22572025-01-17T07:36:09.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90386 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65142 req_id = 41c50af7-89b9-45d3-8f2f-ba3401c34f97 response_code = 204 uri = /switch-ports
22582025-01-17T07:36:09.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65142 req_id = 658f968e-8a4f-4809-85f9-2f4333e7e5c4 response_code = 200 uri = /network-bootstore-config
22592025-01-17T07:36:20.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8228 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = c1e99fa8-ca1e-4654-971c-bdd7ead9dd78 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
22602025-01-17T07:36:25.303ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33475
22612025-01-17T07:36:25.303ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33475 req_id = afaef232-4486-486f-912e-1e97c4bb1654 response_code = 200 uri = /baseboard
22622025-01-17T07:36:39.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59806
22632025-01-17T07:36:39.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59806 req_id = 8d164eda-4cc2-4b42-83a6-1dcd6de3e5c6 response_code = 200 uri = /vpc-routes
22642025-01-17T07:36:39.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53940
22652025-01-17T07:36:39.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53940 req_id = 88184702-b265-4278-aa59-9f343bf31439 response_code = 200 uri = /vpc-routes
22662025-01-17T07:36:39.330ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
22672025-01-17T07:36:39.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53940 req_id = 18139605-b50e-4642-a05a-f76d84835932 response_code = 204 uri = /eip-gateways
22682025-01-17T07:36:39.331ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
22692025-01-17T07:36:39.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59806 req_id = 6b22a16b-4fff-4e69-b1d3-0c358a28e2f3 response_code = 204 uri = /eip-gateways
22702025-01-17T07:36:39.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53940 req_id = 394d6469-966e-4795-a1f1-7f751cc7bbc6 response_code = 204 uri = /vpc-routes
22712025-01-17T07:36:39.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59806 req_id = 3fe95bfb-46e8-44b7-bb30-fc74882cbb58 response_code = 204 uri = /vpc-routes
22722025-01-17T07:36:39.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37582
22732025-01-17T07:36:39.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37582 req_id = 578dcfec-f214-45f8-8ea1-29bc25d1fd31 response_code = 200 uri = /v2p
22742025-01-17T07:36:39.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40958
22752025-01-17T07:36:39.414ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22762025-01-17T07:36:39.453ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22772025-01-17T07:36:39.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93388 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40958 req_id = 91ed51f3-579d-42df-9a00-9225ad1901a4 response_code = 204 uri = /switch-ports
22782025-01-17T07:36:39.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52809
22792025-01-17T07:36:39.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58100
22802025-01-17T07:36:39.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40377
22812025-01-17T07:36:39.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47363
22822025-01-17T07:36:39.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47363 req_id = 1f7f48ab-f33a-4f6d-a104-dd3d7ed46677 response_code = 200 uri = /v2p
22832025-01-17T07:36:39.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58100 req_id = 28eb9056-413e-4ab9-9146-ffc9b0c1132b response_code = 200 uri = /vpc-routes
22842025-01-17T07:36:39.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22852025-01-17T07:36:39.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40958 req_id = 9c94ac73-8c87-4295-be56-04b5bd56d481 response_code = 200 uri = /network-bootstore-config
22862025-01-17T07:36:39.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40377 req_id = f671c523-68d0-4e66-ac1b-bff09b2caa37 response_code = 200 uri = /v2p
22872025-01-17T07:36:39.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36053
22882025-01-17T07:36:39.528ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
22892025-01-17T07:36:39.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 679 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58100 req_id = d4f21457-abb6-487d-9485-f358808597eb response_code = 204 uri = /eip-gateways
22902025-01-17T07:36:39.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1000 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58100 req_id = a571bd2a-1b31-45e6-b443-0091614e2743 response_code = 204 uri = /vpc-routes
22912025-01-17T07:36:39.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22922025-01-17T07:36:39.605ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22932025-01-17T07:36:39.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97073 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52809 req_id = d0ef3dc2-8f5b-4cfb-9fa3-d3e5df3ef861 response_code = 204 uri = /switch-ports
22942025-01-17T07:36:39.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52809 req_id = 42b62e20-3f43-4984-a871-9d0686d6ac6b response_code = 200 uri = /network-bootstore-config
22952025-01-17T07:36:39.644ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22962025-01-17T07:36:39.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178857 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36053 req_id = 7feee06f-decd-485c-a3ab-9da5a9fc5174 response_code = 204 uri = /switch-ports
22972025-01-17T07:36:39.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36053 req_id = 3cadb7f9-9869-41f9-96d8-d38d960fcc3b response_code = 200 uri = /network-bootstore-config
22982025-01-17T07:36:50.686ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8479 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = d07ef95d-a04b-4bb2-b478-3b13a760eb9e response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
22992025-01-17T07:36:55.335ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50106
23002025-01-17T07:36:55.335ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50106 req_id = 26500b21-d1f6-4a5d-94d5-d0ff0cc5e8aa response_code = 200 uri = /baseboard
23012025-01-17T07:37:02.901ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23022025-01-17T07:37:02.902ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23032025-01-17T07:37:02.935ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1932, tv_nsec: 668119851 } time_to_next_cleanup = 599.99999803s
23042025-01-17T07:37:09.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49315
23052025-01-17T07:37:09.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49315 req_id = 1abe640c-22b2-4d7f-9f2a-5d54228dba10 response_code = 200 uri = /vpc-routes
23062025-01-17T07:37:09.392ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
23072025-01-17T07:37:09.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49315 req_id = aa38d3d0-cd5f-4ac5-b8cc-a0e6fc1e2791 response_code = 204 uri = /eip-gateways
23082025-01-17T07:37:09.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53888
23092025-01-17T07:37:09.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53888 req_id = 95e5c5ee-aaaa-40b6-82d0-cb832e433b44 response_code = 200 uri = /v2p
23102025-01-17T07:37:09.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49315 req_id = 7aefbad4-bb29-4420-8133-b38a407e8b0a response_code = 204 uri = /vpc-routes
23112025-01-17T07:37:09.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41729
23122025-01-17T07:37:09.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41729 req_id = cbd87616-d1fb-439a-9b99-856f9285f724 response_code = 200 uri = /vpc-routes
23132025-01-17T07:37:09.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55548
23142025-01-17T07:37:09.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55548 req_id = 22fbb3a0-aad8-4e65-9b4a-828c15804b86 response_code = 200 uri = /vpc-routes
23152025-01-17T07:37:09.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
23162025-01-17T07:37:09.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41729 req_id = 65cd4170-77a7-4687-8abb-18cbd9a078e1 response_code = 204 uri = /eip-gateways
23172025-01-17T07:37:09.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41729 req_id = f16dd650-396d-4fc1-8d66-e7a25b3c9b42 response_code = 204 uri = /vpc-routes
23182025-01-17T07:37:09.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33623
23192025-01-17T07:37:09.605ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23202025-01-17T07:37:09.647ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23212025-01-17T07:37:09.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104097 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33623 req_id = 4af18734-8c6e-4cea-acca-62dafb149469 response_code = 204 uri = /switch-ports
23222025-01-17T07:37:09.709ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
23232025-01-17T07:37:09.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55548 req_id = 0e80d69c-fa71-4297-91d3-f15c66044f48 response_code = 204 uri = /eip-gateways
23242025-01-17T07:37:09.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33623 req_id = 7884abbe-2fe5-4665-890f-6fb081850f0c response_code = 200 uri = /network-bootstore-config
23252025-01-17T07:37:09.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61477
23262025-01-17T07:37:09.715ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23272025-01-17T07:37:09.752ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23282025-01-17T07:37:09.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92015 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61477 req_id = 06cbb5d1-e515-449c-bdab-7921f1cc9b67 response_code = 204 uri = /switch-ports
23292025-01-17T07:37:09.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38012
23302025-01-17T07:37:09.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46664
23312025-01-17T07:37:09.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44593
23322025-01-17T07:37:09.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61477 req_id = 19a266e6-d3b5-4d8e-9e97-a8ce69dd496f response_code = 200 uri = /network-bootstore-config
23332025-01-17T07:37:09.807ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23342025-01-17T07:37:09.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44593 req_id = 35d588ac-024a-480d-b965-43e44d296c19 response_code = 200 uri = /v2p
23352025-01-17T07:37:09.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38012 req_id = d0b281ab-0be1-43c7-9cb3-b0bb9dca7dd6 response_code = 200 uri = /v2p
23362025-01-17T07:37:09.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55548 req_id = 94d3413e-b94d-47e7-90be-af572cb909df response_code = 204 uri = /vpc-routes
23372025-01-17T07:37:09.844ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23382025-01-17T07:37:09.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90872 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46664 req_id = 80e593b4-9532-4364-8752-1f3fee8f16b2 response_code = 204 uri = /switch-ports
23392025-01-17T07:37:09.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46664 req_id = 76378c65-de18-4fbd-a0e7-a4de8befbd15 response_code = 200 uri = /network-bootstore-config
23402025-01-17T07:37:17.201ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23412025-01-17T07:37:20.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7832 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 97fbc2a1-bf57-4256-96b7-d14a2402ffe0 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
23422025-01-17T07:37:25.368ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37337
23432025-01-17T07:37:25.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37337 req_id = df70b396-f0da-4449-af8a-fdc125ed66fe response_code = 200 uri = /baseboard
23442025-01-17T07:37:39.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60309
23452025-01-17T07:37:39.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60309 req_id = c5bf9a19-f846-4776-9a4d-2edcc70e3c5d response_code = 200 uri = /vpc-routes
23462025-01-17T07:37:39.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63070
23472025-01-17T07:37:39.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63070 req_id = a45b7cc5-44b7-4dd7-b2fd-9e02c9fc0950 response_code = 200 uri = /vpc-routes
23482025-01-17T07:37:39.366ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
23492025-01-17T07:37:39.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60309 req_id = 0f38ebe0-dd85-40a4-b0a6-4f18ff361ad9 response_code = 204 uri = /eip-gateways
23502025-01-17T07:37:39.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63055
23512025-01-17T07:37:39.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63055 req_id = 1d3cffa6-b747-4369-b231-c84e5eed4c9f response_code = 200 uri = /v2p
23522025-01-17T07:37:39.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60309 req_id = d4eab639-bbe4-4cde-81ce-c0c9d36d6922 response_code = 204 uri = /vpc-routes
23532025-01-17T07:37:39.401ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
23542025-01-17T07:37:39.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63070 req_id = 0acdda9c-02a8-4880-9c11-b39687b3a3bb response_code = 204 uri = /eip-gateways
23552025-01-17T07:37:39.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63070 req_id = c2e67634-0c2b-4228-8788-6581c382f470 response_code = 204 uri = /vpc-routes
23562025-01-17T07:37:39.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58136
23572025-01-17T07:37:39.453ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23582025-01-17T07:37:39.501ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23592025-01-17T07:37:39.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58136 req_id = 85d98cd1-bff6-4038-aeab-c428901997f4 response_code = 204 uri = /switch-ports
23602025-01-17T07:37:39.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35356
23612025-01-17T07:37:39.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54631
23622025-01-17T07:37:39.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52366
23632025-01-17T07:37:39.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36701
23642025-01-17T07:37:39.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58136 req_id = b6c9f12c-561f-4a4f-83e5-7da14960b259 response_code = 200 uri = /network-bootstore-config
23652025-01-17T07:37:39.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23662025-01-17T07:37:39.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35356 req_id = 719ec484-5148-4497-ba93-0b81b124e7f6 response_code = 200 uri = /vpc-routes
23672025-01-17T07:37:39.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52366 req_id = 48d4454f-38cd-4d10-a1c9-b6e95b7bb3b5 response_code = 200 uri = /v2p
23682025-01-17T07:37:39.596ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
23692025-01-17T07:37:39.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35356 req_id = 483b8c50-b82a-45e0-a4de-9447f9b41e72 response_code = 204 uri = /eip-gateways
23702025-01-17T07:37:39.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 843 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35356 req_id = 48f36649-edcd-45c7-b2d5-18ec61eaec60 response_code = 204 uri = /vpc-routes
23712025-01-17T07:37:39.622ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23722025-01-17T07:37:39.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55525
23732025-01-17T07:37:39.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55525 req_id = 3ecd3a5a-d7f4-49f0-ae62-781cb04b8405 response_code = 200 uri = /v2p
23742025-01-17T07:37:39.676ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23752025-01-17T07:37:39.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101674 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36701 req_id = 30080f4d-3aec-4243-9b0f-fb4b0f42a84e response_code = 204 uri = /switch-ports
23762025-01-17T07:37:39.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 706 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36701 req_id = 4cb7280f-d13a-464c-befc-7d3540418558 response_code = 200 uri = /network-bootstore-config
23772025-01-17T07:37:39.715ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23782025-01-17T07:37:39.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54631 req_id = 0766a7cf-646e-4db3-8ee6-166e328c0c2d response_code = 204 uri = /switch-ports
23792025-01-17T07:37:39.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54631 req_id = 58688f3a-4be9-41dc-b288-54be015e5eed response_code = 200 uri = /network-bootstore-config
23802025-01-17T07:37:50.686ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7990 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 64637eb7-a9af-46fc-ac4f-29c57933ba3e response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
23812025-01-17T07:37:55.400ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60501
23822025-01-17T07:37:55.400ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60501 req_id = b74dacb3-e72c-4aa1-8639-1847d6261d19 response_code = 200 uri = /baseboard
23832025-01-17T07:38:09.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40776
23842025-01-17T07:38:09.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40776 req_id = 23676dbc-1aa5-4639-b134-116245acf9ad response_code = 200 uri = /vpc-routes
23852025-01-17T07:38:09.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49021
23862025-01-17T07:38:09.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49021 req_id = a21aded1-d557-47b6-bdbf-c280ccd15878 response_code = 200 uri = /vpc-routes
23872025-01-17T07:38:09.492ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
23882025-01-17T07:38:09.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40776 req_id = 095cce4a-7d52-4290-9387-914ac1c142c8 response_code = 204 uri = /eip-gateways
23892025-01-17T07:38:09.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40776 req_id = 2d8c13fa-e73a-4745-a4bc-38cc49c7a85c response_code = 204 uri = /vpc-routes
23902025-01-17T07:38:09.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
23912025-01-17T07:38:09.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49021 req_id = f972f090-da56-439a-95dc-03d43f1db62c response_code = 204 uri = /eip-gateways
23922025-01-17T07:38:09.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49021 req_id = d60c107a-13a5-4499-9cce-8ed4bc9d6fcd response_code = 204 uri = /vpc-routes
23932025-01-17T07:38:09.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50659
23942025-01-17T07:38:09.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50659 req_id = 4fb0b3c7-824b-4591-9067-e36e2a91c766 response_code = 200 uri = /v2p
23952025-01-17T07:38:09.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32779
23962025-01-17T07:38:09.588ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23972025-01-17T07:38:09.628ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23982025-01-17T07:38:09.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32779 req_id = 43f26ada-567b-44f9-8c0d-21eee2ecaecf response_code = 204 uri = /switch-ports
23992025-01-17T07:38:09.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46056
24002025-01-17T07:38:09.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63373
24012025-01-17T07:38:09.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41165
24022025-01-17T07:38:09.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41165 req_id = 58793d70-dd62-40ec-99ed-5a2c760fe340 response_code = 200 uri = /v2p
24032025-01-17T07:38:09.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46056 req_id = 84322d1a-cf42-4508-ab19-691d56649f8e response_code = 200 uri = /vpc-routes
24042025-01-17T07:38:09.685ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24052025-01-17T07:38:09.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5043 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32779 req_id = 3db4b728-fa78-4791-8ec4-b51e3e65b96b response_code = 200 uri = /network-bootstore-config
24062025-01-17T07:38:09.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58877
24072025-01-17T07:38:09.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58877 req_id = 836ca7d7-6d75-45d0-a8cb-72697d434403 response_code = 200 uri = /v2p
24082025-01-17T07:38:09.704ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
24092025-01-17T07:38:09.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 693 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46056 req_id = 0896fc72-ba0f-414f-814d-29a043b20387 response_code = 204 uri = /eip-gateways
24102025-01-17T07:38:09.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34673
24112025-01-17T07:38:09.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46056 req_id = f593ea7b-ef66-4a65-90fa-61077db22ef9 response_code = 204 uri = /vpc-routes
24122025-01-17T07:38:09.726ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24132025-01-17T07:38:09.784ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24142025-01-17T07:38:09.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63373 req_id = cb962271-557e-45cd-8464-08b2be1db194 response_code = 204 uri = /switch-ports
24152025-01-17T07:38:09.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 528 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63373 req_id = 70cc7ca4-d0a0-4e73-9048-608982e37cb2 response_code = 200 uri = /network-bootstore-config
24162025-01-17T07:38:09.820ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24172025-01-17T07:38:09.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34673 req_id = 6fc4252a-89c6-40ca-a8c6-9afc4da3cb81 response_code = 204 uri = /switch-ports
24182025-01-17T07:38:09.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34673 req_id = 2aa6554a-83b2-4710-9199-9ee8ed9108cc response_code = 200 uri = /network-bootstore-config
24192025-01-17T07:38:20.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7220 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = b44e41c5-735e-4b9b-bd01-e9de4113ff45 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
24202025-01-17T07:38:25.434ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45186
24212025-01-17T07:38:25.434ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45186 req_id = 57e3d5be-79c6-426f-81cf-e19a0cd58eb6 response_code = 200 uri = /baseboard
24222025-01-17T07:38:39.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34229
24232025-01-17T07:38:39.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34229 req_id = f32359f7-57d8-4baf-b3d2-5ac509a941af response_code = 200 uri = /vpc-routes
24242025-01-17T07:38:39.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43167
24252025-01-17T07:38:39.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43167 req_id = 99c8864e-2ece-4dd1-85e3-915e4484ef8c response_code = 200 uri = /vpc-routes
24262025-01-17T07:38:39.341ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
24272025-01-17T07:38:39.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34229 req_id = 1d629714-f23b-49f2-873a-1a55a6fc6b53 response_code = 204 uri = /eip-gateways
24282025-01-17T07:38:39.361ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
24292025-01-17T07:38:39.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43167 req_id = 3aa03fc8-6404-4c37-92cd-fe5e94d05028 response_code = 204 uri = /eip-gateways
24302025-01-17T07:38:39.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50451
24312025-01-17T07:38:39.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50451 req_id = f934d696-8407-4648-b787-45a242609c25 response_code = 200 uri = /v2p
24322025-01-17T07:38:39.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43167 req_id = 05495d06-658e-4a89-b66b-45247e8a094d response_code = 204 uri = /vpc-routes
24332025-01-17T07:38:39.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34229 req_id = b8e21793-fd37-457e-872f-9cf9853d5b01 response_code = 204 uri = /vpc-routes
24342025-01-17T07:38:39.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58666
24352025-01-17T07:38:39.389ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24362025-01-17T07:38:39.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24372025-01-17T07:38:39.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58666 req_id = 5aa4bc9a-5448-4f7f-b70e-03752568dd20 response_code = 204 uri = /switch-ports
24382025-01-17T07:38:39.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36690
24392025-01-17T07:38:39.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56014
24402025-01-17T07:38:39.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65265
24412025-01-17T07:38:39.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47543
24422025-01-17T07:38:39.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58666 req_id = ad36eecf-87a9-4c8d-8988-e43e26d24454 response_code = 200 uri = /network-bootstore-config
24432025-01-17T07:38:39.516ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24442025-01-17T07:38:39.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4878 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56014 req_id = ef72e489-347b-4f8b-929a-e4258ed0f2bb response_code = 200 uri = /v2p
24452025-01-17T07:38:39.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 11121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47543 req_id = 91989ebb-372f-4a57-8282-1869236ff2b5 response_code = 200 uri = /v2p
24462025-01-17T07:38:39.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 11345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65265 req_id = 5e900ce9-5273-4673-aacc-2b7daafbf5c2 response_code = 200 uri = /vpc-routes
24472025-01-17T07:38:39.556ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
24482025-01-17T07:38:39.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65265 req_id = e1248f12-916c-41d4-9f02-5fa571d3046d response_code = 204 uri = /eip-gateways
24492025-01-17T07:38:39.560ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24502025-01-17T07:38:39.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65265 req_id = 0e5c0dc5-df42-4159-b343-5237a043e99e response_code = 204 uri = /vpc-routes
24512025-01-17T07:38:39.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45676
24522025-01-17T07:38:39.618ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24532025-01-17T07:38:39.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102757 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36690 req_id = 5e221a95-53dc-4367-bdcc-bedbe9939fec response_code = 204 uri = /switch-ports
24542025-01-17T07:38:39.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 646 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36690 req_id = bf376fcf-58bc-4dcc-8fe3-c7f399d0e4fb response_code = 200 uri = /network-bootstore-config
24552025-01-17T07:38:39.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24562025-01-17T07:38:39.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133245 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45676 req_id = 0165f56a-7d74-43e7-93ca-0ae2072b283f response_code = 204 uri = /switch-ports
24572025-01-17T07:38:39.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45676 req_id = 4efcb056-4dbb-41c2-8616-73dcba227ff1 response_code = 200 uri = /network-bootstore-config
24582025-01-17T07:38:50.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7925 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 15f53c67-ca93-4ddf-bced-e9e5d72a1403 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
24592025-01-17T07:38:55.466ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54100
24602025-01-17T07:38:55.466ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54100 req_id = 3b6b9006-ed3d-4ae8-8f12-5c9b2e508c74 response_code = 200 uri = /baseboard
24612025-01-17T07:39:09.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62842
24622025-01-17T07:39:09.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62842 req_id = 576c413f-a62e-4d7a-9f6e-7b10c20717f3 response_code = 200 uri = /vpc-routes
24632025-01-17T07:39:09.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
24642025-01-17T07:39:09.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62842 req_id = 839214eb-f25d-4c8d-9cf4-8522ef07fdda response_code = 204 uri = /eip-gateways
24652025-01-17T07:39:09.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62842 req_id = 52161b7b-e7db-4477-82de-ef34beb54ee7 response_code = 204 uri = /vpc-routes
24662025-01-17T07:39:09.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59591
24672025-01-17T07:39:09.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59591 req_id = f8126490-3d55-4144-886d-2aa1e0da4782 response_code = 200 uri = /vpc-routes
24682025-01-17T07:39:09.589ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
24692025-01-17T07:39:09.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59591 req_id = 90e71a04-471f-4acb-96aa-d0849249f7f7 response_code = 204 uri = /eip-gateways
24702025-01-17T07:39:09.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59591 req_id = b260bb15-b651-4b9c-9692-f35d048e7298 response_code = 204 uri = /vpc-routes
24712025-01-17T07:39:09.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59631
24722025-01-17T07:39:09.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59631 req_id = 52eee7a3-2bb7-4774-b7da-75f4eb122f31 response_code = 200 uri = /vpc-routes
24732025-01-17T07:39:09.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48942
24742025-01-17T07:39:09.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48942 req_id = 788b3c14-941d-4915-8701-5a6c4ebd2f1e response_code = 200 uri = /v2p
24752025-01-17T07:39:09.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61399
24762025-01-17T07:39:09.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61399 req_id = d9f26fbd-356c-41ea-9285-b07e534c5f56 response_code = 200 uri = /v2p
24772025-01-17T07:39:09.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52709
24782025-01-17T07:39:09.681ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24792025-01-17T07:39:09.722ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24802025-01-17T07:39:09.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106041 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52709 req_id = 2d84e63b-ce15-4ac5-b736-d429e6bd91a2 response_code = 204 uri = /switch-ports
24812025-01-17T07:39:09.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62393
24822025-01-17T07:39:09.787ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
24832025-01-17T07:39:09.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59631 req_id = 8352f187-0627-46ac-9b7d-f6ea11500e58 response_code = 204 uri = /eip-gateways
24842025-01-17T07:39:09.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39748
24852025-01-17T07:39:09.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36057
24862025-01-17T07:39:09.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55001
24872025-01-17T07:39:09.787ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24882025-01-17T07:39:09.787ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24892025-01-17T07:39:09.787ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:177
24902025-01-17T07:39:09.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52709 req_id = d50a47ef-1322-4dde-a51f-d203a3fbba42 response_code = 200 uri = /network-bootstore-config
24912025-01-17T07:39:09.787ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24922025-01-17T07:39:09.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24932025-01-17T07:39:09.793ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24942025-01-17T07:39:09.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24952025-01-17T07:39:09.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24962025-01-17T07:39:09.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24972025-01-17T07:39:09.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24982025-01-17T07:39:09.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24992025-01-17T07:39:09.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25002025-01-17T07:39:09.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6591 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36057 req_id = 6f6ab07a-3f2d-4c3d-b23d-983dc1282c43 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25012025-01-17T07:39:09.794ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:177
25022025-01-17T07:39:09.807ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25032025-01-17T07:39:09.807ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd
25042025-01-17T07:39:09.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25052025-01-17T07:39:09.824ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:177
25062025-01-17T07:39:09.828ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:177
25072025-01-17T07:39:09.832ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25082025-01-17T07:39:09.836ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25092025-01-17T07:39:09.836ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841
25102025-01-17T07:39:09.850ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25112025-01-17T07:39:09.850ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd
25122025-01-17T07:39:09.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59188
25132025-01-17T07:39:09.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59631 req_id = c43385e9-8296-4e63-98d2-2944c79cbfa8 response_code = 204 uri = /vpc-routes
25142025-01-17T07:39:09.866ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25152025-01-17T07:39:09.866ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25162025-01-17T07:39:09.866ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/config/omicron-zones.json file = common/src/ledger.rs:177
25172025-01-17T07:39:09.875ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/config/omicron-zones.json file = common/src/ledger.rs:177
25182025-01-17T07:39:09.880ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25192025-01-17T07:39:09.880ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e
25202025-01-17T07:39:09.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60463
25212025-01-17T07:39:09.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60463 req_id = 6b6c3390-ca88-4e21-9bf5-b81008d333d2 response_code = 200 uri = /v2p
25222025-01-17T07:39:09.895ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25232025-01-17T07:39:09.895ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841
25242025-01-17T07:39:09.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55001 req_id = 1b677e59-770c-4ec3-8d7c-4d6d535d96fd response_code = 204 uri = /switch-ports
25252025-01-17T07:39:09.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55001 req_id = 2bcd533e-901d-42ad-8a71-7519f72ef197 response_code = 200 uri = /network-bootstore-config
25262025-01-17T07:39:09.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48778
25272025-01-17T07:39:09.906ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25282025-01-17T07:39:09.906ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25292025-01-17T07:39:09.906ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25302025-01-17T07:39:09.906ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25312025-01-17T07:39:09.906ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25322025-01-17T07:39:09.906ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25332025-01-17T07:39:09.906ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25342025-01-17T07:39:09.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48778 req_id = 602c6b08-104b-4987-a343-9691cc138d4a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25352025-01-17T07:39:09.909ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ade9310a-246d-42ae-ac99-e5fa7edb32cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25362025-01-17T07:39:09.909ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ade9310a-246d-42ae-ac99-e5fa7edb32cd
25372025-01-17T07:39:09.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56797
25382025-01-17T07:39:09.919ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25392025-01-17T07:39:09.928ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25402025-01-17T07:39:09.928ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6
25412025-01-17T07:39:09.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42134
25422025-01-17T07:39:09.942ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8f0b1726-da08-41ec-a4c9-04d6b18b5fd0, kind: Service { id: 7f47121b-12fd-4abc-a73f-0730b0912f3f }, name: Name("external-dns-7f47121b-12fd-4abc-a73f-0730b0912f3f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 50])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bee94243-cdc0-4169-a47d-7b909dd33b1a, kind: Service { id: 698e9900-c4dc-4c83-a27a-15b855c7d659 }, name: Name("external-dns-698e9900-c4dc-4c83-a27a-15b855c7d659"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 53616262-58ac-4c29-a95c-e1eeb0179cfc, kind: Service { id: f16d291f-3318-414c-a9b3-9d3363ece06d }, name: Name("nexus-f16d291f-3318-414c-a9b3-9d3363ece06d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 185])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5801ec83-59cc-480f-a07d-4b97a388dabe, kind: Service { id: 4556b772-0c65-4b05-a77f-6ccbe1f3923a }, name: Name("nexus-4556b772-0c65-4b05-a77f-6ccbe1f3923a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 162])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6dc9992d-fde3-40f8-9947-9532995a6d13, kind: Service { id: a8f04023-6d44-4570-ac4a-005dc53e1aa3 }, name: Name("nexus-a8f04023-6d44-4570-ac4a-005dc53e1aa3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25432025-01-17T07:39:09.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25442025-01-17T07:39:09.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25452025-01-17T07:39:09.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25462025-01-17T07:39:09.942ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25472025-01-17T07:39:09.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25482025-01-17T07:39:09.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25492025-01-17T07:39:09.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 701 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42134 req_id = 22525ef7-774b-4f54-b792-542c3e97259e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25502025-01-17T07:39:09.949ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5a87517-097c-4a2f-afbf-79d6c9f09841 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25512025-01-17T07:39:09.949ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5a87517-097c-4a2f-afbf-79d6c9f09841
25522025-01-17T07:39:09.967ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25532025-01-17T07:39:09.968ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e
25542025-01-17T07:39:09.970ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25552025-01-17T07:39:09.986ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25562025-01-17T07:39:09.987ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d
25572025-01-17T07:39:10.011ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25582025-01-17T07:39:10.011ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6
25592025-01-17T07:39:10.026ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 40ecfd63-dbad-47b6-b4dc-5ec07acc064e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25602025-01-17T07:39:10.027ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_40ecfd63-dbad-47b6-b4dc-5ec07acc064e
25612025-01-17T07:39:10.044ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25622025-01-17T07:39:10.044ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3
25632025-01-17T07:39:10.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56797 req_id = 6c3b664d-8cb7-469b-b642-f70cc08c4318 response_code = 204 uri = /switch-ports
25642025-01-17T07:39:10.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56797 req_id = 00b9b459-402e-4ab9-b387-330ccae3b10a response_code = 200 uri = /network-bootstore-config
25652025-01-17T07:39:10.058ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a70c5d15-749f-4edb-acb5-978cf6d6a0e6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25662025-01-17T07:39:10.058ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a70c5d15-749f-4edb-acb5-978cf6d6a0e6
25672025-01-17T07:39:10.071ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25682025-01-17T07:39:10.071ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d
25692025-01-17T07:39:10.087ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25702025-01-17T07:39:10.088ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5
25712025-01-17T07:39:10.106ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25722025-01-17T07:39:10.106ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3
25732025-01-17T07:39:10.118ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5cf2694b-be09-4fa3-a419-e39c5e9a1b2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25742025-01-17T07:39:10.118ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5cf2694b-be09-4fa3-a419-e39c5e9a1b2d
25752025-01-17T07:39:10.135ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25762025-01-17T07:39:10.135ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4
25772025-01-17T07:39:10.154ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a66b5bb6-ab1d-4ce3-a106-8aab030b10a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25782025-01-17T07:39:10.154ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a66b5bb6-ab1d-4ce3-a106-8aab030b10a3
25792025-01-17T07:39:10.165ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25802025-01-17T07:39:10.165ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5
25812025-01-17T07:39:10.181ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25822025-01-17T07:39:10.181ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b
25832025-01-17T07:39:10.195ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25842025-01-17T07:39:10.195ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4
25852025-01-17T07:39:10.209ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb15c0f9-9b0e-4a01-bfc8-246a568c95e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25862025-01-17T07:39:10.209ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb15c0f9-9b0e-4a01-bfc8-246a568c95e5
25872025-01-17T07:39:10.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 425639 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62393 req_id = 9aced1c9-a292-4335-bb1b-a5b982eb2e8a response_code = 200 uri = /inventory
25882025-01-17T07:39:10.232ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ad1a5a5-5214-4567-bf05-ddbf81ca27f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25892025-01-17T07:39:10.232ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ad1a5a5-5214-4567-bf05-ddbf81ca27f4
25902025-01-17T07:39:10.245ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25912025-01-17T07:39:10.245ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b
25922025-01-17T07:39:10.262ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83d1549d-4c3e-4f65-a42f-f9d01576fa7b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25932025-01-17T07:39:10.262ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83d1549d-4c3e-4f65-a42f-f9d01576fa7b
25942025-01-17T07:39:10.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 479115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39748 req_id = 19a881ad-778f-4f95-845f-84c68e6797ad response_code = 200 uri = /inventory
25952025-01-17T07:39:10.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 421173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59188 req_id = 84956342-5ca8-4143-99b5-fd18e7452327 response_code = 200 uri = /inventory
25962025-01-17T07:39:20.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8512 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = 2122cc54-18c6-49bb-b44c-fb91ac4123a1 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
25972025-01-17T07:39:25.499ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60359
25982025-01-17T07:39:25.499ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60359 req_id = edcedcc9-78a5-42c9-babf-4f70560bed6f response_code = 200 uri = /baseboard
25992025-01-17T07:39:39.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47803
26002025-01-17T07:39:39.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47803 req_id = a3aeac75-37f8-4a05-8ee3-669188fb8eef response_code = 200 uri = /vpc-routes
26012025-01-17T07:39:39.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33513
26022025-01-17T07:39:39.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33513 req_id = 64763d7f-62e1-4063-a281-5106436602f6 response_code = 200 uri = /vpc-routes
26032025-01-17T07:39:39.339ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
26042025-01-17T07:39:39.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47803 req_id = 2dbc59dd-5af3-46f2-9e9b-315b7876c849 response_code = 204 uri = /eip-gateways
26052025-01-17T07:39:39.341ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
26062025-01-17T07:39:39.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33513 req_id = 16565dcd-ab9e-4c86-8cfd-e61fe8f48b72 response_code = 204 uri = /eip-gateways
26072025-01-17T07:39:39.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47803 req_id = 04ec25a6-5e38-4055-96f1-b2db95425b9e response_code = 204 uri = /vpc-routes
26082025-01-17T07:39:39.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33513 req_id = 1575f4ae-3c9a-47bf-911c-258bd5da309c response_code = 204 uri = /vpc-routes
26092025-01-17T07:39:39.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48032
26102025-01-17T07:39:39.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26112025-01-17T07:39:39.411ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26122025-01-17T07:39:39.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107606 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48032 req_id = 61c35633-f5d1-4897-bc54-a61f6f14b231 response_code = 204 uri = /switch-ports
26132025-01-17T07:39:39.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35761
26142025-01-17T07:39:39.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36250
26152025-01-17T07:39:39.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41000
26162025-01-17T07:39:39.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41000 req_id = 0391676f-ca5a-4578-82e4-9eb87aa5ca6b response_code = 200 uri = /v2p
26172025-01-17T07:39:39.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48032 req_id = 3871e08f-9e05-4dce-b31d-7c2272503f3b response_code = 200 uri = /network-bootstore-config
26182025-01-17T07:39:39.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35761 req_id = b8be9fe2-f946-41bd-8eff-c20f3335ea27 response_code = 200 uri = /v2p
26192025-01-17T07:39:39.476ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26202025-01-17T07:39:39.510ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26212025-01-17T07:39:39.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61399
26222025-01-17T07:39:39.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61399 req_id = 11c69076-c5f8-4562-8ed4-41d3311e3a81 response_code = 200 uri = /vpc-routes
26232025-01-17T07:39:39.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89041 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36250 req_id = 3445b11b-4f9c-419e-b430-c5555dd37dcc response_code = 204 uri = /switch-ports
26242025-01-17T07:39:39.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36250 req_id = 63952e62-f5a5-4730-b3b1-4da9592cad9c response_code = 200 uri = /network-bootstore-config
26252025-01-17T07:39:39.601ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
26262025-01-17T07:39:39.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61399 req_id = 49bfac36-baad-4777-9a00-d3dded75f23f response_code = 204 uri = /eip-gateways
26272025-01-17T07:39:39.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61399 req_id = 5f08c23a-8918-4cca-8f3a-2cccce575418 response_code = 204 uri = /vpc-routes
26282025-01-17T07:39:39.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35866
26292025-01-17T07:39:39.626ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26302025-01-17T07:39:39.664ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26312025-01-17T07:39:39.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89558 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35866 req_id = 0fb0e4f8-bf90-40e8-abd8-c8f3295b72a7 response_code = 204 uri = /switch-ports
26322025-01-17T07:39:39.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53366
26332025-01-17T07:39:39.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53366 req_id = 9584f50b-7517-452f-a0ab-44805ab9d475 response_code = 200 uri = /v2p
26342025-01-17T07:39:39.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35866 req_id = 6e1e60d2-4498-45f0-b73f-1d966ef6f441 response_code = 200 uri = /network-bootstore-config
26352025-01-17T07:39:50.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8413 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = db6c259d-9a19-47c9-ba25-75bd8510a9ab response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
26362025-01-17T07:39:55.531ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43017
26372025-01-17T07:39:55.532ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43017 req_id = 31f691c6-7e8a-4923-8e82-ee7ef83dfb0c response_code = 200 uri = /baseboard
26382025-01-17T07:40:06.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64755
26392025-01-17T07:40:06.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64755 req_id = a252d4da-8db4-4594-ab03-bf46ec51f5b4 response_code = 200 uri = /v2p
26402025-01-17T07:40:06.847ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(8062315) }
26412025-01-17T07:40:06.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 961 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64755 req_id = d15ebe06-85fa-4aa6-ac68-0687af98e9ac response_code = 204 uri = /v2p
26422025-01-17T07:40:07.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53325
26432025-01-17T07:40:07.061ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 875b5d32-24b6-4f0d-ad61-1bba37746bef, kind: Instance { id: a6afe310-347c-44b3-972e-d3ace98b4fbb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8062315), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 875b5d32-24b6-4f0d-ad61-1bba37746bef, kind: Instance { id: a6afe310-347c-44b3-972e-d3ace98b4fbb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8062315), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 875b5d32-24b6-4f0d-ad61-1bba37746bef, kind: Instance { id: a6afe310-347c-44b3-972e-d3ace98b4fbb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8062315), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(8062315))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 875b5d32-24b6-4f0d-ad61-1bba37746bef, kind: Instance { id: a6afe310-347c-44b3-972e-d3ace98b4fbb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8062315), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 2fb22baf-71fe-4084-a37f-9306cf8c6fb2, slot: 0, read_only: false, vcr_json: .., name: "disk-16d4785988e" }], boot_settings: Some(InstanceBootSettings { order: [2fb22baf-71fe-4084-a37f-9306cf8c6fb2] }), cloud_init_bytes: Some(..) } instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb metadata = InstanceMetadata { silo_id: 647975c4-1959-4a2b-b414-ee459c3f152b, project_id: 575a957d-dc26-40e9-a357-2f66dc5171ba } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-17T07:40:07.052217113Z }
26442025-01-17T07:40:07.061ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb migration_id = None propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26452025-01-17T07:40:07.062ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb migration_id = None propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 875b5d32-24b6-4f0d-ad61-1bba37746bef, kind: Instance { id: a6afe310-347c-44b3-972e-d3ace98b4fbb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8062315), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 875b5d32-24b6-4f0d-ad61-1bba37746bef, kind: Instance { id: a6afe310-347c-44b3-972e-d3ace98b4fbb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8062315), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 875b5d32-24b6-4f0d-ad61-1bba37746bef, kind: Instance { id: a6afe310-347c-44b3-972e-d3ace98b4fbb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8062315), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(8062315))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 875b5d32-24b6-4f0d-ad61-1bba37746bef, kind: Instance { id: a6afe310-347c-44b3-972e-d3ace98b4fbb }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8062315), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 2fb22baf-71fe-4084-a37f-9306cf8c6fb2, slot: 0, read_only: false, vcr_json: .., name: "disk-16d4785988e" }], boot_settings: Some(InstanceBootSettings { order: [2fb22baf-71fe-4084-a37f-9306cf8c6fb2] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-17T07:40:07.052217113Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26462025-01-17T07:40:07.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 13147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53325 req_id = c6702210-2339-4b82-a0a5-59070de2b85c response_code = 200 uri = /vmms/d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26472025-01-17T07:40:07.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37693
26482025-01-17T07:40:07.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2063 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37693 req_id = 0971d1f5-10d4-4de2-af9d-24fac55a3ee1 response_code = 200 uri = /vmms/d9298d86-4ef5-4f1f-bd13-0639fbcbe17a/state
26492025-01-17T07:40:07.173ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 8062315 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26502025-01-17T07:40:07.173ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26512025-01-17T07:40:07.212ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a file = illumos-utils/src/zone.rs:325 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26522025-01-17T07:40:07.234ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a file = illumos-utils/src/zone.rs:363 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26532025-01-17T07:40:07.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42261
26542025-01-17T07:40:07.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42261 req_id = 33d9df99-1dd0-40cf-82b9-f317f3d62268 response_code = 200 uri = /vpc-routes
26552025-01-17T07:40:07.322ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {875b5d32-24b6-4f0d-ad61-1bba37746bef: {10.151.1.175: {95bb67f5-1872-4877-9aae-1e7d3e9dbfd8}, 10.151.1.176: {95bb67f5-1872-4877-9aae-1e7d3e9dbfd8}}} }
26562025-01-17T07:40:08.765ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26572025-01-17T07:40:08.765ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone file = illumos-utils/src/running_zone.rs:488 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26582025-01-17T07:40:08.940ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a") failed: Property not found. retry in 43.963212ms file = illumos-utils/src/svc.rs:42 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26592025-01-17T07:40:08.993ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a") failed: Property not found. retry in 105.758736ms file = illumos-utils/src/svc.rs:42 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26602025-01-17T07:40:09.156ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a") failed: Property not found. retry in 174.811908ms file = illumos-utils/src/svc.rs:42 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26612025-01-17T07:40:09.356ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a") failed: Property not found. retry in 482.914733ms file = illumos-utils/src/svc.rs:42 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26622025-01-17T07:40:09.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48779
26632025-01-17T07:40:09.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36458
26642025-01-17T07:40:09.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34460
26652025-01-17T07:40:09.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34460 req_id = 72bac396-0676-4faf-983e-351ae128e745 response_code = 200 uri = /vpc-routes
26662025-01-17T07:40:09.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33145
26672025-01-17T07:40:09.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53161
26682025-01-17T07:40:09.750ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26692025-01-17T07:40:09.801ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26702025-01-17T07:40:09.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53161 req_id = be548c97-9add-4470-a37a-c703123eb68b response_code = 204 uri = /switch-ports
26712025-01-17T07:40:09.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34338
26722025-01-17T07:40:09.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34338 req_id = a8c08a3c-aae5-493f-b750-90b1c5f14e6b response_code = 200 uri = /vpc-routes
26732025-01-17T07:40:09.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {875b5d32-24b6-4f0d-ad61-1bba37746bef: {10.151.1.176: {95bb67f5-1872-4877-9aae-1e7d3e9dbfd8}, 10.151.1.175: {95bb67f5-1872-4877-9aae-1e7d3e9dbfd8}}} }
26742025-01-17T07:40:09.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5598 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34460 req_id = dc160b57-677b-475d-8639-066e990529f4 response_code = 204 uri = /eip-gateways
26752025-01-17T07:40:09.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5984 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53161 req_id = 5a003167-55c7-4292-be13-619a46a75e42 response_code = 200 uri = /network-bootstore-config
26762025-01-17T07:40:09.896ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a") failed: Property not found. retry in 762.892165ms file = illumos-utils/src/svc.rs:42 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26772025-01-17T07:40:09.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54808
26782025-01-17T07:40:09.898ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26792025-01-17T07:40:09.951ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26802025-01-17T07:40:10.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133178 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54808 req_id = 7bbf9b87-483f-4390-8bf8-0d02d18d2a2a response_code = 204 uri = /switch-ports
26812025-01-17T07:40:10.031ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {875b5d32-24b6-4f0d-ad61-1bba37746bef: {10.151.1.175: {95bb67f5-1872-4877-9aae-1e7d3e9dbfd8}, 10.151.1.176: {95bb67f5-1872-4877-9aae-1e7d3e9dbfd8}}} }
26822025-01-17T07:40:10.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48587
26832025-01-17T07:40:10.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34338 req_id = 066637bb-6caa-4543-8206-f245e863687a response_code = 204 uri = /eip-gateways
26842025-01-17T07:40:10.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53491
26852025-01-17T07:40:10.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40379
26862025-01-17T07:40:10.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52914
26872025-01-17T07:40:10.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54808 req_id = aa3b5ab9-0dc5-4c40-a84c-2e1fbb6334f3 response_code = 200 uri = /network-bootstore-config
26882025-01-17T07:40:10.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48587 req_id = 6b111731-7af9-4ebc-85a4-d1d58eb05db4 response_code = 200 uri = /v2p
26892025-01-17T07:40:10.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53491 req_id = 0786a6ee-320a-49f9-af99-dd49863a9070 response_code = 200 uri = /v2p
26902025-01-17T07:40:10.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26912025-01-17T07:40:10.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52914 req_id = 9c2b8d0e-0ea1-45de-8d54-e42d039cd074 response_code = 200 uri = /v2p
26922025-01-17T07:40:10.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34460 req_id = 432b8a80-1d40-4a43-bfc1-3c9491560912 response_code = 204 uri = /vpc-routes
26932025-01-17T07:40:10.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26942025-01-17T07:40:10.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40379 req_id = b8018562-aeb7-439b-9e44-eadecaa4778d response_code = 204 uri = /switch-ports
26952025-01-17T07:40:10.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40379 req_id = beafdd14-e68a-4bf4-a295-f07f26bbcdfb response_code = 200 uri = /network-bootstore-config
26962025-01-17T07:40:10.192ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: dac48ceb-4ee6-4b7d-9d69-3ec8bd4e8345, version: 3 } old_vers = RouterVersion { router_id: dac48ceb-4ee6-4b7d-9d69-3ec8bd4e8345, version: 3 } subnet = RouterId { vni: Vni(8062315), kind: System }
26972025-01-17T07:40:10.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 486 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34338 req_id = 917f853d-8fc6-426c-a663-6d22dd57ad9b response_code = 204 uri = /vpc-routes
26982025-01-17T07:40:10.672ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a") failed: Property not found. retry in 1.443285292s file = illumos-utils/src/svc.rs:42 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
26992025-01-17T07:40:12.126ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a") failed: Property not found. retry in 917.509074ms file = illumos-utils/src/svc.rs:42 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27002025-01-17T07:40:13.054ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a") failed: Property not found. retry in 564.187098ms file = illumos-utils/src/svc.rs:42 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27012025-01-17T07:40:13.629ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a") failed: Property not found. retry in 1.059152268s file = illumos-utils/src/svc.rs:42 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a zone = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27022025-01-17T07:40:14.717ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a file = sled-agent/src/instance.rs:2068 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27032025-01-17T07:40:14.725ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27042025-01-17T07:40:14.761ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27052025-01-17T07:40:14.899ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27062025-01-17T07:40:14.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5287674 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48779 req_id = 3d0fbca0-df62-4c55-80d4-69a6a0877c02 response_code = 200 uri = /vmms/d9298d86-4ef5-4f1f-bd13-0639fbcbe17a/state
27072025-01-17T07:40:14.899ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
27082025-01-17T07:40:14.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5193505 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33145 req_id = ce8384ae-142f-42c9-804a-88ba4c2c81cc response_code = 200 uri = /vmms/d9298d86-4ef5-4f1f-bd13-0639fbcbe17a/state
27092025-01-17T07:40:14.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5243341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36458 req_id = 5f109f5b-c070-4fe4-8302-6f3e20487b36 response_code = 200 uri = /vmms/d9298d86-4ef5-4f1f-bd13-0639fbcbe17a/state
27102025-01-17T07:40:14.899ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-17T07:40:14.899781269Z } file = sled-agent/src/instance.rs:781 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27112025-01-17T07:40:14.899ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-17T07:40:14.899781269Z } propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27122025-01-17T07:40:14.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7577171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42261 req_id = 905824f4-1d50-4a05-80c8-e72cd7fcfee7 response_code = 204 uri = /eip-gateways
27132025-01-17T07:40:14.899ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-17T07:40:14.899781269Z }, migration_in: None, migration_out: None }
27142025-01-17T07:40:14.929ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-17T07:40:14.929077858Z } file = sled-agent/src/instance.rs:781 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27152025-01-17T07:40:14.929ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-17T07:40:14.929077858Z } propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27162025-01-17T07:40:14.929ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-17T07:40:14.929077858Z }, migration_in: None, migration_out: None }
27172025-01-17T07:40:15.004ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: dac48ceb-4ee6-4b7d-9d69-3ec8bd4e8345, version: 3 } old_vers = RouterVersion { router_id: dac48ceb-4ee6-4b7d-9d69-3ec8bd4e8345, version: 3 } subnet = RouterId { vni: Vni(8062315), kind: System }
27182025-01-17T07:40:15.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42261 req_id = 24d8f502-bb6f-45ef-bfee-4e8de0982ad5 response_code = 204 uri = /vpc-routes
27192025-01-17T07:40:15.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34616
27202025-01-17T07:40:15.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34616 req_id = 3e30c918-49aa-4dde-8ec9-ee39c1ef8995 response_code = 200 uri = /vpc-routes
27212025-01-17T07:40:15.147ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {875b5d32-24b6-4f0d-ad61-1bba37746bef: {10.151.1.176: {95bb67f5-1872-4877-9aae-1e7d3e9dbfd8}, 10.151.1.175: {95bb67f5-1872-4877-9aae-1e7d3e9dbfd8}}} }
27222025-01-17T07:40:15.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34616 req_id = c886c6c2-3f32-4c5e-8c10-a2a1180bcecc response_code = 204 uri = /eip-gateways
27232025-01-17T07:40:15.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34616 req_id = b52c237b-d83e-42da-a59e-98f0a455e920 response_code = 204 uri = /vpc-routes
27242025-01-17T07:40:20.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7385 local_addr = [fd00:1122:3344:101::1]:51514 method = GET remote_addr = [fd00:1122:3344:101::d]:42233 req_id = b1ff34d5-2c9f-4a50-bfa1-adaba3a0c641 response_code = 200 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 uri = /df37d1c6-999a-4855-92c3-920ccfa9c7b0
27252025-01-17T07:40:24.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58538
27262025-01-17T07:40:24.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1008 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58538 req_id = c047f657-5d37-47cb-926a-471937bc2cc3 response_code = 200 uri = /vmms/d9298d86-4ef5-4f1f-bd13-0639fbcbe17a/state
27272025-01-17T07:40:24.763ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-17T07:40:24.763972272Z } file = sled-agent/src/instance.rs:781 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27282025-01-17T07:40:24.764ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-17T07:40:24.763972272Z } propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27292025-01-17T07:40:24.764ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-17T07:40:24.763972272Z }, migration_in: None, migration_out: None }
27302025-01-17T07:40:24.800ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-17T07:40:24.800514132Z } file = sled-agent/src/instance.rs:781 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27312025-01-17T07:40:24.800ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-17T07:40:24.800514132Z } propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27322025-01-17T07:40:24.800ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27332025-01-17T07:40:24.800ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27342025-01-17T07:40:24.800ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 17264258033421965639 n_samples = 6 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
27352025-01-17T07:40:24.800ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 6760336671662311477 n_samples = 6 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
27362025-01-17T07:40:24.800ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27372025-01-17T07:40:24.801ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/0819f1e6-ddf3-48a6-ad1f-9728962f4834/debug/bundle/zone", "/pool/int/b1a4491e-a24b-4fc6-b2b0-584be9006609/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/ade9310a-246d-42ae-ac99-e5fa7edb32cd/crypt/debug", "/pool/ext/b5a87517-097c-4a2f-afbf-79d6c9f09841/crypt/debug", "/pool/ext/40ecfd63-dbad-47b6-b4dc-5ec07acc064e/crypt/debug", "/pool/ext/a70c5d15-749f-4edb-acb5-978cf6d6a0e6/crypt/debug", "/pool/ext/5cf2694b-be09-4fa3-a419-e39c5e9a1b2d/crypt/debug", "/pool/ext/a66b5bb6-ab1d-4ce3-a106-8aab030b10a3/crypt/debug", "/pool/ext/eb15c0f9-9b0e-4a01-bfc8-246a568c95e5/crypt/debug", "/pool/ext/1ad1a5a5-5214-4567-bf05-ddbf81ca27f4/crypt/debug", "/pool/ext/83d1549d-4c3e-4f65-a42f-f9d01576fa7b/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27382025-01-17T07:40:25.447ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a", bundle_id: 5a0f67f7-59ad-4306-bf47-29e062ac74e2 }, time_created: 2025-01-17T07:40:24.802471070Z, version: 0, cause: TerminatedInstance }
27392025-01-17T07:40:25.448ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_d9298d86-4ef5-4f1f-bd13-0639fbcbe17a file = sled-agent/src/instance.rs:1314 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27402025-01-17T07:40:25.567ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43081
27412025-01-17T07:40:25.567ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43081 req_id = 8f9a13cf-5a71-4354-855f-454ac7e4c272 response_code = 200 uri = /baseboard
27422025-01-17T07:40:27.202ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27432025-01-17T07:40:27.219ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(8062315), kind: System }
27442025-01-17T07:40:27.219ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(8062315), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27452025-01-17T07:40:27.219ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T07:40:27.219720707Z }, migration_in: None, migration_out: None }
27462025-01-17T07:40:27.244ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T07:40:27.219720707Z }, migration_in: None, migration_out: None }
27472025-01-17T07:40:27.247ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = a6afe310-347c-44b3-972e-d3ace98b4fbb propolis_id = d9298d86-4ef5-4f1f-bd13-0639fbcbe17a
27482025-01-17T07:40:27.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52159
27492025-01-17T07:40:27.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52159 req_id = 7d22ed0f-7bbd-4e9f-936b-927348cdb28e response_code = 200 uri = /vpc-routes
27502025-01-17T07:40:27.732ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
27512025-01-17T07:40:27.732ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0
27522025-01-17T07:40:27.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52159 req_id = a9b2cb87-7297-4da9-ab53-c469da56fba4 response_code = 204 uri = /eip-gateways
27532025-01-17T07:40:27.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52159 req_id = 0231cfa6-77a8-4b3f-bbc9-35ddafe2e641 response_code = 204 uri = /vpc-routes
27542025-01-17T07:40:27.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38250
27552025-01-17T07:40:27.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38250 req_id = 8d2a357e-8700-49da-abe1-90ea7945d6da response_code = 200 uri = /v2p
27562025-01-17T07:40:28.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33544
27572025-01-17T07:40:28.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33544 req_id = ec1f0d10-5c0e-4752-b8fd-a5d3d8caf2e5 response_code = 200 uri = /v2p
27582025-01-17T07:40:28.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45094
27592025-01-17T07:40:28.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45094 req_id = 75906913-4054-4aa7-a1a7-3da334ff8efc response_code = 200 uri = /vpc-routes
27602025-01-17T07:40:28.278ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
27612025-01-17T07:40:28.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45094 req_id = bf2bc168-b73d-4603-97b8-9a1adfa4a723 response_code = 204 uri = /eip-gateways
27622025-01-17T07:40:28.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45094 req_id = 12e478c8-8414-4f88-9466-7dcabfa807bb response_code = 204 uri = /vpc-routes
27632025-01-17T07:40:28.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43809
27642025-01-17T07:40:28.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43809 req_id = fa1f0be0-649c-4e98-a951-ddbef5e9d367 response_code = 200 uri = /vpc-routes
27652025-01-17T07:40:28.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = df37d1c6-999a-4855-92c3-920ccfa9c7b0 values = ExternalIpGatewayMap { mappings: {} }
27662025-01-17T07:40:28.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43809 req_id = fc8ec9cb-76d1-471a-bd3a-145bbea4a06f response_code = 204 uri = /eip-gateways
27672025-01-17T07:40:28.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43809 req_id = ed6267e6-e863-423f-b1eb-95a75eb8280d response_code = 204 uri = /vpc-routes