Max level shown:
1 [ Jan 9 01:30:36 Enabled. ]
2 [ Jan 9 01:30:36 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 9 01:30:36 Method "start" exited with status 0. ]
4 [ Jan 9 01:30:36 Rereading configuration. ]
5 [ Jan 9 01:30:36 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-09T01:30:36.351ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-09T01:30:36.351ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-09T01:30:36.406ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-09T01:30:36.406ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-09T01:30:36.524ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-09T01:30:36.533ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-09T01:30:36.541ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-09T01:30:37.146ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-01-09T01:30:37.286ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-09T01:30:37.286ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-09T01:30:37.286ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-09T01:30:37.286ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-09T01:30:37.286ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-01-09T01:30:37.286ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-09T01:30:37.289ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-09T01:30:37.289ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-09T01:30:37.289ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-09T01:30:37.289ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-09T01:30:37.289ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-09T01:30:37.289ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-09T01:30:37.289ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-09T01:30:37.289ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-09T01:30:37.289ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-09T01:30:37.302ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-09T01:30:37.302ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool)
322025-01-09T01:30:37.402ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal }
332025-01-09T01:30:37.765ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-09T01:30:37.765ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-09T01:30:37.765ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-09T01:30:37.765ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-09T01:30:37.765ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-09T01:30:37.765ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-09T01:30:37.765ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-09T01:30:37.774ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-09T01:30:37.774ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool)
422025-01-09T01:30:37.861ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal }
432025-01-09T01:30:38.225ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-09T01:30:38.225ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-09T01:30:38.225ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
462025-01-09T01:30:38.225ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
472025-01-09T01:30:38.225ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482025-01-09T01:30:38.225ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492025-01-09T01:30:38.225ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-09T01:30:38.225ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
512025-01-09T01:30:38.225ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
522025-01-09T01:30:38.225ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552025-01-09T01:30:38.226ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-09T01:30:38.226ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-09T01:30:38.226ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
592025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602025-01-09T01:30:38.226ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-09T01:30:38.226ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-09T01:30:38.226ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-09T01:30:38.226ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-09T01:30:38.226ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-09T01:30:38.226ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-09T01:30:38.226ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-09T01:30:38.226ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-09T01:30:38.226ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-09T01:30:38.226ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-09T01:30:38.226ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-09T01:30:38.226ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-09T01:30:38.226ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-09T01:30:38.226ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-09T01:30:38.226ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-01-09T01:30:38.226ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-01-09T01:30:38.226ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-01-09T01:30:38.226ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-09T01:30:38.226ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-09T01:30:38.226ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-09T01:30:38.226ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-09T01:30:38.226ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-09T01:30:38.226ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942025-01-09T01:30:38.226ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
952025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
962025-01-09T01:30:38.226ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972025-01-09T01:30:38.226ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-09T01:30:38.226ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1002025-01-09T01:30:38.226ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1012025-01-09T01:30:38.226ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022025-01-09T01:30:38.226ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-09T01:30:38.226ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-09T01:30:38.226ZINFOSledAgent (bootstore): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-01-09T01:30:38.226ZINFOSledAgent (bootstore): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-01-09T01:30:38.226ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-01-09T01:30:38.226ZINFOSledAgent (bootstore): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-01-09T01:30:38.226ZINFOSledAgent (bootstore): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-01-09T01:30:38.226ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-01-09T01:30:38.226ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-09T01:30:38.226ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-09T01:30:38.238ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:748
1132025-01-09T01:30:38.238ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1370, tv_nsec: 791911355 } time_to_next_cleanup = 599.999907778s
1142025-01-09T01:30:38.238ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
1152025-01-09T01:30:38.238ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-09T01:30:38.238ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-09T01:30:38.240ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-09T01:30:38.241ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-01-09T01:30:38.242ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-01-09T01:30:38.243ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212025-01-09T01:30:38.243ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-09T01:30:38.243ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-09T01:30:38.243ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-09T01:30:38.243ZINFOSledAgent (RSS): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-09T01:30:38.243ZINFOSledAgent (RSS): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-09T01:30:38.243ZINFOSledAgent (RSS): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-09T01:30:38.243ZINFOSledAgent (RSS): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-09T01:30:38.243ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292025-01-09T01:30:38.243ZINFOSledAgent (RSS): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-09T01:30:38.243ZINFOSledAgent (RSS): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-09T01:30:38.244ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322025-01-09T01:30:38.244ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-09T01:30:38.244ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-09T01:30:38.244ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-09T01:30:38.244ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-01-09T01:30:38.244ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-01-09T01:30:38.244ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-01-09T01:30:38.244ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-01-09T01:30:38.244ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 2a5ec8ce-31e5-4982-a156-7cc817b136d7 (sled), rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-01-09T01:30:38.245ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4270
1412025-01-09T01:30:38.245ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4664
1422025-01-09T01:30:38.249ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-09T01:30:38.255ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-09T01:30:38.255ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-09T01:30:38.259ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-09T01:30:38.259ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-09T01:30:38.259ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63987
1482025-01-09T01:30:38.259ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 2a5ec8ce-31e5-4982-a156-7cc817b136d7 (sled), rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-09T01:30:38.259ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-09T01:30:38.259ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-09T01:30:38.259ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-09T01:30:38.260ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-09T01:30:38.260ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-09T01:30:38.260ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-09T01:30:38.260ZINFOSledAgent (StorageManager): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-09T01:30:38.260ZINFOSledAgent (StorageManager): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-09T01:30:38.260ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-09T01:30:38.260ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-09T01:30:38.260ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-09T01:30:38.263ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-09T01:30:38.263ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-09T01:30:38.275ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-09T01:30:38.294ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-09T01:30:38.311ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-09T01:30:38.346ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
1662025-01-09T01:30:38.346ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-09T01:30:38.346ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1682025-01-09T01:30:38.346ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
1692025-01-09T01:30:38.349ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 81.393301ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9971e9d2-ca16-4f42-87e0-693872ea24cc", "content-length": "124", "date": "Thu, 09 Jan 2025 01:30:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9971e9d2-ca16-4f42-87e0-693872ea24cc" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-09T01:30:38.360ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_b26b17b4-316d-4586-8c99-78f69b3c6fa1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-09T01:30:38.384ZINFOSledAgent: successfully created encrypted zvol: name="oxi_b26b17b4-316d-4586-8c99-78f69b3c6fa1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-09T01:30:38.385ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_b26b17b4-316d-4586-8c99-78f69b3c6fa1/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-09T01:30:38.391ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
1742025-01-09T01:30:38.391ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-09T01:30:38.391ZINFOSledAgent (BackingFs): Ensuring dataset oxi_b26b17b4-316d-4586-8c99-78f69b3c6fa1/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-09T01:30:38.432ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-09T01:30:38.432ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 142.128178ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0f8f1479-361a-4778-a511-ed4cebf52583", "content-length": "124", "date": "Thu, 09 Jan 2025 01:30:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0f8f1479-361a-4778-a511-ed4cebf52583" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-09T01:30:38.457ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-09T01:30:38.576ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-09T01:30:38.576ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 112.346772ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b2fa45ad-b2bb-497d-b8be-eb0358012d12", "content-length": "124", "date": "Thu, 09 Jan 2025 01:30:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b2fa45ad-b2bb-497d-b8be-eb0358012d12" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-09T01:30:38.675ZINFOSledAgent (BackingFs): Mounting oxi_b26b17b4-316d-4586-8c99-78f69b3c6fa1/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-09T01:30:38.688ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-09T01:30:38.688ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-09T01:30:38.688ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-09T01:30:38.688ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-09T01:30:38.690ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-09T01:30:38.691ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 104.083325ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c0e552b6-cc5d-4a54-acd8-d1e648cc5e62", "content-length": "124", "date": "Thu, 09 Jan 2025 01:30:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c0e552b6-cc5d-4a54-acd8-d1e648cc5e62" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-09T01:30:38.796ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-09T01:30:38.796ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 243.762816ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f7b43f72-b0cd-4d66-9951-9f33b4bd4acf", "content-length": "124", "date": "Thu, 09 Jan 2025 01:30:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f7b43f72-b0cd-4d66-9951-9f33b4bd4acf" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-09T01:30:39.041ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-09T01:30:39.041ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 281.454616ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ab44dbc1-53f8-4450-aef5-c0f19eb2a205", "content-length": "124", "date": "Thu, 09 Jan 2025 01:30:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ab44dbc1-53f8-4450-aef5-c0f19eb2a205" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-09T01:30:39.324ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-09T01:30:39.324ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 195.836151ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "144750a9-d98e-4068-8dd4-c315e6458126", "content-length": "124", "date": "Thu, 09 Jan 2025 01:30:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "144750a9-d98e-4068-8dd4-c315e6458126" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-09T01:30:39.424ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
1952025-01-09T01:30:39.430ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:56703 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
1962025-01-09T01:30:39.430ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
1972025-01-09T01:30:39.430ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:56703 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
1982025-01-09T01:30:39.431ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 201.28481ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
1992025-01-09T01:30:39.432ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2002025-01-09T01:30:39.432ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2012025-01-09T01:30:39.432ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:932 underlay_address = fd00:1122:3344:101::1
2022025-01-09T01:30:39.432ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-09T01:30:39.521ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042025-01-09T01:30:39.633ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 717.445947ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2052025-01-09T01:30:40.352ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 920.396699ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2062025-01-09T01:30:41.275ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.162011908s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2072025-01-09T01:30:42.031ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2694
2082025-01-09T01:30:42.031ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2939
2092025-01-09T01:30:42.031ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2564
2102025-01-09T01:30:42.031ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2611
2112025-01-09T01:30:42.031ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3020
2122025-01-09T01:30:42.031ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3065
2132025-01-09T01:30:42.033ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2864
2142025-01-09T01:30:42.035ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2605
2152025-01-09T01:30:42.035ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='ec38dd42-f3d0-4950-99df-5a1ba580771a'/> <propval type="astring" name="rack_id" value='59b29299-38cc-4366-91a5-ce2131096a5f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe05:c422'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='59b29299-38cc-4366-91a5-ce2131096a5f'/> <propval type="astring" name="sled_id" value='2a5ec8ce-31e5-4982-a156-7cc817b136d7'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='2a5ec8ce-31e5-4982-a156-7cc817b136d7'/> <propval type="astring" name="rack_uuid" value='59b29299-38cc-4366-91a5-ce2131096a5f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='2a5ec8ce-31e5-4982-a156-7cc817b136d7'/> <propval type="astring" name="rack_uuid" value='59b29299-38cc-4366-91a5-ce2131096a5f'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-09T01:30:42.035ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-09T01:30:42.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 40.027199ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182025-01-09T01:30:42.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 100.090457ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192025-01-09T01:30:42.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 160.867273ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-09T01:30:42.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 325.95612ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212025-01-09T01:30:43.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 562.247653ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222025-01-09T01:30:43.439ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.33945266s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2232025-01-09T01:30:43.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.474348703s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-09T01:30:45.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 755.581679ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252025-01-09T01:30:46.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.161815577s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262025-01-09T01:30:47.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 701.594119ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272025-01-09T01:30:48.676ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/2a5ec8ce-31e5-4982-a156-7cc817b136d7) file = sled-agent/src/nexus.rs:527 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2282025-01-09T01:30:48.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292025-01-09T01:30:48.706ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2302025-01-09T01:30:48.707ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312025-01-09T01:30:48.707ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322025-01-09T01:30:48.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2332025-01-09T01:30:48.707ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-09T01:30:48.708ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-01-09T01:30:48.708ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362025-01-09T01:30:48.708ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372025-01-09T01:30:48.708ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
2382025-01-09T01:30:48.708ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63987
2392025-01-09T01:30:48.938ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2402025-01-09T01:30:48.938ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2412025-01-09T01:30:48.939ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.93973986s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2422025-01-09T01:30:48.943ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4294 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2432025-01-09T01:30:49.441ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2442025-01-09T01:30:49.441ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2452025-01-09T01:30:49.667ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2462025-01-09T01:30:49.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54490
2472025-01-09T01:30:49.681ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2482025-01-09T01:30:49.681ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2492025-01-09T01:30:49.681ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:188
2502025-01-09T01:30:49.681ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:188
2512025-01-09T01:30:49.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54490 req_id = 66b9d9fc-d752-4189-a11c-d5dbf44a1009 response_code = 200 uri = /inventory
2522025-01-09T01:30:49.694ZINFOSledAgent (ServiceManager): refreshed zone-network-setup service with new configuration file = sled-agent/src/services.rs:4343
2532025-01-09T01:30:49.694ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4401
2542025-01-09T01:30:49.709ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7) file = sled-agent/src/probe_manager.rs:231 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2552025-01-09T01:30:49.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55318
2562025-01-09T01:30:49.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55318 req_id = c4750c8d-8aa7-4ad3-b2ca-21612d40a666 response_code = 200 uri = /sled-role
2572025-01-09T01:30:49.774ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: ae0cad89-c3d7-4b81-b094-ae8491dc121a (physical_disk), pool_id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 76b85a29-1988-4eec-b8a0-f8432185450f (physical_disk), pool_id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 8b6d7ccc-728e-4b38-a922-342a16e0d48a (physical_disk), pool_id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 8428bca5-d392-4d7a-8f42-5389efcf225d (physical_disk), pool_id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: a1745759-c980-40c5-a6ce-609b3c991135 (physical_disk), pool_id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 1c7424f1-399f-4aa9-bc07-f5b6b4d87e54 (physical_disk), pool_id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d484de8e-9dd6-4827-a622-18e5eb81743a (physical_disk), pool_id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 43e08963-e6b1-4836-8484-d382a394df2d (physical_disk), pool_id: 629544c0-27f4-4020-b514-332802874b60 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9c4070d5-f432-4c6b-b099-ca3dce4890f6 (physical_disk), pool_id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2582025-01-09T01:30:49.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56206
2592025-01-09T01:30:49.775ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
2602025-01-09T01:30:49.775ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: ae0cad89-c3d7-4b81-b094-ae8491dc121a (physical_disk), pool_id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 76b85a29-1988-4eec-b8a0-f8432185450f (physical_disk), pool_id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 8b6d7ccc-728e-4b38-a922-342a16e0d48a (physical_disk), pool_id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 8428bca5-d392-4d7a-8f42-5389efcf225d (physical_disk), pool_id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: a1745759-c980-40c5-a6ce-609b3c991135 (physical_disk), pool_id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 1c7424f1-399f-4aa9-bc07-f5b6b4d87e54 (physical_disk), pool_id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d484de8e-9dd6-4827-a622-18e5eb81743a (physical_disk), pool_id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 43e08963-e6b1-4836-8484-d382a394df2d (physical_disk), pool_id: 629544c0-27f4-4020-b514-332802874b60 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9c4070d5-f432-4c6b-b099-ca3dce4890f6 (physical_disk), pool_id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2612025-01-09T01:30:49.775ZINFOSledAgent (StorageManager): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2622025-01-09T01:30:49.775ZINFOSledAgent (StorageManager): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2632025-01-09T01:30:49.775ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2642025-01-09T01:30:49.775ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2652025-01-09T01:30:49.775ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2662025-01-09T01:30:49.775ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2672025-01-09T01:30:49.775ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2682025-01-09T01:30:49.786ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2692025-01-09T01:30:49.786ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool)
2702025-01-09T01:30:49.835ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4467
2712025-01-09T01:30:49.835ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4494
2722025-01-09T01:30:49.875ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4507
2732025-01-09T01:30:49.875ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4353
2742025-01-09T01:30:49.893ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }
2752025-01-09T01:30:49.902ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2762025-01-09T01:30:49.902ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2772025-01-09T01:30:49.902ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2782025-01-09T01:30:49.902ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2792025-01-09T01:30:49.902ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2802025-01-09T01:30:49.902ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2812025-01-09T01:30:49.902ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2822025-01-09T01:30:49.939ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2832025-01-09T01:30:49.948ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone file = sled-storage/src/dataset.rs:302
2842025-01-09T01:30:50.083ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1 file = sled-storage/src/dataset.rs:388
2852025-01-09T01:30:50.091ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2862025-01-09T01:30:50.091ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2872025-01-09T01:30:50.091ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2882025-01-09T01:30:50.091ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2892025-01-09T01:30:50.091ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2902025-01-09T01:30:50.100ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2912025-01-09T01:30:50.100ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool)
2922025-01-09T01:30:50.193ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }
2932025-01-09T01:30:50.201ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2942025-01-09T01:30:50.201ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2952025-01-09T01:30:50.201ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2962025-01-09T01:30:50.201ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2972025-01-09T01:30:50.201ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2982025-01-09T01:30:50.202ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2992025-01-09T01:30:50.202ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3002025-01-09T01:30:50.237ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3012025-01-09T01:30:50.244ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone file = sled-storage/src/dataset.rs:302
3022025-01-09T01:30:50.382ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86 file = sled-storage/src/dataset.rs:388
3032025-01-09T01:30:50.390ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3042025-01-09T01:30:50.390ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3052025-01-09T01:30:50.390ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3062025-01-09T01:30:50.390ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3072025-01-09T01:30:50.390ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3082025-01-09T01:30:50.400ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3092025-01-09T01:30:50.400ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool)
3102025-01-09T01:30:50.490ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }
3112025-01-09T01:30:50.498ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3122025-01-09T01:30:50.498ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3132025-01-09T01:30:50.498ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3142025-01-09T01:30:50.498ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3152025-01-09T01:30:50.498ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3162025-01-09T01:30:50.498ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3172025-01-09T01:30:50.498ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3182025-01-09T01:30:50.533ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3192025-01-09T01:30:50.542ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone file = sled-storage/src/dataset.rs:302
3202025-01-09T01:30:50.682ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2 file = sled-storage/src/dataset.rs:388
3212025-01-09T01:30:50.690ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3222025-01-09T01:30:50.691ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3232025-01-09T01:30:50.691ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3242025-01-09T01:30:50.691ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3252025-01-09T01:30:50.691ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3262025-01-09T01:30:50.700ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3272025-01-09T01:30:50.700ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool)
3282025-01-09T01:30:50.798ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }
3292025-01-09T01:30:50.806ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3302025-01-09T01:30:50.806ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3312025-01-09T01:30:50.806ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3322025-01-09T01:30:50.806ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3332025-01-09T01:30:50.806ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3342025-01-09T01:30:50.806ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3352025-01-09T01:30:50.806ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3362025-01-09T01:30:50.810ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7) file = sled-agent/src/probe_manager.rs:231 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
3372025-01-09T01:30:50.841ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3382025-01-09T01:30:50.848ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/zone file = sled-storage/src/dataset.rs:302
3392025-01-09T01:30:50.982ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf file = sled-storage/src/dataset.rs:388
3402025-01-09T01:30:50.990ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3412025-01-09T01:30:50.990ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3422025-01-09T01:30:50.990ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3432025-01-09T01:30:50.990ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3442025-01-09T01:30:50.990ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3452025-01-09T01:30:51.001ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3462025-01-09T01:30:51.001ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6ff08246-782d-4058-9e5f-ff095db6560c (zpool)
3472025-01-09T01:30:51.094ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }
3482025-01-09T01:30:51.102ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3492025-01-09T01:30:51.102ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3502025-01-09T01:30:51.102ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3512025-01-09T01:30:51.102ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3522025-01-09T01:30:51.102ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3532025-01-09T01:30:51.102ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3542025-01-09T01:30:51.102ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3552025-01-09T01:30:51.140ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3562025-01-09T01:30:51.148ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6ff08246-782d-4058-9e5f-ff095db6560c/crypt/zone file = sled-storage/src/dataset.rs:302
3572025-01-09T01:30:51.285ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6ff08246-782d-4058-9e5f-ff095db6560c file = sled-storage/src/dataset.rs:388
3582025-01-09T01:30:51.293ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3592025-01-09T01:30:51.293ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3602025-01-09T01:30:51.293ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3612025-01-09T01:30:51.293ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3622025-01-09T01:30:51.293ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3632025-01-09T01:30:51.303ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3642025-01-09T01:30:51.303ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool)
3652025-01-09T01:30:51.395ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }
3662025-01-09T01:30:51.403ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3672025-01-09T01:30:51.403ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3682025-01-09T01:30:51.403ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3692025-01-09T01:30:51.404ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3702025-01-09T01:30:51.404ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3712025-01-09T01:30:51.404ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3722025-01-09T01:30:51.404ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3732025-01-09T01:30:51.438ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3742025-01-09T01:30:51.446ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crypt/zone file = sled-storage/src/dataset.rs:302
3752025-01-09T01:30:51.590ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 file = sled-storage/src/dataset.rs:388
3762025-01-09T01:30:51.598ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3772025-01-09T01:30:51.598ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3782025-01-09T01:30:51.598ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3792025-01-09T01:30:51.598ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3802025-01-09T01:30:51.598ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3812025-01-09T01:30:51.608ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3822025-01-09T01:30:51.608ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a5da334f-19cb-4d72-b915-499edbcccd72 (zpool)
3832025-01-09T01:30:51.704ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }
3842025-01-09T01:30:51.712ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3852025-01-09T01:30:51.712ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3862025-01-09T01:30:51.712ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3872025-01-09T01:30:51.712ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3882025-01-09T01:30:51.712ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3892025-01-09T01:30:51.712ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3902025-01-09T01:30:51.712ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3912025-01-09T01:30:51.748ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3922025-01-09T01:30:51.756ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a5da334f-19cb-4d72-b915-499edbcccd72/crypt/zone file = sled-storage/src/dataset.rs:302
3932025-01-09T01:30:51.812ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7) file = sled-agent/src/probe_manager.rs:231 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
3942025-01-09T01:30:51.891ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a5da334f-19cb-4d72-b915-499edbcccd72 file = sled-storage/src/dataset.rs:388
3952025-01-09T01:30:51.899ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3962025-01-09T01:30:51.899ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3972025-01-09T01:30:51.899ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3982025-01-09T01:30:51.899ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3992025-01-09T01:30:51.899ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4002025-01-09T01:30:51.909ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4012025-01-09T01:30:51.909ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 629544c0-27f4-4020-b514-332802874b60 (zpool)
4022025-01-09T01:30:51.937ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4395
4032025-01-09T01:30:51.938ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4474 rack_subnet = fd00:1122:3344::
4042025-01-09T01:30:52.007ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }
4052025-01-09T01:30:52.015ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4062025-01-09T01:30:52.015ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4072025-01-09T01:30:52.015ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4082025-01-09T01:30:52.015ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4092025-01-09T01:30:52.015ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4102025-01-09T01:30:52.015ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4112025-01-09T01:30:52.015ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4122025-01-09T01:30:52.050ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4132025-01-09T01:30:52.057ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_629544c0-27f4-4020-b514-332802874b60/crypt/zone file = sled-storage/src/dataset.rs:302
4142025-01-09T01:30:52.193ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_629544c0-27f4-4020-b514-332802874b60 file = sled-storage/src/dataset.rs:388
4152025-01-09T01:30:52.201ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4162025-01-09T01:30:52.201ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4172025-01-09T01:30:52.201ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4182025-01-09T01:30:52.201ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4192025-01-09T01:30:52.201ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4202025-01-09T01:30:52.212ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4212025-01-09T01:30:52.212ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool)
4222025-01-09T01:30:52.307ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }
4232025-01-09T01:30:52.314ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4242025-01-09T01:30:52.314ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4252025-01-09T01:30:52.314ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4262025-01-09T01:30:52.314ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4272025-01-09T01:30:52.314ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4282025-01-09T01:30:52.314ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4292025-01-09T01:30:52.314ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4302025-01-09T01:30:52.363ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4312025-01-09T01:30:52.373ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/zone file = sled-storage/src/dataset.rs:302
4322025-01-09T01:30:52.514ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 file = sled-storage/src/dataset.rs:388
4332025-01-09T01:30:52.522ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4342025-01-09T01:30:52.522ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4352025-01-09T01:30:52.522ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4362025-01-09T01:30:52.522ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b26b17b4-316d-4586-8c99-78f69b3c6fa1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0fd3c3fa-6a57-4068-95d9-59f288374d68 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4372025-01-09T01:30:52.522ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4382025-01-09T01:30:52.522ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4392025-01-09T01:30:52.522ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4402025-01-09T01:30:52.523ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
4412025-01-09T01:30:52.523ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4422025-01-09T01:30:52.523ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
4432025-01-09T01:30:52.523ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
4442025-01-09T01:30:52.523ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
4452025-01-09T01:30:52.523ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
4462025-01-09T01:30:52.523ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
4472025-01-09T01:30:52.523ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4482025-01-09T01:30:52.523ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
4492025-01-09T01:30:52.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2748399 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56206 req_id = 1a144083-a5d4-4a55-b46c-69af686375d9 response_code = 200 uri = /omicron-physical-disks
4502025-01-09T01:30:52.554ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {117a58e9-1a9f-416c-8870-52a36c1654c9 (dataset): DatasetConfig { id: 117a58e9-1a9f-416c-8870-52a36c1654c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14cf9b65-598c-444b-bd6d-601ea33ac793 (dataset): DatasetConfig { id: 14cf9b65-598c-444b-bd6d-601ea33ac793 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15ff782e-7168-4681-b987-07d15aa2c3f6 (dataset): DatasetConfig { id: 15ff782e-7168-4681-b987-07d15aa2c3f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ad7873c-4530-4d19-a004-d612167812c2 (dataset): DatasetConfig { id: 1ad7873c-4530-4d19-a004-d612167812c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 20646734-16cd-4e66-813c-e700313d77f2 (dataset): DatasetConfig { id: 20646734-16cd-4e66-813c-e700313d77f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2629e29c-3ae9-4962-9eea-5bf50d8a6333 (dataset): DatasetConfig { id: 2629e29c-3ae9-4962-9eea-5bf50d8a6333 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26c04133-4dc7-4bd4-8e17-fd8ca3da0066 (dataset): DatasetConfig { id: 26c04133-4dc7-4bd4-8e17-fd8ca3da0066 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 279d756a-3af7-4b3f-abf2-ad0db3ae14be (dataset): DatasetConfig { id: 279d756a-3af7-4b3f-abf2-ad0db3ae14be (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b11a9e2-928b-4466-873b-47847a11a18d (dataset): DatasetConfig { id: 2b11a9e2-928b-4466-873b-47847a11a18d (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d8f9c9c-f8da-4ed1-bebf-78ea4b958687 (dataset): DatasetConfig { id: 2d8f9c9c-f8da-4ed1-bebf-78ea4b958687 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ec55c84-bffc-4cd6-9958-24aaa743b971 (dataset): DatasetConfig { id: 2ec55c84-bffc-4cd6-9958-24aaa743b971 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 323f32fc-0ca0-4558-ac1b-2b32c43fec8e (dataset): DatasetConfig { id: 323f32fc-0ca0-4558-ac1b-2b32c43fec8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39daae4e-bacc-4714-8f21-aa0307071427 (dataset): DatasetConfig { id: 39daae4e-bacc-4714-8f21-aa0307071427 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3dcddcc7-e451-4af6-b17f-56bbb363e80e (dataset): DatasetConfig { id: 3dcddcc7-e451-4af6-b17f-56bbb363e80e (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3fc70f6b-d8bf-4444-98e3-20306b26ac5c (dataset): DatasetConfig { id: 3fc70f6b-d8bf-4444-98e3-20306b26ac5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 404c5799-07d6-4e7d-bcbf-24292e57d206 (dataset): DatasetConfig { id: 404c5799-07d6-4e7d-bcbf-24292e57d206 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 435293ed-0db6-4a3f-bad2-7377bbae0582 (dataset): DatasetConfig { id: 435293ed-0db6-4a3f-bad2-7377bbae0582 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4397025c-ca78-42cf-af4e-1adff55b77ff (dataset): DatasetConfig { id: 4397025c-ca78-42cf-af4e-1adff55b77ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 475c629d-e779-4425-bebf-2ce89f753ff6 (dataset): DatasetConfig { id: 475c629d-e779-4425-bebf-2ce89f753ff6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 479762b5-8492-406d-b40c-b228f68d9572 (dataset): DatasetConfig { id: 479762b5-8492-406d-b40c-b228f68d9572 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49ee03af-b0ae-4912-ad36-90760c926345 (dataset): DatasetConfig { id: 49ee03af-b0ae-4912-ad36-90760c926345 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e9706cd-ddb5-4e5a-b027-881c1401a259 (dataset): DatasetConfig { id: 4e9706cd-ddb5-4e5a-b027-881c1401a259 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ff5bb5a-8651-4aaa-8751-240d45d561c4 (dataset): DatasetConfig { id: 4ff5bb5a-8651-4aaa-8751-240d45d561c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51cf25ab-5be1-448c-b838-afbc0613a369 (dataset): DatasetConfig { id: 51cf25ab-5be1-448c-b838-afbc0613a369 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 553dc4dc-b4c7-4256-a39b-e76bc0d4d4b7 (dataset): DatasetConfig { id: 553dc4dc-b4c7-4256-a39b-e76bc0d4d4b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 584f7234-4ab9-45e8-ace3-1d200552f056 (dataset): DatasetConfig { id: 584f7234-4ab9-45e8-ace3-1d200552f056 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f76f9df-282b-42b0-aecc-7381a2aa9f01 (dataset): DatasetConfig { id: 5f76f9df-282b-42b0-aecc-7381a2aa9f01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60ba0aee-f660-4e6c-849d-5e731e2475f2 (dataset): DatasetConfig { id: 60ba0aee-f660-4e6c-849d-5e731e2475f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60be5a8a-ac34-4ae4-8480-fea819221786 (dataset): DatasetConfig { id: 60be5a8a-ac34-4ae4-8480-fea819221786 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63b7907b-b63f-4c82-bceb-a00c19de4f98 (dataset): DatasetConfig { id: 63b7907b-b63f-4c82-bceb-a00c19de4f98 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 647a5607-d497-476c-b47b-25732e0dabfc (dataset): DatasetConfig { id: 647a5607-d497-476c-b47b-25732e0dabfc (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 654c0dbb-421b-49ed-90c9-4973c7983d13 (dataset): DatasetConfig { id: 654c0dbb-421b-49ed-90c9-4973c7983d13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6763f8d2-a327-4a58-ae1f-4057b209bf85 (dataset): DatasetConfig { id: 6763f8d2-a327-4a58-ae1f-4057b209bf85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d11abc9-c347-4787-910b-bb9c1843768d (dataset): DatasetConfig { id: 6d11abc9-c347-4787-910b-bb9c1843768d (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70fd8b7d-cd4d-4ecb-b247-1c61a2b67c90 (dataset): DatasetConfig { id: 70fd8b7d-cd4d-4ecb-b247-1c61a2b67c90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 821a6599-b746-4f2e-86a5-32e36c3465a7 (dataset): DatasetConfig { id: 821a6599-b746-4f2e-86a5-32e36c3465a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 842a6cfa-e9ad-4d7f-a39e-09904d622969 (dataset): DatasetConfig { id: 842a6cfa-e9ad-4d7f-a39e-09904d622969 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ce7abe2-3420-4595-b7b1-c367771b4ee0 (dataset): DatasetConfig { id: 8ce7abe2-3420-4595-b7b1-c367771b4ee0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fc31126-603a-4ce8-af57-d2a79f4d2c64 (dataset): DatasetConfig { id: 8fc31126-603a-4ce8-af57-d2a79f4d2c64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 907cf10f-d49a-466f-bb92-92685c297b94 (dataset): DatasetConfig { id: 907cf10f-d49a-466f-bb92-92685c297b94 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7f673996-71f3-460d-8744-05523682c460" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93bcfe6d-b224-47d9-aa32-0c9592825540 (dataset): DatasetConfig { id: 93bcfe6d-b224-47d9-aa32-0c9592825540 (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c48c30-3766-47fa-8ee9-67760b216b18 (dataset): DatasetConfig { id: 95c48c30-3766-47fa-8ee9-67760b216b18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98e175a8-b9c7-4e2a-a9c3-fc061e9ba232 (dataset): DatasetConfig { id: 98e175a8-b9c7-4e2a-a9c3-fc061e9ba232 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99744f69-5799-4ae7-ab92-89a139a93c90 (dataset): DatasetConfig { id: 99744f69-5799-4ae7-ab92-89a139a93c90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99e73b15-8005-4fc6-8f54-9e49234a041f (dataset): DatasetConfig { id: 99e73b15-8005-4fc6-8f54-9e49234a041f (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ab30b7a-2ba8-4d9e-ae8c-8c4134f9bd9c (dataset): DatasetConfig { id: 9ab30b7a-2ba8-4d9e-ae8c-8c4134f9bd9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c230e4f-b40f-4a83-96fd-0d28c4543b11 (dataset): DatasetConfig { id: 9c230e4f-b40f-4a83-96fd-0d28c4543b11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a69e5ef6-5950-45cb-8e55-d7826e4de298 (dataset): DatasetConfig { id: a69e5ef6-5950-45cb-8e55-d7826e4de298 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ac38da6f-d4d7-4ebc-a72e-afc4f8765f90 (dataset): DatasetConfig { id: ac38da6f-d4d7-4ebc-a72e-afc4f8765f90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, afc46ab3-4d84-4b6a-95a4-601dc40956df (dataset): DatasetConfig { id: afc46ab3-4d84-4b6a-95a4-601dc40956df (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afc87388-564e-4689-99ea-8f1b8c460a2c (dataset): DatasetConfig { id: afc87388-564e-4689-99ea-8f1b8c460a2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9439599-6eff-4473-b5ac-b99c83ad80c3 (dataset): DatasetConfig { id: b9439599-6eff-4473-b5ac-b99c83ad80c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9ccb748-89f6-42a7-bcd7-46b6bd508e40 (dataset): DatasetConfig { id: b9ccb748-89f6-42a7-bcd7-46b6bd508e40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c247755d-c039-4382-8fb6-d359b058d0e3 (dataset): DatasetConfig { id: c247755d-c039-4382-8fb6-d359b058d0e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c301aa66-cb4e-4228-b2b4-2e2831582d4f (dataset): DatasetConfig { id: c301aa66-cb4e-4228-b2b4-2e2831582d4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d23ebb20-799e-434f-8576-004beb568405 (dataset): DatasetConfig { id: d23ebb20-799e-434f-8576-004beb568405 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3fe1ed6-0681-4ba4-b604-16b819ac68e7 (dataset): DatasetConfig { id: d3fe1ed6-0681-4ba4-b604-16b819ac68e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5b08f33-80a4-46c3-9fff-cf9a73edfa48 (dataset): DatasetConfig { id: d5b08f33-80a4-46c3-9fff-cf9a73edfa48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d90d7e1e-90d4-4e23-8da5-a29da9948379 (dataset): DatasetConfig { id: d90d7e1e-90d4-4e23-8da5-a29da9948379 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc9834f3-33b3-4243-842b-c6d97baf7bc4 (dataset): DatasetConfig { id: dc9834f3-33b3-4243-842b-c6d97baf7bc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dca9b76b-c0f3-4964-9c55-6ec00637fc62 (dataset): DatasetConfig { id: dca9b76b-c0f3-4964-9c55-6ec00637fc62 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dd40b5bb-7f1b-4f79-a794-ce6bf1ac52c1 (dataset): DatasetConfig { id: dd40b5bb-7f1b-4f79-a794-ce6bf1ac52c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2c9aadc-7689-4e9f-9022-b7112066b452 (dataset): DatasetConfig { id: e2c9aadc-7689-4e9f-9022-b7112066b452 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e51754ba-87c9-45b2-b74a-ac84d4172d73 (dataset): DatasetConfig { id: e51754ba-87c9-45b2-b74a-ac84d4172d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97cf080-6a63-45b3-a037-0f5cc864a918 (dataset): DatasetConfig { id: e97cf080-6a63-45b3-a037-0f5cc864a918 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec2d8297-aa06-48a9-a458-0d6b880e3fd7 (dataset): DatasetConfig { id: ec2d8297-aa06-48a9-a458-0d6b880e3fd7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4512025-01-09T01:30:52.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52609
4522025-01-09T01:30:52.555ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
4532025-01-09T01:30:52.555ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {117a58e9-1a9f-416c-8870-52a36c1654c9 (dataset): DatasetConfig { id: 117a58e9-1a9f-416c-8870-52a36c1654c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14cf9b65-598c-444b-bd6d-601ea33ac793 (dataset): DatasetConfig { id: 14cf9b65-598c-444b-bd6d-601ea33ac793 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15ff782e-7168-4681-b987-07d15aa2c3f6 (dataset): DatasetConfig { id: 15ff782e-7168-4681-b987-07d15aa2c3f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ad7873c-4530-4d19-a004-d612167812c2 (dataset): DatasetConfig { id: 1ad7873c-4530-4d19-a004-d612167812c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 20646734-16cd-4e66-813c-e700313d77f2 (dataset): DatasetConfig { id: 20646734-16cd-4e66-813c-e700313d77f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2629e29c-3ae9-4962-9eea-5bf50d8a6333 (dataset): DatasetConfig { id: 2629e29c-3ae9-4962-9eea-5bf50d8a6333 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26c04133-4dc7-4bd4-8e17-fd8ca3da0066 (dataset): DatasetConfig { id: 26c04133-4dc7-4bd4-8e17-fd8ca3da0066 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 279d756a-3af7-4b3f-abf2-ad0db3ae14be (dataset): DatasetConfig { id: 279d756a-3af7-4b3f-abf2-ad0db3ae14be (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b11a9e2-928b-4466-873b-47847a11a18d (dataset): DatasetConfig { id: 2b11a9e2-928b-4466-873b-47847a11a18d (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d8f9c9c-f8da-4ed1-bebf-78ea4b958687 (dataset): DatasetConfig { id: 2d8f9c9c-f8da-4ed1-bebf-78ea4b958687 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ec55c84-bffc-4cd6-9958-24aaa743b971 (dataset): DatasetConfig { id: 2ec55c84-bffc-4cd6-9958-24aaa743b971 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 323f32fc-0ca0-4558-ac1b-2b32c43fec8e (dataset): DatasetConfig { id: 323f32fc-0ca0-4558-ac1b-2b32c43fec8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39daae4e-bacc-4714-8f21-aa0307071427 (dataset): DatasetConfig { id: 39daae4e-bacc-4714-8f21-aa0307071427 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3dcddcc7-e451-4af6-b17f-56bbb363e80e (dataset): DatasetConfig { id: 3dcddcc7-e451-4af6-b17f-56bbb363e80e (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3fc70f6b-d8bf-4444-98e3-20306b26ac5c (dataset): DatasetConfig { id: 3fc70f6b-d8bf-4444-98e3-20306b26ac5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 404c5799-07d6-4e7d-bcbf-24292e57d206 (dataset): DatasetConfig { id: 404c5799-07d6-4e7d-bcbf-24292e57d206 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 435293ed-0db6-4a3f-bad2-7377bbae0582 (dataset): DatasetConfig { id: 435293ed-0db6-4a3f-bad2-7377bbae0582 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4397025c-ca78-42cf-af4e-1adff55b77ff (dataset): DatasetConfig { id: 4397025c-ca78-42cf-af4e-1adff55b77ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 475c629d-e779-4425-bebf-2ce89f753ff6 (dataset): DatasetConfig { id: 475c629d-e779-4425-bebf-2ce89f753ff6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 479762b5-8492-406d-b40c-b228f68d9572 (dataset): DatasetConfig { id: 479762b5-8492-406d-b40c-b228f68d9572 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49ee03af-b0ae-4912-ad36-90760c926345 (dataset): DatasetConfig { id: 49ee03af-b0ae-4912-ad36-90760c926345 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e9706cd-ddb5-4e5a-b027-881c1401a259 (dataset): DatasetConfig { id: 4e9706cd-ddb5-4e5a-b027-881c1401a259 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ff5bb5a-8651-4aaa-8751-240d45d561c4 (dataset): DatasetConfig { id: 4ff5bb5a-8651-4aaa-8751-240d45d561c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51cf25ab-5be1-448c-b838-afbc0613a369 (dataset): DatasetConfig { id: 51cf25ab-5be1-448c-b838-afbc0613a369 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 553dc4dc-b4c7-4256-a39b-e76bc0d4d4b7 (dataset): DatasetConfig { id: 553dc4dc-b4c7-4256-a39b-e76bc0d4d4b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 584f7234-4ab9-45e8-ace3-1d200552f056 (dataset): DatasetConfig { id: 584f7234-4ab9-45e8-ace3-1d200552f056 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f76f9df-282b-42b0-aecc-7381a2aa9f01 (dataset): DatasetConfig { id: 5f76f9df-282b-42b0-aecc-7381a2aa9f01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60ba0aee-f660-4e6c-849d-5e731e2475f2 (dataset): DatasetConfig { id: 60ba0aee-f660-4e6c-849d-5e731e2475f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60be5a8a-ac34-4ae4-8480-fea819221786 (dataset): DatasetConfig { id: 60be5a8a-ac34-4ae4-8480-fea819221786 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63b7907b-b63f-4c82-bceb-a00c19de4f98 (dataset): DatasetConfig { id: 63b7907b-b63f-4c82-bceb-a00c19de4f98 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 647a5607-d497-476c-b47b-25732e0dabfc (dataset): DatasetConfig { id: 647a5607-d497-476c-b47b-25732e0dabfc (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 654c0dbb-421b-49ed-90c9-4973c7983d13 (dataset): DatasetConfig { id: 654c0dbb-421b-49ed-90c9-4973c7983d13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6763f8d2-a327-4a58-ae1f-4057b209bf85 (dataset): DatasetConfig { id: 6763f8d2-a327-4a58-ae1f-4057b209bf85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d11abc9-c347-4787-910b-bb9c1843768d (dataset): DatasetConfig { id: 6d11abc9-c347-4787-910b-bb9c1843768d (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70fd8b7d-cd4d-4ecb-b247-1c61a2b67c90 (dataset): DatasetConfig { id: 70fd8b7d-cd4d-4ecb-b247-1c61a2b67c90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 821a6599-b746-4f2e-86a5-32e36c3465a7 (dataset): DatasetConfig { id: 821a6599-b746-4f2e-86a5-32e36c3465a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 842a6cfa-e9ad-4d7f-a39e-09904d622969 (dataset): DatasetConfig { id: 842a6cfa-e9ad-4d7f-a39e-09904d622969 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ce7abe2-3420-4595-b7b1-c367771b4ee0 (dataset): DatasetConfig { id: 8ce7abe2-3420-4595-b7b1-c367771b4ee0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fc31126-603a-4ce8-af57-d2a79f4d2c64 (dataset): DatasetConfig { id: 8fc31126-603a-4ce8-af57-d2a79f4d2c64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 907cf10f-d49a-466f-bb92-92685c297b94 (dataset): DatasetConfig { id: 907cf10f-d49a-466f-bb92-92685c297b94 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7f673996-71f3-460d-8744-05523682c460" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93bcfe6d-b224-47d9-aa32-0c9592825540 (dataset): DatasetConfig { id: 93bcfe6d-b224-47d9-aa32-0c9592825540 (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95c48c30-3766-47fa-8ee9-67760b216b18 (dataset): DatasetConfig { id: 95c48c30-3766-47fa-8ee9-67760b216b18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98e175a8-b9c7-4e2a-a9c3-fc061e9ba232 (dataset): DatasetConfig { id: 98e175a8-b9c7-4e2a-a9c3-fc061e9ba232 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99744f69-5799-4ae7-ab92-89a139a93c90 (dataset): DatasetConfig { id: 99744f69-5799-4ae7-ab92-89a139a93c90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99e73b15-8005-4fc6-8f54-9e49234a041f (dataset): DatasetConfig { id: 99e73b15-8005-4fc6-8f54-9e49234a041f (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ab30b7a-2ba8-4d9e-ae8c-8c4134f9bd9c (dataset): DatasetConfig { id: 9ab30b7a-2ba8-4d9e-ae8c-8c4134f9bd9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c230e4f-b40f-4a83-96fd-0d28c4543b11 (dataset): DatasetConfig { id: 9c230e4f-b40f-4a83-96fd-0d28c4543b11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a69e5ef6-5950-45cb-8e55-d7826e4de298 (dataset): DatasetConfig { id: a69e5ef6-5950-45cb-8e55-d7826e4de298 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ac38da6f-d4d7-4ebc-a72e-afc4f8765f90 (dataset): DatasetConfig { id: ac38da6f-d4d7-4ebc-a72e-afc4f8765f90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, afc46ab3-4d84-4b6a-95a4-601dc40956df (dataset): DatasetConfig { id: afc46ab3-4d84-4b6a-95a4-601dc40956df (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afc87388-564e-4689-99ea-8f1b8c460a2c (dataset): DatasetConfig { id: afc87388-564e-4689-99ea-8f1b8c460a2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9439599-6eff-4473-b5ac-b99c83ad80c3 (dataset): DatasetConfig { id: b9439599-6eff-4473-b5ac-b99c83ad80c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9ccb748-89f6-42a7-bcd7-46b6bd508e40 (dataset): DatasetConfig { id: b9ccb748-89f6-42a7-bcd7-46b6bd508e40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c247755d-c039-4382-8fb6-d359b058d0e3 (dataset): DatasetConfig { id: c247755d-c039-4382-8fb6-d359b058d0e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c301aa66-cb4e-4228-b2b4-2e2831582d4f (dataset): DatasetConfig { id: c301aa66-cb4e-4228-b2b4-2e2831582d4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d23ebb20-799e-434f-8576-004beb568405 (dataset): DatasetConfig { id: d23ebb20-799e-434f-8576-004beb568405 (dataset), name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3fe1ed6-0681-4ba4-b604-16b819ac68e7 (dataset): DatasetConfig { id: d3fe1ed6-0681-4ba4-b604-16b819ac68e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5b08f33-80a4-46c3-9fff-cf9a73edfa48 (dataset): DatasetConfig { id: d5b08f33-80a4-46c3-9fff-cf9a73edfa48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d90d7e1e-90d4-4e23-8da5-a29da9948379 (dataset): DatasetConfig { id: d90d7e1e-90d4-4e23-8da5-a29da9948379 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc9834f3-33b3-4243-842b-c6d97baf7bc4 (dataset): DatasetConfig { id: dc9834f3-33b3-4243-842b-c6d97baf7bc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dca9b76b-c0f3-4964-9c55-6ec00637fc62 (dataset): DatasetConfig { id: dca9b76b-c0f3-4964-9c55-6ec00637fc62 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dd40b5bb-7f1b-4f79-a794-ce6bf1ac52c1 (dataset): DatasetConfig { id: dd40b5bb-7f1b-4f79-a794-ce6bf1ac52c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2c9aadc-7689-4e9f-9022-b7112066b452 (dataset): DatasetConfig { id: e2c9aadc-7689-4e9f-9022-b7112066b452 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e51754ba-87c9-45b2-b74a-ac84d4172d73 (dataset): DatasetConfig { id: e51754ba-87c9-45b2-b74a-ac84d4172d73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e97cf080-6a63-45b3-a037-0f5cc864a918 (dataset): DatasetConfig { id: e97cf080-6a63-45b3-a037-0f5cc864a918 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec2d8297-aa06-48a9-a458-0d6b880e3fd7 (dataset): DatasetConfig { id: ec2d8297-aa06-48a9-a458-0d6b880e3fd7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4542025-01-09T01:30:52.555ZINFOSledAgent (StorageManager): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4552025-01-09T01:30:52.555ZINFOSledAgent (StorageManager): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4562025-01-09T01:30:52.555ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4572025-01-09T01:30:52.570ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-01-09T01:30:52.570ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592025-01-09T01:30:52.570ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf/crucible" } file = sled-storage/src/manager.rs:1431
4602025-01-09T01:30:52.617ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-01-09T01:30:52.617ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4622025-01-09T01:30:52.617ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crucible" } file = sled-storage/src/manager.rs:1431
4632025-01-09T01:30:52.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-01-09T01:30:52.664ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652025-01-09T01:30:52.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4662025-01-09T01:30:52.710ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672025-01-09T01:30:52.710ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4682025-01-09T01:30:52.710ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/debug"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/debug" } file = sled-storage/src/manager.rs:1431
4692025-01-09T01:30:52.738ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702025-01-09T01:30:52.738ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712025-01-09T01:30:52.738ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/zone/oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a"), full_name: "oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/zone/oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a" } file = sled-storage/src/manager.rs:1431
4722025-01-09T01:30:52.795ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732025-01-09T01:30:52.795ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4742025-01-09T01:30:52.795ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/zone/oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050"), full_name: "oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/zone/oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050" } file = sled-storage/src/manager.rs:1431
4752025-01-09T01:30:52.814ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7) file = sled-agent/src/probe_manager.rs:231 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
4762025-01-09T01:30:52.852ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-09T01:30:52.852ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-01-09T01:30:52.852ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/zone/oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1"), full_name: "oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/zone/oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1" } file = sled-storage/src/manager.rs:1431
4792025-01-09T01:30:52.910ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-01-09T01:30:52.910ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-01-09T01:30:52.910ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/629544c0-27f4-4020-b514-332802874b60/crypt/zone/oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be"), full_name: "oxp_629544c0-27f4-4020-b514-332802874b60/crypt/zone/oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be" } file = sled-storage/src/manager.rs:1431
4822025-01-09T01:30:52.968ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-01-09T01:30:52.968ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842025-01-09T01:30:52.968ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone/oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb"), full_name: "oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone/oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb" } file = sled-storage/src/manager.rs:1431
4852025-01-09T01:30:53.028ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-01-09T01:30:53.028ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872025-01-09T01:30:53.028ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4882025-01-09T01:30:53.076ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-01-09T01:30:53.076ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902025-01-09T01:30:53.076ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crucible" } file = sled-storage/src/manager.rs:1431
4912025-01-09T01:30:53.122ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-01-09T01:30:53.122ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4932025-01-09T01:30:53.122ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crypt/zone"), full_name: "oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crypt/zone" } file = sled-storage/src/manager.rs:1431
4942025-01-09T01:30:53.149ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-01-09T01:30:53.149ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-01-09T01:30:53.149ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22" } file = sled-storage/src/manager.rs:1431
4972025-01-09T01:30:53.206ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-01-09T01:30:53.206ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4992025-01-09T01:30:53.206ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5da334f-19cb-4d72-b915-499edbcccd72/crypt/debug"), full_name: "oxp_a5da334f-19cb-4d72-b915-499edbcccd72/crypt/debug" } file = sled-storage/src/manager.rs:1431
5002025-01-09T01:30:53.234ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-01-09T01:30:53.234ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022025-01-09T01:30:53.234ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5032025-01-09T01:30:53.279ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-01-09T01:30:53.279ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052025-01-09T01:30:53.279ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone/oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone/oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc" } file = sled-storage/src/manager.rs:1431
5062025-01-09T01:30:53.337ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-01-09T01:30:53.337ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5082025-01-09T01:30:53.337ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/debug"), full_name: "oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/debug" } file = sled-storage/src/manager.rs:1431
5092025-01-09T01:30:53.365ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-01-09T01:30:53.366ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-01-09T01:30:53.366ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone/oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f"), full_name: "oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone/oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f" } file = sled-storage/src/manager.rs:1431
5122025-01-09T01:30:53.424ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-01-09T01:30:53.424ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142025-01-09T01:30:53.424ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6ff08246-782d-4058-9e5f-ff095db6560c/crucible" } file = sled-storage/src/manager.rs:1431
5152025-01-09T01:30:53.472ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-01-09T01:30:53.472ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5172025-01-09T01:30:53.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone" } file = sled-storage/src/manager.rs:1431
5182025-01-09T01:30:53.501ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-01-09T01:30:53.501ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-01-09T01:30:53.501ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5da334f-19cb-4d72-b915-499edbcccd72/crypt/zone/oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346"), full_name: "oxp_a5da334f-19cb-4d72-b915-499edbcccd72/crypt/zone/oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346" } file = sled-storage/src/manager.rs:1431
5212025-01-09T01:30:53.556ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-01-09T01:30:53.556ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5232025-01-09T01:30:53.556ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crucible" } file = sled-storage/src/manager.rs:1431
5242025-01-09T01:30:53.606ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-01-09T01:30:53.606ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262025-01-09T01:30:53.606ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ff08246-782d-4058-9e5f-ff095db6560c/crypt/zone/oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee"), full_name: "oxp_6ff08246-782d-4058-9e5f-ff095db6560c/crypt/zone/oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee" } file = sled-storage/src/manager.rs:1431
5272025-01-09T01:30:53.663ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282025-01-09T01:30:53.664ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292025-01-09T01:30:53.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone/oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f"), full_name: "oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone/oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f" } file = sled-storage/src/manager.rs:1431
5302025-01-09T01:30:53.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312025-01-09T01:30:53.722ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5322025-01-09T01:30:53.722ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/629544c0-27f4-4020-b514-332802874b60/crypt/zone/oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98"), full_name: "oxp_629544c0-27f4-4020-b514-332802874b60/crypt/zone/oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98" } file = sled-storage/src/manager.rs:1431
5332025-01-09T01:30:53.781ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5342025-01-09T01:30:53.781ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5352025-01-09T01:30:53.781ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5362025-01-09T01:30:53.817ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7) file = sled-agent/src/probe_manager.rs:231 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
5372025-01-09T01:30:53.827ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-09T01:30:53.827ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392025-01-09T01:30:53.827ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5402025-01-09T01:30:53.877ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-09T01:30:53.877ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-01-09T01:30:53.877ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/zone/oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a"), full_name: "oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/zone/oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a" } file = sled-storage/src/manager.rs:1431
5432025-01-09T01:30:53.938ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-01-09T01:30:53.938ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-01-09T01:30:53.938ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone/oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone/oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442" } file = sled-storage/src/manager.rs:1431
5462025-01-09T01:30:54.002ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-01-09T01:30:54.002ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5482025-01-09T01:30:54.002ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5492025-01-09T01:30:54.054ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-01-09T01:30:54.054ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-01-09T01:30:54.054ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/zone/oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114"), full_name: "oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/zone/oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114" } file = sled-storage/src/manager.rs:1431
5522025-01-09T01:30:54.113ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-01-09T01:30:54.113ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5542025-01-09T01:30:54.113ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ff08246-782d-4058-9e5f-ff095db6560c/crypt/debug"), full_name: "oxp_6ff08246-782d-4058-9e5f-ff095db6560c/crypt/debug" } file = sled-storage/src/manager.rs:1431
5552025-01-09T01:30:54.143ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-01-09T01:30:54.143ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5572025-01-09T01:30:54.143ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/zone"), full_name: "oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/zone" } file = sled-storage/src/manager.rs:1431
5582025-01-09T01:30:54.174ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-01-09T01:30:54.174ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602025-01-09T01:30:54.174ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5da334f-19cb-4d72-b915-499edbcccd72/crypt/zone/oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9"), full_name: "oxp_a5da334f-19cb-4d72-b915-499edbcccd72/crypt/zone/oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9" } file = sled-storage/src/manager.rs:1431
5612025-01-09T01:30:54.235ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-01-09T01:30:54.235ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5632025-01-09T01:30:54.235ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/debug"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/debug" } file = sled-storage/src/manager.rs:1431
5642025-01-09T01:30:54.264ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-01-09T01:30:54.264ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662025-01-09T01:30:54.264ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_629544c0-27f4-4020-b514-332802874b60/crucible" } file = sled-storage/src/manager.rs:1431
5672025-01-09T01:30:54.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-01-09T01:30:54.313ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692025-01-09T01:30:54.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone/oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone/oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5" } file = sled-storage/src/manager.rs:1431
5702025-01-09T01:30:54.374ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-01-09T01:30:54.374ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5722025-01-09T01:30:54.374ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ff08246-782d-4058-9e5f-ff095db6560c/crypt/zone/oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590"), full_name: "oxp_6ff08246-782d-4058-9e5f-ff095db6560c/crypt/zone/oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590" } file = sled-storage/src/manager.rs:1431
5732025-01-09T01:30:54.433ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-01-09T01:30:54.433ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752025-01-09T01:30:54.433ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434" } file = sled-storage/src/manager.rs:1431
5762025-01-09T01:30:54.493ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-01-09T01:30:54.493ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782025-01-09T01:30:54.493ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone/oxz_crucible_7f673996-71f3-460d-8744-05523682c460"), full_name: "oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone/oxz_crucible_7f673996-71f3-460d-8744-05523682c460" } file = sled-storage/src/manager.rs:1431
5792025-01-09T01:30:54.554ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-01-09T01:30:54.554ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5812025-01-09T01:30:54.554ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/629544c0-27f4-4020-b514-332802874b60/crypt/zone"), full_name: "oxp_629544c0-27f4-4020-b514-332802874b60/crypt/zone" } file = sled-storage/src/manager.rs:1431
5822025-01-09T01:30:54.584ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-01-09T01:30:54.584ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5842025-01-09T01:30:54.584ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crypt/zone/oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112"), full_name: "oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crypt/zone/oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112" } file = sled-storage/src/manager.rs:1431
5852025-01-09T01:30:54.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-01-09T01:30:54.645ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872025-01-09T01:30:54.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5da334f-19cb-4d72-b915-499edbcccd72/crypt/zone/oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096"), full_name: "oxp_a5da334f-19cb-4d72-b915-499edbcccd72/crypt/zone/oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096" } file = sled-storage/src/manager.rs:1431
5882025-01-09T01:30:54.705ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-01-09T01:30:54.705ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5902025-01-09T01:30:54.705ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ff08246-782d-4058-9e5f-ff095db6560c/crypt/zone"), full_name: "oxp_6ff08246-782d-4058-9e5f-ff095db6560c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5912025-01-09T01:30:54.736ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922025-01-09T01:30:54.736ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5932025-01-09T01:30:54.736ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5942025-01-09T01:30:54.786ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952025-01-09T01:30:54.786ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962025-01-09T01:30:54.786ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/zone/oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62"), full_name: "oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/zone/oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62" } file = sled-storage/src/manager.rs:1431
5972025-01-09T01:30:54.820ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7) file = sled-agent/src/probe_manager.rs:231 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
5982025-01-09T01:30:54.847ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-01-09T01:30:54.847ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6002025-01-09T01:30:54.847ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone"), full_name: "oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/zone" } file = sled-storage/src/manager.rs:1431
6012025-01-09T01:30:54.875ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-09T01:30:54.875ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6032025-01-09T01:30:54.875ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/debug"), full_name: "oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/debug" } file = sled-storage/src/manager.rs:1431
6042025-01-09T01:30:54.905ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-09T01:30:54.905ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6062025-01-09T01:30:54.905ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crypt/debug"), full_name: "oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crypt/debug" } file = sled-storage/src/manager.rs:1431
6072025-01-09T01:30:54.934ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-01-09T01:30:54.934ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-01-09T01:30:54.934ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a5da334f-19cb-4d72-b915-499edbcccd72/crucible" } file = sled-storage/src/manager.rs:1431
6102025-01-09T01:30:54.982ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-01-09T01:30:54.982ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-01-09T01:30:54.982ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6132025-01-09T01:30:55.033ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-01-09T01:30:55.033ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-01-09T01:30:55.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec" } file = sled-storage/src/manager.rs:1431
6162025-01-09T01:30:55.095ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-01-09T01:30:55.095ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-01-09T01:30:55.095ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crucible" } file = sled-storage/src/manager.rs:1431
6192025-01-09T01:30:55.145ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-01-09T01:30:55.145ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212025-01-09T01:30:55.145ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6222025-01-09T01:30:55.196ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-01-09T01:30:55.196ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242025-01-09T01:30:55.196ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df" } file = sled-storage/src/manager.rs:1431
6252025-01-09T01:30:55.256ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-01-09T01:30:55.256ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272025-01-09T01:30:55.256ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone/oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2"), full_name: "oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/zone/oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2" } file = sled-storage/src/manager.rs:1431
6282025-01-09T01:30:55.319ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-01-09T01:30:55.319ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6302025-01-09T01:30:55.319ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone" } file = sled-storage/src/manager.rs:1431
6312025-01-09T01:30:55.350ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-01-09T01:30:55.350ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6332025-01-09T01:30:55.350ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/629544c0-27f4-4020-b514-332802874b60/crypt/debug"), full_name: "oxp_629544c0-27f4-4020-b514-332802874b60/crypt/debug" } file = sled-storage/src/manager.rs:1431
6342025-01-09T01:30:55.380ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-01-09T01:30:55.380ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362025-01-09T01:30:55.380ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crucible" } file = sled-storage/src/manager.rs:1431
6372025-01-09T01:30:55.430ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-01-09T01:30:55.430ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6392025-01-09T01:30:55.430ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/debug"), full_name: "oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/debug" } file = sled-storage/src/manager.rs:1431
6402025-01-09T01:30:55.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-01-09T01:30:55.459ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-01-09T01:30:55.459ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/zone/oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe" } file = sled-storage/src/manager.rs:1431
6432025-01-09T01:30:55.518ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-01-09T01:30:55.518ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452025-01-09T01:30:55.518ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6462025-01-09T01:30:55.568ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-01-09T01:30:55.568ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6482025-01-09T01:30:55.568ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/zone"), full_name: "oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/zone" } file = sled-storage/src/manager.rs:1431
6492025-01-09T01:30:55.598ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502025-01-09T01:30:55.598ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6512025-01-09T01:30:55.598ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ff08246-782d-4058-9e5f-ff095db6560c/crypt/zone/oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189"), full_name: "oxp_6ff08246-782d-4058-9e5f-ff095db6560c/crypt/zone/oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189" } file = sled-storage/src/manager.rs:1431
6522025-01-09T01:30:55.659ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6532025-01-09T01:30:55.659ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6542025-01-09T01:30:55.659ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5da334f-19cb-4d72-b915-499edbcccd72/crypt/zone"), full_name: "oxp_a5da334f-19cb-4d72-b915-499edbcccd72/crypt/zone" } file = sled-storage/src/manager.rs:1431
6552025-01-09T01:30:55.688ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6562025-01-09T01:30:55.688ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6572025-01-09T01:30:55.688ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6ff08246-782d-4058-9e5f-ff095db6560c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6582025-01-09T01:30:55.738ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6592025-01-09T01:30:55.738ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6602025-01-09T01:30:55.738ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
6612025-01-09T01:30:55.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3183738 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52609 req_id = ae78e082-4f4d-4a1b-9517-e4e85997d30b response_code = 200 uri = /datasets
6622025-01-09T01:30:55.771ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 4008b857-31de-45a2-bfb6-156254963434 (service), filesystem_pool: Some(ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: db7bb166-91ce-4196-80af-3fafccfe99a2 (service), filesystem_pool: Some(ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1587a3be-b05d-4475-8c28-83a2cddb206f (service), filesystem_pool: Some(ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6632025-01-09T01:30:55.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34202
6642025-01-09T01:30:55.771ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6652025-01-09T01:30:55.771ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6662025-01-09T01:30:55.780ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6672025-01-09T01:30:55.780ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6682025-01-09T01:30:55.789ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6692025-01-09T01:30:55.789ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6702025-01-09T01:30:55.797ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-01-09T01:30:55.797ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:188
6722025-01-09T01:30:55.797ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:188
6732025-01-09T01:30:55.797ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6742025-01-09T01:30:55.824ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7) file = sled-agent/src/probe_manager.rs:231 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
6752025-01-09T01:30:55.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6762025-01-09T01:30:55.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6772025-01-09T01:30:55.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6782025-01-09T01:30:55.896ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2 file = illumos-utils/src/zone.rs:325
6792025-01-09T01:30:55.900ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434 file = illumos-utils/src/zone.rs:325
6802025-01-09T01:30:55.903ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f file = illumos-utils/src/zone.rs:325
6812025-01-09T01:30:55.916ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2 file = illumos-utils/src/zone.rs:363
6822025-01-09T01:30:55.921ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434 file = illumos-utils/src/zone.rs:363
6832025-01-09T01:30:55.925ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f file = illumos-utils/src/zone.rs:363
6842025-01-09T01:30:55.957ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4485
6852025-01-09T01:30:55.957ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4527
6862025-01-09T01:30:56.826ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7) file = sled-agent/src/probe_manager.rs:231 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
6872025-01-09T01:30:57.550ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6882025-01-09T01:30:57.550ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6892025-01-09T01:30:57.550ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
6902025-01-09T01:30:58.038ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6912025-01-09T01:30:58.038ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6922025-01-09T01:30:58.060ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4559
6932025-01-09T01:30:58.061ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4565
6942025-01-09T01:30:58.154ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4606
6952025-01-09T01:30:58.154ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6962025-01-09T01:30:58.506ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 28.39372ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
6972025-01-09T01:30:58.527ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6982025-01-09T01:30:58.535ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 134.112872ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
6992025-01-09T01:30:58.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 73.533027ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7002025-01-09T01:30:58.536ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7012025-01-09T01:30:58.540ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
7022025-01-09T01:30:58.540ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7032025-01-09T01:30:58.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 116.636924ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7042025-01-09T01:30:58.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 68.268805ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7052025-01-09T01:30:58.679ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3572676266355634919 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
7062025-01-09T01:30:58.679ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1801784180991443419 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
7072025-01-09T01:30:58.680ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7082025-01-09T01:30:58.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f") failed: Property not found. retry in 59.926233ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7092025-01-09T01:30:58.712ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7102025-01-09T01:30:58.712ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7112025-01-09T01:30:58.712ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 0
7122025-01-09T01:30:58.712ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7132025-01-09T01:30:58.861ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
7142025-01-09T01:30:58.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 130.804694ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7152025-01-09T01:30:59.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 264.818961ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7162025-01-09T01:30:59.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f") failed: Property not found. retry in 70.810924ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7172025-01-09T01:30:59.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 252.993777ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7182025-01-09T01:30:59.113ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7192025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7202025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7212025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7222025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7232025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7242025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7252025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7262025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7272025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7282025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7292025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7302025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7312025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7322025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7332025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7342025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7352025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7362025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7372025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7382025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7392025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7402025-01-09T01:30:59.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7412025-01-09T01:30:59.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f") failed: Property not found. retry in 288.474444ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7422025-01-09T01:30:59.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 486.478785ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7432025-01-09T01:30:59.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 250.173466ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7442025-01-09T01:30:59.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f") failed: Property not found. retry in 355.507721ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7452025-01-09T01:30:59.443ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
7462025-01-09T01:30:59.443ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
7472025-01-09T01:30:59.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 641.434729ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7482025-01-09T01:30:59.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f") failed: Property not found. retry in 606.406153ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7492025-01-09T01:30:59.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 401.14546ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7502025-01-09T01:31:00.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 503.689952ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7512025-01-09T01:31:00.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 1.334152793s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7522025-01-09T01:31:00.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f") failed: Property not found. retry in 1.433020137s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7532025-01-09T01:31:00.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 1.445974409s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7542025-01-09T01:31:01.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 1.444914816s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7552025-01-09T01:31:01.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f") failed: Property not found. retry in 1.465914088s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7562025-01-09T01:31:02.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 794.039267ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7572025-01-09T01:31:02.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 570.784582ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7582025-01-09T01:31:03.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 892.894939ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7592025-01-09T01:31:03.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f") failed: Property not found. retry in 846.909004ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7602025-01-09T01:31:03.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 534.737747ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7612025-01-09T01:31:03.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 584.901916ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7622025-01-09T01:31:04.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434") failed: Property not found. retry in 978.164694ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7632025-01-09T01:31:04.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f") failed: Property not found. retry in 1.393144602s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7642025-01-09T01:31:04.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2") failed: Property not found. retry in 1.366227493s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7652025-01-09T01:31:05.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_db7bb166-91ce-4196-80af-3fafccfe99a2
7662025-01-09T01:31:05.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_4008b857-31de-45a2-bfb6-156254963434
7672025-01-09T01:31:05.912ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_1587a3be-b05d-4475-8c28-83a2cddb206f
7682025-01-09T01:31:05.912ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692025-01-09T01:31:05.912ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7702025-01-09T01:31:05.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10141789 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34202 req_id = 89bae34e-83d4-469e-8aee-28626c568c54 response_code = 204 uri = /omicron-zones
7712025-01-09T01:31:05.915ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722025-01-09T01:31:05.994ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732025-01-09T01:31:06.222ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 112.182383ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7742025-01-09T01:31:06.389ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7752025-01-09T01:31:06.471ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7762025-01-09T01:31:06.471ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7772025-01-09T01:31:06.503ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7782025-01-09T01:31:06.504ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7792025-01-09T01:31:06.504ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7802025-01-09T01:31:06.534ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 4008b857-31de-45a2-bfb6-156254963434 (service), filesystem_pool: Some(ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: db7bb166-91ce-4196-80af-3fafccfe99a2 (service), filesystem_pool: Some(ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1587a3be-b05d-4475-8c28-83a2cddb206f (service), filesystem_pool: Some(ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6feb68c5-225d-45a2-9d9e-86b600533114 (service), filesystem_pool: Some(ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 05d46c63-0c10-4446-a13b-ae1a90f5767f, kind: Service { id: 6feb68c5-225d-45a2-9d9e-86b600533114 }, name: Name("ntp-6feb68c5-225d-45a2-9d9e-86b600533114"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 197])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7812025-01-09T01:31:06.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56372
7822025-01-09T01:31:06.534ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-01-09T01:31:06.534ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-01-09T01:31:06.545ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-01-09T01:31:06.545ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-01-09T01:31:06.555ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872025-01-09T01:31:06.555ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882025-01-09T01:31:06.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7892025-01-09T01:31:06.565ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:177
7902025-01-09T01:31:06.565ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:177
7912025-01-09T01:31:06.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7922025-01-09T01:31:06.576ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7932025-01-09T01:31:06.608ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7942025-01-09T01:31:06.609ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7952025-01-09T01:31:06.609ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7962025-01-09T01:31:06.639ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 173, 197]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7972025-01-09T01:31:06.639ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = boundary_ntp
7982025-01-09T01:31:06.639ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7992025-01-09T01:31:06.639ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8002025-01-09T01:31:06.639ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8012025-01-09T01:31:06.640ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8022025-01-09T01:31:06.663ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114 file = illumos-utils/src/zone.rs:325
8032025-01-09T01:31:06.681ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114 file = illumos-utils/src/zone.rs:363
8042025-01-09T01:31:07.287ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8052025-01-09T01:31:07.287ZINFOSledAgent (ServiceManager): Booting oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8062025-01-09T01:31:07.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 49.760032ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8072025-01-09T01:31:07.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 103.422428ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8082025-01-09T01:31:07.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 225.942548ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8092025-01-09T01:31:07.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 438.10606ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8102025-01-09T01:31:08.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 412.965245ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8112025-01-09T01:31:08.680ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3572676266355634919 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8122025-01-09T01:31:08.681ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1801784180991443419 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8132025-01-09T01:31:08.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 683.018508ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8142025-01-09T01:31:09.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 695.718596ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8152025-01-09T01:31:09.445ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8162025-01-09T01:31:09.445ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8172025-01-09T01:31:10.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 728.296387ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8182025-01-09T01:31:10.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 1.146983429s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8192025-01-09T01:31:11.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 538.897727ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8202025-01-09T01:31:12.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114") failed: Property not found. retry in 870.843511ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8212025-01-09T01:31:13.432ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114
8222025-01-09T01:31:13.432ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8232025-01-09T01:31:13.433ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8242025-01-09T01:31:13.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6899480 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56372 req_id = 97df38ef-33f4-437d-94ad-9d4c62180ab2 response_code = 204 uri = /omicron-zones
8252025-01-09T01:31:13.436ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8262025-01-09T01:31:13.466ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272025-01-09T01:31:13.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58880
8282025-01-09T01:31:13.476ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8292025-01-09T01:31:13.476ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9695 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58880 req_id = 2e386f1b-9e4d-403e-8a25-87d2e2cb900a response_code = 500 uri = /timesync
8302025-01-09T01:31:13.478ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8312025-01-09T01:31:13.589ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322025-01-09T01:31:13.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45937
8332025-01-09T01:31:15.115ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16686652683226403765 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8342025-01-09T01:31:15.599ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1463616566871155198 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8352025-01-09T01:31:15.916ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7293751632111141215 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8362025-01-09T01:31:17.598ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8372025-01-09T01:31:17.598ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45937 req_id = 538755b5-c132-4328-9c0b-d3d1cd29de09 response_code = 500 uri = /timesync
8382025-01-09T01:31:17.601ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8392025-01-09T01:31:17.806ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402025-01-09T01:31:17.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58885
8412025-01-09T01:31:17.815ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8422025-01-09T01:31:17.815ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8676 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58885 req_id = 73ecd2ce-fa61-4d3d-ba49-487f4ce13c4c response_code = 500 uri = /timesync
8432025-01-09T01:31:17.817ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8442025-01-09T01:31:17.962ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8452025-01-09T01:31:17.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40380
8462025-01-09T01:31:18.684ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3572676266355634919 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8472025-01-09T01:31:18.684ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1801784180991443419 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8482025-01-09T01:31:19.447ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8492025-01-09T01:31:19.447ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8502025-01-09T01:31:22.477ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6feb68c5-225d-45a2-9d9e-86b600533114': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8512025-01-09T01:31:22.477ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008970 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40380 req_id = c0c8baac-6096-4c52-ac52-8a8eb20be0ec response_code = 500 uri = /timesync
8522025-01-09T01:31:22.479ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-01-09T01:31:22.031ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542025-01-09T01:31:22.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54348
8552025-01-09T01:31:22.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8829 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54348 req_id = f9197411-c197-4163-ad11-5d45c1187939 response_code = 200 uri = /timesync
8562025-01-09T01:31:22.042ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736386281.0050662, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8572025-01-09T01:31:22.042ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-01-09T01:31:22.310ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592025-01-09T01:31:22.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63338
8602025-01-09T01:31:22.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63338 req_id = 0e47db6d-d868-41e9-bba0-4c93d3f85598 response_code = 200 uri = /timesync
8612025-01-09T01:31:22.322ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736386281.0050662, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8622025-01-09T01:31:22.322ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632025-01-09T01:31:22.661ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642025-01-09T01:31:22.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35323
8652025-01-09T01:31:22.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35323 req_id = 552124a6-650a-48a5-aae3-b3b2166803ef response_code = 200 uri = /timesync
8662025-01-09T01:31:22.672ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736386281.0050662, correction: 0.215620071 } file = sled-agent/src/rack_setup/service.rs:743
8672025-01-09T01:31:22.672ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682025-01-09T01:31:23.070ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692025-01-09T01:31:23.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54779
8702025-01-09T01:31:23.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7758 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54779 req_id = 3d36e395-e8cb-4e7b-9694-a13b69c3f7e3 response_code = 200 uri = /timesync
8712025-01-09T01:31:23.081ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736386281.0050662, correction: 0.214517355 } file = sled-agent/src/rack_setup/service.rs:743
8722025-01-09T01:31:23.081ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732025-01-09T01:31:23.370ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3540525181723263357 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8742025-01-09T01:31:23.370ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4038706230283723823 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8752025-01-09T01:31:23.449ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762025-01-09T01:31:23.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51617
8772025-01-09T01:31:23.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51617 req_id = 1ef4aa27-785d-4af3-8465-882d585d6b05 response_code = 200 uri = /timesync
8782025-01-09T01:31:23.460ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736386281.0050662, correction: 0.213492796 } file = sled-agent/src/rack_setup/service.rs:743
8792025-01-09T01:31:23.460ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802025-01-09T01:31:24.021ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812025-01-09T01:31:24.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57236
8822025-01-09T01:31:24.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8081 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57236 req_id = 6b883380-32eb-4832-a823-507bbe86c25c response_code = 200 uri = /timesync
8832025-01-09T01:31:24.033ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736386281.0050662, correction: 0.212951392 } file = sled-agent/src/rack_setup/service.rs:743
8842025-01-09T01:31:24.033ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852025-01-09T01:31:24.642ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8862025-01-09T01:31:24.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45986
8872025-01-09T01:31:24.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8916 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45986 req_id = 4729d401-a432-4a5c-b74f-6879c1b6be76 response_code = 200 uri = /timesync
8882025-01-09T01:31:24.653ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736386281.0050662, correction: 0.211272597 } file = sled-agent/src/rack_setup/service.rs:743
8892025-01-09T01:31:24.653ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8902025-01-09T01:31:24.858ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 337.952567ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8912025-01-09T01:31:25.056ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16686652683226403765 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8922025-01-09T01:31:25.540ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1463616566871155198 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8932025-01-09T01:31:25.589ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8942025-01-09T01:31:25.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60559
8952025-01-09T01:31:25.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8585 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60559 req_id = 2433f157-b5a7-4a94-b397-ad446853f09a response_code = 200 uri = /timesync
8962025-01-09T01:31:25.600ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736386281.0050662, correction: 0.208974883 } file = sled-agent/src/rack_setup/service.rs:743
8972025-01-09T01:31:25.600ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8982025-01-09T01:31:25.859ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7293751632111141215 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
8992025-01-09T01:31:26.343ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9002025-01-09T01:31:26.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57540
9012025-01-09T01:31:26.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57540 req_id = 079c003a-6de6-4372-8662-b4c39ec132d4 response_code = 200 uri = /timesync
9022025-01-09T01:31:26.354ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736386281.0050662, correction: 0.208039463 } file = sled-agent/src/rack_setup/service.rs:743
9032025-01-09T01:31:26.354ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9042025-01-09T01:31:26.870ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9052025-01-09T01:31:26.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37754
9062025-01-09T01:31:26.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8069 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37754 req_id = e69c8e26-ebee-4027-90e7-4cfe2de803d3 response_code = 200 uri = /timesync
9072025-01-09T01:31:26.880ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501670575, ip_addr: 149.28.118.175, stratum: 3, ref_time: 1736386285.9158137, correction: 0.205797255 } file = sled-agent/src/rack_setup/service.rs:743
9082025-01-09T01:31:26.880ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9092025-01-09T01:31:28.482ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9102025-01-09T01:31:28.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59455
9112025-01-09T01:31:28.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8804 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59455 req_id = 26579eb9-2fac-47a0-a0a9-64ebed10b9b5 response_code = 200 uri = /timesync
9122025-01-09T01:31:28.493ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501670575, ip_addr: 149.28.118.175, stratum: 3, ref_time: 1736386287.1814697, correction: 0.199313417 } file = sled-agent/src/rack_setup/service.rs:743
9132025-01-09T01:31:28.493ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9142025-01-09T01:31:28.627ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55651
9152025-01-09T01:31:28.627ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55651 req_id = 2be234dd-ef1b-4ee2-b7fe-958654fe2f82 response_code = 200 uri = /baseboard
9162025-01-09T01:31:28.634ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3572676266355634919 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9172025-01-09T01:31:28.634ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1801784180991443419 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9182025-01-09T01:31:29.399ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9192025-01-09T01:31:29.400ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9202025-01-09T01:31:30.052ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9212025-01-09T01:31:30.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51576
9222025-01-09T01:31:30.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51576 req_id = 4834f3a3-6dec-429f-b73f-e8cf9fb043d6 response_code = 200 uri = /timesync
9232025-01-09T01:31:30.064ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386289.473937, correction: 0.194646478 } file = sled-agent/src/rack_setup/service.rs:743
9242025-01-09T01:31:30.064ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9252025-01-09T01:31:32.152ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9262025-01-09T01:31:32.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38627
9272025-01-09T01:31:32.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8686 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38627 req_id = 295dc425-33c5-46e8-ad66-dd4d664c60d0 response_code = 200 uri = /timesync
9282025-01-09T01:31:32.163ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386291.8622198, correction: 0.188949302 } file = sled-agent/src/rack_setup/service.rs:743
9292025-01-09T01:31:32.163ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9302025-01-09T01:31:33.399ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3540525181723263357 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9312025-01-09T01:31:33.399ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4038706230283723823 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9322025-01-09T01:31:34.507ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9332025-01-09T01:31:34.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49557
9342025-01-09T01:31:34.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49557 req_id = b4fcf08d-0099-46a1-b4e3-a8f79e546537 response_code = 200 uri = /timesync
9352025-01-09T01:31:34.518ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386293.1733005, correction: 0.182575434 } file = sled-agent/src/rack_setup/service.rs:743
9362025-01-09T01:31:34.518ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9372025-01-09T01:31:35.085ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16686652683226403765 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9382025-01-09T01:31:35.568ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1463616566871155198 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9392025-01-09T01:31:35.875ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9402025-01-09T01:31:35.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64882
9412025-01-09T01:31:35.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7756 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64882 req_id = a7e563ab-98c2-42ef-85cf-6ca1dd7ab8b2 response_code = 200 uri = /timesync
9422025-01-09T01:31:35.885ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386294.1981878, correction: 0.178882062 } file = sled-agent/src/rack_setup/service.rs:743
9432025-01-09T01:31:35.885ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9442025-01-09T01:31:35.888ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7293751632111141215 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9452025-01-09T01:31:38.663ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3572676266355634919 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9462025-01-09T01:31:38.664ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1801784180991443419 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9472025-01-09T01:31:39.429ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9482025-01-09T01:31:39.429ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9492025-01-09T01:31:39.555ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9502025-01-09T01:31:39.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42938
9512025-01-09T01:31:39.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8390 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42938 req_id = 33cd78af-8e94-46a6-a080-a0bf158685ea response_code = 200 uri = /timesync
9522025-01-09T01:31:39.566ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386297.4747338, correction: 0.168965638 } file = sled-agent/src/rack_setup/service.rs:743
9532025-01-09T01:31:39.566ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9542025-01-09T01:31:40.273ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 558.642276ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9552025-01-09T01:31:41.338ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9562025-01-09T01:31:41.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57074
9572025-01-09T01:31:41.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10070 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57074 req_id = 2007c6ca-0b9b-41f4-b4a5-89009e961af9 response_code = 200 uri = /timesync
9582025-01-09T01:31:41.351ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386300.0006754, correction: 0.164127797 } file = sled-agent/src/rack_setup/service.rs:743
9592025-01-09T01:31:41.351ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9602025-01-09T01:31:43.428ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3540525181723263357 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9612025-01-09T01:31:43.429ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4038706230283723823 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9622025-01-09T01:31:43.911ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9632025-01-09T01:31:43.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50656
9642025-01-09T01:31:43.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50656 req_id = 46b40575-edfe-486f-b92a-2e45d5b35f81 response_code = 200 uri = /timesync
9652025-01-09T01:31:43.923ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386301.5155387, correction: 0.157187045 } file = sled-agent/src/rack_setup/service.rs:743
9662025-01-09T01:31:43.923ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9672025-01-09T01:31:45.114ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16686652683226403765 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9682025-01-09T01:31:45.597ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1463616566871155198 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9692025-01-09T01:31:45.917ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7293751632111141215 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9702025-01-09T01:31:46.907ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9712025-01-09T01:31:46.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36711
9722025-01-09T01:31:46.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8862 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36711 req_id = c28aefa9-cfad-4b1b-8397-e2d0155ddb27 response_code = 200 uri = /timesync
9732025-01-09T01:31:46.919ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386305.6037312, correction: 0.149113283 } file = sled-agent/src/rack_setup/service.rs:743
9742025-01-09T01:31:46.919ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9752025-01-09T01:31:48.692ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3572676266355634919 reason = Duration(60s) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9762025-01-09T01:31:48.693ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1801784180991443419 reason = Duration(60s) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9772025-01-09T01:31:49.458ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9782025-01-09T01:31:49.458ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9792025-01-09T01:31:50.145ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9802025-01-09T01:31:50.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35198
9812025-01-09T01:31:50.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9037 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35198 req_id = ac1b67a9-7640-4261-abea-30839fa5da02 response_code = 200 uri = /timesync
9822025-01-09T01:31:50.156ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386309.5945816, correction: 0.140338153 } file = sled-agent/src/rack_setup/service.rs:743
9832025-01-09T01:31:50.156ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9842025-01-09T01:31:53.457ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3540525181723263357 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9852025-01-09T01:31:53.457ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4038706230283723823 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9862025-01-09T01:31:54.328ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9872025-01-09T01:31:54.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50976
9882025-01-09T01:31:54.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8465 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50976 req_id = 0f33c763-d1bc-4bee-9328-a8a4a84720eb response_code = 200 uri = /timesync
9892025-01-09T01:31:54.340ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386312.9665751, correction: 0.129045188 } file = sled-agent/src/rack_setup/service.rs:743
9902025-01-09T01:31:54.340ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9912025-01-09T01:31:55.143ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16686652683226403765 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9922025-01-09T01:31:55.626ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1463616566871155198 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9932025-01-09T01:31:55.909ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.010643114s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9942025-01-09T01:31:55.946ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7293751632111141215 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9952025-01-09T01:31:58.742ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47371
9962025-01-09T01:31:58.742ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47371 req_id = cdb3c472-0802-45f7-bab3-9b1312d6912e response_code = 200 uri = /baseboard
9972025-01-09T01:31:59.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9982025-01-09T01:31:59.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
9992025-01-09T01:32:03.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3540525181723263357 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10002025-01-09T01:32:03.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4038706230283723823 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10012025-01-09T01:32:05.172ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16686652683226403765 reason = Duration(60s) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10022025-01-09T01:32:05.655ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1463616566871155198 reason = Duration(60s) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10032025-01-09T01:32:05.809ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10042025-01-09T01:32:05.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46068
10052025-01-09T01:32:05.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46068 req_id = 5903d51b-781f-455d-89ad-50f50b22bded response_code = 200 uri = /timesync
10062025-01-09T01:32:05.821ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386325.7211783, correction: 0.098012961 } file = sled-agent/src/rack_setup/service.rs:743
10072025-01-09T01:32:05.821ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10082025-01-09T01:32:05.977ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7293751632111141215 reason = Duration(60s) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10092025-01-09T01:32:09.516ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10102025-01-09T01:32:09.516ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10112025-01-09T01:32:11.579ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10122025-01-09T01:32:11.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33466
10132025-01-09T01:32:11.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9491 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33466 req_id = 0df5c4fd-71dc-47dd-8b06-564d4015fd9c response_code = 200 uri = /timesync
10142025-01-09T01:32:11.591ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386329.21873, correction: 0.082453057 } file = sled-agent/src/rack_setup/service.rs:743
10152025-01-09T01:32:11.591ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10162025-01-09T01:32:11.998ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.81661099s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10172025-01-09T01:32:13.516ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3540525181723263357 reason = Duration(60s) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10182025-01-09T01:32:13.516ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4038706230283723823 reason = Duration(60s) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10192025-01-09T01:32:19.545ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4617741088769698861 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10202025-01-09T01:32:19.546ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12466924864998617224 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10212025-01-09T01:32:26.408ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10222025-01-09T01:32:26.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47940
10232025-01-09T01:32:26.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21861 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47940 req_id = d718b030-f1b7-411f-a541-1705c04c4d2b response_code = 200 uri = /timesync
10242025-01-09T01:32:26.430ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-09T01:32:05.977082917Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7293751632111141215 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10252025-01-09T01:32:26.433ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-09T01:31:48.692514484Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3572676266355634919 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10262025-01-09T01:32:26.433ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-09T01:31:48.693063475Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1801784180991443419 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10272025-01-09T01:32:26.433ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-09T01:32:05.655747790Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1463616566871155198 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10282025-01-09T01:32:26.433ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-09T01:32:13.516449318Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3540525181723263357 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10292025-01-09T01:32:26.433ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-09T01:32:13.516793565Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4038706230283723823 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10302025-01-09T01:32:26.434ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-09T01:32:05.172895778Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16686652683226403765 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10312025-01-09T01:32:26.435ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1736386338.9717102, correction: 0.042416718 } file = sled-agent/src/rack_setup/service.rs:743
10322025-01-09T01:32:26.435ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10332025-01-09T01:32:26.467ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 4008b857-31de-45a2-bfb6-156254963434 (service), filesystem_pool: Some(ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: db7bb166-91ce-4196-80af-3fafccfe99a2 (service), filesystem_pool: Some(ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1587a3be-b05d-4475-8c28-83a2cddb206f (service), filesystem_pool: Some(ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6feb68c5-225d-45a2-9d9e-86b600533114 (service), filesystem_pool: Some(ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 05d46c63-0c10-4446-a13b-ae1a90f5767f, kind: Service { id: 6feb68c5-225d-45a2-9d9e-86b600533114 }, name: Name("ntp-6feb68c5-225d-45a2-9d9e-86b600533114"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 197])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: d0744eff-8742-451e-98ef-94f40ac1d1df (service), filesystem_pool: Some(ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5 (service), filesystem_pool: Some(ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External } } } }, OmicronZoneConfig { id: 51674af7-c107-40dc-95d4-4e5d6a25c76f (service), filesystem_pool: Some(ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8eaf51f5-df38-4cb2-a3b9-98a78a1630e1 (service), filesystem_pool: Some(ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External } } } }, OmicronZoneConfig { id: 33bac3ce-17ae-4a72-a521-7fa522c24590 (service), filesystem_pool: Some(ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10342025-01-09T01:32:26.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62738
10352025-01-09T01:32:26.467ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10362025-01-09T01:32:26.467ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10372025-01-09T01:32:26.478ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10382025-01-09T01:32:26.478ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10392025-01-09T01:32:26.488ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10402025-01-09T01:32:26.488ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10412025-01-09T01:32:26.496ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10422025-01-09T01:32:26.496ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10432025-01-09T01:32:26.505ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10442025-01-09T01:32:26.505ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10452025-01-09T01:32:26.514ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10462025-01-09T01:32:26.514ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472025-01-09T01:32:26.523ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10482025-01-09T01:32:26.523ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492025-01-09T01:32:26.532ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10502025-01-09T01:32:26.532ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10512025-01-09T01:32:26.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10522025-01-09T01:32:26.540ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:177
10532025-01-09T01:32:26.541ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:177
10542025-01-09T01:32:26.541ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10552025-01-09T01:32:26.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10562025-01-09T01:32:26.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10572025-01-09T01:32:26.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10582025-01-09T01:32:26.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10592025-01-09T01:32:26.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10602025-01-09T01:32:26.714ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5 file = illumos-utils/src/zone.rs:325
10612025-01-09T01:32:26.718ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f file = illumos-utils/src/zone.rs:325
10622025-01-09T01:32:26.722ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df file = illumos-utils/src/zone.rs:325
10632025-01-09T01:32:26.726ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 file = illumos-utils/src/zone.rs:325
10642025-01-09T01:32:26.731ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1 file = illumos-utils/src/zone.rs:325
10652025-01-09T01:32:26.736ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5 file = illumos-utils/src/zone.rs:363
10662025-01-09T01:32:26.740ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f file = illumos-utils/src/zone.rs:363
10672025-01-09T01:32:26.745ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df file = illumos-utils/src/zone.rs:363
10682025-01-09T01:32:26.750ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 file = illumos-utils/src/zone.rs:363
10692025-01-09T01:32:26.754ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1 file = illumos-utils/src/zone.rs:363
10702025-01-09T01:32:28.855ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53921
10712025-01-09T01:32:28.856ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53921 req_id = 8441b710-2ded-47c3-960b-4147fcdbfa22 response_code = 200 uri = /baseboard
10722025-01-09T01:32:28.899ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.400812585s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
10732025-01-09T01:32:29.695ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='51674af7-c107-40dc-95d4-4e5d6a25c76f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10742025-01-09T01:32:29.695ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
10752025-01-09T01:32:29.714ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='33bac3ce-17ae-4a72-a521-7fa522c24590'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10762025-01-09T01:32:29.714ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
10772025-01-09T01:32:29.778ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d0744eff-8742-451e-98ef-94f40ac1d1df'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10782025-01-09T01:32:29.779ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
10792025-01-09T01:32:29.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 46.765898ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
10802025-01-09T01:32:29.845ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10812025-01-09T01:32:29.845ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
10822025-01-09T01:32:29.850ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8eaf51f5-df38-4cb2-a3b9-98a78a1630e1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10832025-01-09T01:32:29.851ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
10842025-01-09T01:32:29.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 45.155665ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
10852025-01-09T01:32:29.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 124.434816ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
10862025-01-09T01:32:29.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 119.911963ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
10872025-01-09T01:32:29.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 40.180046ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
10882025-01-09T01:32:30.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 246.323088ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
10892025-01-09T01:32:30.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 90.537408ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
10902025-01-09T01:32:30.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 230.303035ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
10912025-01-09T01:32:30.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 189.075599ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
10922025-01-09T01:32:30.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 362.652309ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
10932025-01-09T01:32:30.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 289.886438ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
10942025-01-09T01:32:30.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 318.740835ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
10952025-01-09T01:32:30.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 33.733501ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
10962025-01-09T01:32:30.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 25.599123ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
10972025-01-09T01:32:30.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 104.26218ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
10982025-01-09T01:32:30.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 131.7779ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
10992025-01-09T01:32:31.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 863.504497ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11002025-01-09T01:32:31.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 1.199564698s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11012025-01-09T01:32:31.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 140.210209ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11022025-01-09T01:32:31.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 211.743628ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11032025-01-09T01:32:31.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 989.541612ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11042025-01-09T01:32:31.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 516.137438ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11052025-01-09T01:32:31.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 289.435591ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11062025-01-09T01:32:31.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 733.61756ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11072025-01-09T01:32:31.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 1.49040289s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11082025-01-09T01:32:31.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 963.950642ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11092025-01-09T01:32:32.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 1.308603864s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11102025-01-09T01:32:32.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 955.995566ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11112025-01-09T01:32:32.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 892.349623ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11122025-01-09T01:32:32.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 594.905071ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11132025-01-09T01:32:33.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 1.188408154s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11142025-01-09T01:32:33.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 1.056606333s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11152025-01-09T01:32:33.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 1.023254228s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11162025-01-09T01:32:33.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 1.056962726s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11172025-01-09T01:32:33.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 1.172035308s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11182025-01-09T01:32:34.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 1.157414317s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11192025-01-09T01:32:34.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 620.646985ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11202025-01-09T01:32:34.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 818.91722ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11212025-01-09T01:32:34.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 1.064876356s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11222025-01-09T01:32:34.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 845.210686ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11232025-01-09T01:32:35.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 1.498398608s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11242025-01-09T01:32:35.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 1.375075338s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11252025-01-09T01:32:35.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 1.437172228s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11262025-01-09T01:32:35.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 974.098367ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11272025-01-09T01:32:35.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 1.077016564s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11282025-01-09T01:32:36.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 847.243757ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11292025-01-09T01:32:36.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 542.132176ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11302025-01-09T01:32:36.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 1.464986942s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11312025-01-09T01:32:36.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 687.384469ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11322025-01-09T01:32:37.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 1.45733073s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11332025-01-09T01:32:37.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 916.590014ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11342025-01-09T01:32:37.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 931.334884ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11352025-01-09T01:32:37.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 568.053202ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11362025-01-09T01:32:38.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 924.633638ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11372025-01-09T01:32:38.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 1.05313417s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11382025-01-09T01:32:38.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 794.281944ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11392025-01-09T01:32:38.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 925.310893ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11402025-01-09T01:32:38.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 671.160806ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11412025-01-09T01:32:38.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 537.91912ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11422025-01-09T01:32:38.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 1.12015725s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11432025-01-09T01:32:39.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 1.492406627s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11442025-01-09T01:32:39.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 1.131477789s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11452025-01-09T01:32:39.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 600.830209ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11462025-01-09T01:32:39.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 1.388318795s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11472025-01-09T01:32:39.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 739.958519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11482025-01-09T01:32:40.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 624.164541ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11492025-01-09T01:32:40.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 1.004457489s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11502025-01-09T01:32:40.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df") failed: Property not found. retry in 1.414142403s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11512025-01-09T01:32:40.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 930.22171ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11522025-01-09T01:32:40.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f") failed: Property not found. retry in 1.27235967s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11532025-01-09T01:32:40.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590") failed: Property not found. retry in 932.973447ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11542025-01-09T01:32:41.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1") failed: Property not found. retry in 903.950962ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11552025-01-09T01:32:41.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5") failed: Property not found. retry in 1.321939831s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11562025-01-09T01:32:42.958ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5
11572025-01-09T01:32:42.958ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_51674af7-c107-40dc-95d4-4e5d6a25c76f
11582025-01-09T01:32:42.958ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_d0744eff-8742-451e-98ef-94f40ac1d1df
11592025-01-09T01:32:42.958ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590
11602025-01-09T01:32:42.958ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_8eaf51f5-df38-4cb2-a3b9-98a78a1630e1
11612025-01-09T01:32:42.958ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11622025-01-09T01:32:42.958ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11632025-01-09T01:32:42.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16447623 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62738 req_id = 751edb7e-9bc0-432f-a517-d0cde13f637a response_code = 204 uri = /omicron-zones
11642025-01-09T01:32:42.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60780
11652025-01-09T01:32:43.019ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = 2b6e4bda-3f28-49e0-90da-f6c9e47b2067 response_code = 500 uri = /cockroachdb
11662025-01-09T01:32:43.020ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2b6e4bda-3f28-49e0-90da-f6c9e47b2067", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2b6e4bda-3f28-49e0-90da-f6c9e47b2067" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 59.87195ms
11672025-01-09T01:32:43.107ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = 790a6fae-bcbc-4046-8028-bd77e19c967b response_code = 500 uri = /cockroachdb
11682025-01-09T01:32:43.107ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "790a6fae-bcbc-4046-8028-bd77e19c967b", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "790a6fae-bcbc-4046-8028-bd77e19c967b" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 93.118165ms
11692025-01-09T01:32:43.227ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25234 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = 9c0a9bc9-2641-453e-9d2c-e53637c9698d response_code = 500 uri = /cockroachdb
11702025-01-09T01:32:43.227ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9c0a9bc9-2641-453e-9d2c-e53637c9698d", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:42 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9c0a9bc9-2641-453e-9d2c-e53637c9698d" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 174.080904ms
11712025-01-09T01:32:43.429ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27105 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = 20ed568f-484c-4201-8d8a-d896dad6e832 response_code = 500 uri = /cockroachdb
11722025-01-09T01:32:43.430ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "20ed568f-484c-4201-8d8a-d896dad6e832", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "20ed568f-484c-4201-8d8a-d896dad6e832" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 169.221853ms
11732025-01-09T01:32:43.624ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 24609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = 1d85fbe4-37b3-4dfd-9ee1-8d942f8e6d4c response_code = 500 uri = /cockroachdb
11742025-01-09T01:32:43.624ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1d85fbe4-37b3-4dfd-9ee1-8d942f8e6d4c", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1d85fbe4-37b3-4dfd-9ee1-8d942f8e6d4c" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 309.298616ms
11752025-01-09T01:32:43.960ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26312 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = c0e59224-0c6e-475a-9cbb-3edc30ba4ed6 response_code = 500 uri = /cockroachdb
11762025-01-09T01:32:43.961ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c0e59224-0c6e-475a-9cbb-3edc30ba4ed6", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c0e59224-0c6e-475a-9cbb-3edc30ba4ed6" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 162.530462ms
11772025-01-09T01:32:44.152ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26684 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = bfb5b9a4-1009-4255-b6c7-fec001503131 response_code = 500 uri = /cockroachdb
11782025-01-09T01:32:44.152ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bfb5b9a4-1009-4255-b6c7-fec001503131", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bfb5b9a4-1009-4255-b6c7-fec001503131" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 213.926237ms
11792025-01-09T01:32:44.393ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = 4db564dc-44ab-4f57-927e-90bcbeafdb64 response_code = 500 uri = /cockroachdb
11802025-01-09T01:32:44.394ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4db564dc-44ab-4f57-927e-90bcbeafdb64", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4db564dc-44ab-4f57-927e-90bcbeafdb64" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 355.772942ms
11812025-01-09T01:32:44.779ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = 892b700b-a7bf-4fa7-80fe-74a36fe78255 response_code = 500 uri = /cockroachdb
11822025-01-09T01:32:44.779ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "892b700b-a7bf-4fa7-80fe-74a36fe78255", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "892b700b-a7bf-4fa7-80fe-74a36fe78255" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 440.15271ms
11832025-01-09T01:32:45.251ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_33bac3ce-17ae-4a72-a521-7fa522c24590 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 31011 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = 1f1751f0-7a39-46dc-b0a8-1856bc2738b4 response_code = 500 uri = /cockroachdb
11842025-01-09T01:32:45.252ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1f1751f0-7a39-46dc-b0a8-1856bc2738b4", "content-length": "124", "date": "Thu, 09 Jan 2025 01:32:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1f1751f0-7a39-46dc-b0a8-1856bc2738b4" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 482.579422ms
11852025-01-09T01:32:45.767ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3769
11862025-01-09T01:32:54.994ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
11872025-01-09T01:32:59.210ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3810
11882025-01-09T01:32:59.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13474685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:60780 req_id = 766f7212-161b-4a44-877a-dfae33aa5fa5 response_code = 204 uri = /cockroachdb
11892025-01-09T01:32:59.212ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62928
11902025-01-09T01:32:59.212ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62928 req_id = 08a9c6f2-e2f5-46ac-8533-9a585c8f33ce response_code = 200 uri = /baseboard
11912025-01-09T01:32:59.217ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.789305125s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
11922025-01-09T01:32:59.250ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 4008b857-31de-45a2-bfb6-156254963434 (service), filesystem_pool: Some(ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: db7bb166-91ce-4196-80af-3fafccfe99a2 (service), filesystem_pool: Some(ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 1587a3be-b05d-4475-8c28-83a2cddb206f (service), filesystem_pool: Some(ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6feb68c5-225d-45a2-9d9e-86b600533114 (service), filesystem_pool: Some(ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 05d46c63-0c10-4446-a13b-ae1a90f5767f, kind: Service { id: 6feb68c5-225d-45a2-9d9e-86b600533114 }, name: Name("ntp-6feb68c5-225d-45a2-9d9e-86b600533114"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 197])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: d0744eff-8742-451e-98ef-94f40ac1d1df (service), filesystem_pool: Some(ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7ae14c61-6fa7-4b7e-bc1e-96bd385ea9f5 (service), filesystem_pool: Some(ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External } } } }, OmicronZoneConfig { id: 51674af7-c107-40dc-95d4-4e5d6a25c76f (service), filesystem_pool: Some(ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8eaf51f5-df38-4cb2-a3b9-98a78a1630e1 (service), filesystem_pool: Some(ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External } } } }, OmicronZoneConfig { id: 33bac3ce-17ae-4a72-a521-7fa522c24590 (service), filesystem_pool: Some(ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External } } } }, OmicronZoneConfig { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 (service), filesystem_pool: Some(ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: d28db04c-86dc-4788-b08f-467ff8a673dc (service), filesystem_pool: Some(ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a (service), filesystem_pool: Some(ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 (service), filesystem_pool: Some(ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 (service), filesystem_pool: Some(ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a (service), filesystem_pool: Some(ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec (service), filesystem_pool: Some(ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3155a5a4-e862-487e-9a3f-c9900ca9a189 (service), filesystem_pool: Some(ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 1d317d7a-f13a-4512-9dbb-1f40f69031cb (service), filesystem_pool: Some(ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 21441bb6-7ed9-4a23-91b8-3b05cb12d9be (service), filesystem_pool: Some(ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: fb10fea9-36d5-42a4-9bd1-be85290923fe (service), filesystem_pool: Some(ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External } } } }, OmicronZoneConfig { id: ffa3c7f5-edad-49e3-89f8-cc158f82d442 (service), filesystem_pool: Some(ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7f673996-71f3-460d-8744-05523682c460 (service), filesystem_pool: Some(ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 689b4313-df50-4333-a289-9b10cf7a7050 (service), filesystem_pool: Some(ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External } } } }, OmicronZoneConfig { id: 2f42c619-047c-4816-8c03-1b4b869f74ee (service), filesystem_pool: Some(ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External } } } }, OmicronZoneConfig { id: 4b9925c3-a895-43c4-bcfa-3fddb51cc112 (service), filesystem_pool: Some(ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External } } } }, OmicronZoneConfig { id: 02ea87e1-ad72-4067-9c09-1c75a6db0346 (service), filesystem_pool: Some(ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6b405e8e-f031-4046-b8ac-dfbaf3c5ea98 (service), filesystem_pool: Some(ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6c1355e5-9754-43a6-8942-2feda17ecc62 (service), filesystem_pool: Some(ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11932025-01-09T01:32:59.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62258
11942025-01-09T01:32:59.251ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11952025-01-09T01:32:59.251ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11962025-01-09T01:32:59.268ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11972025-01-09T01:32:59.268ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11982025-01-09T01:32:59.280ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11992025-01-09T01:32:59.280ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12002025-01-09T01:32:59.291ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12012025-01-09T01:32:59.291ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12022025-01-09T01:32:59.302ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12032025-01-09T01:32:59.302ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12042025-01-09T01:32:59.312ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12052025-01-09T01:32:59.312ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12062025-01-09T01:32:59.322ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12072025-01-09T01:32:59.322ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Cockroach }, responder: ... }
12082025-01-09T01:32:59.332ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12092025-01-09T01:32:59.332ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Cockroach }, responder: ... }
12102025-01-09T01:32:59.343ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12112025-01-09T01:32:59.343ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12122025-01-09T01:32:59.355ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12132025-01-09T01:32:59.355ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12142025-01-09T01:32:59.365ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12152025-01-09T01:32:59.366ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12162025-01-09T01:32:59.376ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12172025-01-09T01:32:59.376ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, kind: Crucible }, responder: ... }
12182025-01-09T01:32:59.388ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12192025-01-09T01:32:59.388ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, kind: Crucible }, responder: ... }
12202025-01-09T01:32:59.399ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12212025-01-09T01:32:59.399ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, kind: Crucible }, responder: ... }
12222025-01-09T01:32:59.408ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12232025-01-09T01:32:59.408ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, kind: Crucible }, responder: ... }
12242025-01-09T01:32:59.417ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12252025-01-09T01:32:59.417ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, kind: Crucible }, responder: ... }
12262025-01-09T01:32:59.427ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12272025-01-09T01:32:59.427ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, kind: Crucible }, responder: ... }
12282025-01-09T01:32:59.439ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12292025-01-09T01:32:59.439ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, kind: Crucible }, responder: ... }
12302025-01-09T01:32:59.452ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12312025-01-09T01:32:59.452ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, kind: Crucible }, responder: ... }
12322025-01-09T01:32:59.464ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12332025-01-09T01:32:59.464ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, kind: Crucible }, responder: ... }
12342025-01-09T01:32:59.475ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12352025-01-09T01:32:59.475ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:177
12362025-01-09T01:32:59.475ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:177
12372025-01-09T01:32:59.476ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12382025-01-09T01:32:59.595ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12392025-01-09T01:32:59.595ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12402025-01-09T01:32:59.619ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12412025-01-09T01:32:59.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12422025-01-09T01:32:59.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12432025-01-09T01:32:59.643ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12442025-01-09T01:32:59.644ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12452025-01-09T01:32:59.645ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12462025-01-09T01:32:59.670ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12472025-01-09T01:32:59.670ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12482025-01-09T01:32:59.670ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12492025-01-09T01:32:59.861ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12502025-01-09T01:32:59.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12512025-01-09T01:32:59.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12522025-01-09T01:32:59.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12532025-01-09T01:32:59.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12542025-01-09T01:32:59.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12552025-01-09T01:32:59.862ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12562025-01-09T01:32:59.874ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12572025-01-09T01:32:59.874ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346 file = illumos-utils/src/zone.rs:325
12582025-01-09T01:32:59.880ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98 file = illumos-utils/src/zone.rs:325
12592025-01-09T01:32:59.885ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62 file = illumos-utils/src/zone.rs:325
12602025-01-09T01:32:59.890ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112 file = illumos-utils/src/zone.rs:325
12612025-01-09T01:32:59.896ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec file = illumos-utils/src/zone.rs:325
12622025-01-09T01:32:59.901ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb file = illumos-utils/src/zone.rs:325
12632025-01-09T01:32:59.906ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442 file = illumos-utils/src/zone.rs:325
12642025-01-09T01:33:00.047ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346 file = illumos-utils/src/zone.rs:363
12652025-01-09T01:33:00.051ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98 file = illumos-utils/src/zone.rs:363
12662025-01-09T01:33:00.055ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62 file = illumos-utils/src/zone.rs:363
12672025-01-09T01:33:00.060ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112 file = illumos-utils/src/zone.rs:363
12682025-01-09T01:33:00.066ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec file = illumos-utils/src/zone.rs:363
12692025-01-09T01:33:00.071ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb file = illumos-utils/src/zone.rs:363
12702025-01-09T01:33:00.077ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442 file = illumos-utils/src/zone.rs:363
12712025-01-09T01:33:00.082ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a file = illumos-utils/src/zone.rs:325
12722025-01-09T01:33:00.087ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050 file = illumos-utils/src/zone.rs:325
12732025-01-09T01:33:00.092ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe file = illumos-utils/src/zone.rs:325
12742025-01-09T01:33:00.097ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be file = illumos-utils/src/zone.rs:325
12752025-01-09T01:33:00.102ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189 file = illumos-utils/src/zone.rs:325
12762025-01-09T01:33:00.108ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7f673996-71f3-460d-8744-05523682c460 file = illumos-utils/src/zone.rs:325
12772025-01-09T01:33:00.115ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee file = illumos-utils/src/zone.rs:325
12782025-01-09T01:33:00.179ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12792025-01-09T01:33:00.180ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a file = illumos-utils/src/zone.rs:363
12802025-01-09T01:33:00.190ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050 file = illumos-utils/src/zone.rs:363
12812025-01-09T01:33:00.200ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe file = illumos-utils/src/zone.rs:363
12822025-01-09T01:33:00.208ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be file = illumos-utils/src/zone.rs:363
12832025-01-09T01:33:00.217ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189 file = illumos-utils/src/zone.rs:363
12842025-01-09T01:33:00.226ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7f673996-71f3-460d-8744-05523682c460 file = illumos-utils/src/zone.rs:363
12852025-01-09T01:33:00.241ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee file = illumos-utils/src/zone.rs:363
12862025-01-09T01:33:00.302ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12872025-01-09T01:33:00.362ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12882025-01-09T01:33:00.419ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12892025-01-09T01:33:00.476ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12902025-01-09T01:33:00.483ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12912025-01-09T01:33:00.483ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12922025-01-09T01:33:00.548ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 252, 133]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12932025-01-09T01:33:00.550ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12942025-01-09T01:33:00.553ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12952025-01-09T01:33:00.553ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12962025-01-09T01:33:00.653ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 243, 43]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12972025-01-09T01:33:00.653ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12982025-01-09T01:33:00.661ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12992025-01-09T01:33:00.661ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13002025-01-09T01:33:00.763ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 140, 111]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13012025-01-09T01:33:00.764ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
13022025-01-09T01:33:00.766ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13032025-01-09T01:33:00.766ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13042025-01-09T01:33:00.825ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 246, 182]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13052025-01-09T01:33:00.825ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
13062025-01-09T01:33:00.827ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13072025-01-09T01:33:00.827ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13082025-01-09T01:33:00.914ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 218, 217]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13092025-01-09T01:33:00.914ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
13102025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13112025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13122025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13132025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13142025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13152025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13162025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13172025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13182025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13192025-01-09T01:33:00.932ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13202025-01-09T01:33:00.966ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13212025-01-09T01:33:00.968ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13222025-01-09T01:33:00.971ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13232025-01-09T01:33:00.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13242025-01-09T01:33:00.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13252025-01-09T01:33:00.973ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13262025-01-09T01:33:00.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13272025-01-09T01:33:00.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13282025-01-09T01:33:00.976ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13292025-01-09T01:33:01.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13302025-01-09T01:33:01.261ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a file = illumos-utils/src/zone.rs:325
13312025-01-09T01:33:01.273ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc file = illumos-utils/src/zone.rs:325
13322025-01-09T01:33:01.282ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096 file = illumos-utils/src/zone.rs:325
13332025-01-09T01:33:01.293ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22 file = illumos-utils/src/zone.rs:325
13342025-01-09T01:33:01.308ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9 file = illumos-utils/src/zone.rs:325
13352025-01-09T01:33:01.411ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096 file = illumos-utils/src/zone.rs:363
13362025-01-09T01:33:01.423ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a file = illumos-utils/src/zone.rs:363
13372025-01-09T01:33:01.437ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc file = illumos-utils/src/zone.rs:363
13382025-01-09T01:33:01.447ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9 file = illumos-utils/src/zone.rs:363
13392025-01-09T01:33:01.461ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22 file = illumos-utils/src/zone.rs:363
13402025-01-09T01:33:11.239ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412025-01-09T01:33:11.264ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422025-01-09T01:33:11.293ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
13432025-01-09T01:33:11.597ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
13442025-01-09T01:33:11.619ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13452025-01-09T01:33:11.619ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
13462025-01-09T01:33:11.692ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6f48c4e3-656c-4f59-90f9-c3dc78a7a790'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13472025-01-09T01:33:11.693ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
13482025-01-09T01:33:11.702ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7f673996-71f3-460d-8744-05523682c460: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7dcba2bb-19e6-4b1c-90aa-d986d5f63fe0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13492025-01-09T01:33:11.702ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6ff08246-782d-4058-9e5f-ff095db6560c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e0e5ba63-5579-444b-9a91-8bfcc3c8d77f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13502025-01-09T01:33:11.703ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a5da334f-19cb-4d72-b915-499edbcccd72/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='13a2936a-c8f3-4877-8894-bf1c721811be'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13512025-01-09T01:33:11.703ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_629544c0-27f4-4020-b514-332802874b60/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='81fc9ddd-5191-4ac0-b0a7-de234b09a459'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13522025-01-09T01:33:11.703ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2d6c6d99-360d-4fdf-9830-f9b23681de9b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13532025-01-09T01:33:11.704ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c863cd74-d6b6-4658-85ba-a5ca2535d08f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13542025-01-09T01:33:11.704ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7f673996-71f3-460d-8744-05523682c460 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
13552025-01-09T01:33:11.712ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
13562025-01-09T01:33:11.719ZINFOSledAgent (ServiceManager): Booting oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
13572025-01-09T01:33:11.726ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
13582025-01-09T01:33:11.731ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
13592025-01-09T01:33:11.738ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
13602025-01-09T01:33:12.544ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='744911f7-2ab0-4d23-a048-4dd69321cf8c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13612025-01-09T01:33:12.545ZINFOSledAgent (ServiceManager): Booting oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
13622025-01-09T01:33:12.553ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e32e0cd0-eae5-4097-ae60-3cf9904f33e1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13632025-01-09T01:33:12.553ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
13642025-01-09T01:33:13.334ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13652025-01-09T01:33:13.334ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
13662025-01-09T01:33:14.923ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13672025-01-09T01:33:14.988ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13682025-01-09T01:33:14.988ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
13692025-01-09T01:33:15.219ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
13702025-01-09T01:33:17.163ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13712025-01-09T01:33:17.163ZINFOSledAgent (ServiceManager): Booting oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
13722025-01-09T01:33:17.171ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13732025-01-09T01:33:17.171ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13742025-01-09T01:33:17.171ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
13752025-01-09T01:33:17.178ZINFOSledAgent (ServiceManager): Booting oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
13762025-01-09T01:33:18.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 34.693431ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
13772025-01-09T01:33:18.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 69.251886ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
13782025-01-09T01:33:18.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 65.233799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
13792025-01-09T01:33:18.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 51.785909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
13802025-01-09T01:33:18.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 62.632583ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
13812025-01-09T01:33:18.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 45.391903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
13822025-01-09T01:33:18.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 52.055021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
13832025-01-09T01:33:18.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 36.100354ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
13842025-01-09T01:33:18.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 45.672092ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
13852025-01-09T01:33:18.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 52.750552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
13862025-01-09T01:33:18.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 59.614959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
13872025-01-09T01:33:18.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 29.193232ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
13882025-01-09T01:33:18.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 35.57199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
13892025-01-09T01:33:18.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 47.677519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
13902025-01-09T01:33:18.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 42.566201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
13912025-01-09T01:33:18.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 26.186221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
13922025-01-09T01:33:18.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 67.072842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
13932025-01-09T01:33:18.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 35.923192ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
13942025-01-09T01:33:18.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 54.182321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
13952025-01-09T01:33:18.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 148.556213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
13962025-01-09T01:33:18.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 111.542782ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
13972025-01-09T01:33:18.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 126.492548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
13982025-01-09T01:33:18.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 87.353415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
13992025-01-09T01:33:18.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 140.549043ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
14002025-01-09T01:33:18.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 73.222954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
14012025-01-09T01:33:19.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 103.547151ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
14022025-01-09T01:33:19.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 58.866054ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
14032025-01-09T01:33:19.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 110.735016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
14042025-01-09T01:33:19.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 140.554682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
14052025-01-09T01:33:19.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 136.386828ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
14062025-01-09T01:33:19.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 136.3413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
14072025-01-09T01:33:19.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 116.100915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
14082025-01-09T01:33:19.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 111.430288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
14092025-01-09T01:33:19.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 128.315655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
14102025-01-09T01:33:19.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 58.645492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
14112025-01-09T01:33:19.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 111.76055ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
14122025-01-09T01:33:19.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 81.488139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
14132025-01-09T01:33:19.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 209.220781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
14142025-01-09T01:33:19.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 375.215319ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
14152025-01-09T01:33:19.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 292.412353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
14162025-01-09T01:33:19.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 152.908889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
14172025-01-09T01:33:19.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 143.851819ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
14182025-01-09T01:33:19.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 242.174241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
14192025-01-09T01:33:19.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 278.310567ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
14202025-01-09T01:33:19.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 238.58019ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
14212025-01-09T01:33:19.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 283.7409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
14222025-01-09T01:33:19.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 243.044499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
14232025-01-09T01:33:19.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 194.429085ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
14242025-01-09T01:33:19.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 121.032381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
14252025-01-09T01:33:19.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 289.485476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
14262025-01-09T01:33:19.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 104.187242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
14272025-01-09T01:33:19.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 145.756906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
14282025-01-09T01:33:19.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 243.302066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
14292025-01-09T01:33:19.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 111.129243ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
14302025-01-09T01:33:19.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 293.377045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
14312025-01-09T01:33:19.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 228.415512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
14322025-01-09T01:33:19.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 372.534784ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
14332025-01-09T01:33:19.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 225.320531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
14342025-01-09T01:33:19.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 314.683833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
14352025-01-09T01:33:19.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 559.225496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
14362025-01-09T01:33:19.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 256.167618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
14372025-01-09T01:33:19.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 580.244099ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
14382025-01-09T01:33:19.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 494.637993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
14392025-01-09T01:33:19.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 559.043923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
14402025-01-09T01:33:19.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 525.783936ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
14412025-01-09T01:33:19.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 361.123465ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
14422025-01-09T01:33:19.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 270.393749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
14432025-01-09T01:33:19.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 386.90852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
14442025-01-09T01:33:19.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 575.096967ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
14452025-01-09T01:33:19.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 472.493127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
14462025-01-09T01:33:19.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 270.667364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
14472025-01-09T01:33:19.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 670.857584ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
14482025-01-09T01:33:19.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 584.620975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
14492025-01-09T01:33:19.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 205.809775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
14502025-01-09T01:33:19.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.113758979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
14512025-01-09T01:33:19.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 666.38024ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
14522025-01-09T01:33:19.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 939.753513ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
14532025-01-09T01:33:19.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 992.000406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
14542025-01-09T01:33:19.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 431.660079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
14552025-01-09T01:33:19.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 893.933161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
14562025-01-09T01:33:19.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 1.182363847s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
14572025-01-09T01:33:19.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 558.424383ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
14582025-01-09T01:33:19.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 541.317856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
14592025-01-09T01:33:20.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 1.122335171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
14602025-01-09T01:33:20.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 423.35115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
14612025-01-09T01:33:20.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 694.500803ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
14622025-01-09T01:33:20.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 630.294878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
14632025-01-09T01:33:20.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 1.17618785s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
14642025-01-09T01:33:20.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 943.488406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
14652025-01-09T01:33:20.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 969.316192ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
14662025-01-09T01:33:20.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 716.626101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
14672025-01-09T01:33:20.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 990.338175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
14682025-01-09T01:33:20.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 1.389793694s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
14692025-01-09T01:33:20.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 1.383217266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
14702025-01-09T01:33:20.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 972.637133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
14712025-01-09T01:33:20.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 992.000128ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
14722025-01-09T01:33:20.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 840.99178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
14732025-01-09T01:33:20.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 512.081341ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
14742025-01-09T01:33:20.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.07666398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
14752025-01-09T01:33:20.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.467513745s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
14762025-01-09T01:33:20.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 885.457123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
14772025-01-09T01:33:20.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 1.257454178s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
14782025-01-09T01:33:20.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 1.347140811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
14792025-01-09T01:33:20.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 1.216963052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
14802025-01-09T01:33:21.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 749.91936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
14812025-01-09T01:33:21.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 1.047294706s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
14822025-01-09T01:33:21.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 555.200803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
14832025-01-09T01:33:21.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 1.283186227s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
14842025-01-09T01:33:21.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 1.410653804s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
14852025-01-09T01:33:21.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 1.342845233s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
14862025-01-09T01:33:21.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 624.527265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
14872025-01-09T01:33:21.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 1.085389242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
14882025-01-09T01:33:21.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 641.259301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
14892025-01-09T01:33:21.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 1.277312387s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
14902025-01-09T01:33:21.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 971.098847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
14912025-01-09T01:33:21.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 605.208276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
14922025-01-09T01:33:21.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.216304741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
14932025-01-09T01:33:21.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 1.127839598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
14942025-01-09T01:33:21.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 916.188067ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
14952025-01-09T01:33:21.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 1.282712676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
14962025-01-09T01:33:22.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 844.620759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
14972025-01-09T01:33:22.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 1.29186628s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
14982025-01-09T01:33:22.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 820.138139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
14992025-01-09T01:33:22.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 733.706516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
15002025-01-09T01:33:22.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 972.147852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
15012025-01-09T01:33:22.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 1.256104351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
15022025-01-09T01:33:22.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.134663656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
15032025-01-09T01:33:22.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 767.138569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
15042025-01-09T01:33:22.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 669.824386ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
15052025-01-09T01:33:22.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 1.384233445s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
15062025-01-09T01:33:22.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 1.409445165s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
15072025-01-09T01:33:22.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 1.441955076s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
15082025-01-09T01:33:22.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.307189818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
15092025-01-09T01:33:22.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 1.430924453s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
15102025-01-09T01:33:22.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 1.037485875s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
15112025-01-09T01:33:22.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 815.449091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
15122025-01-09T01:33:22.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 612.509535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
15132025-01-09T01:33:22.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 1.109809247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
15142025-01-09T01:33:22.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 1.42255049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
15152025-01-09T01:33:23.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 997.759258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
15162025-01-09T01:33:23.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 678.686403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
15172025-01-09T01:33:23.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 1.458127656s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
15182025-01-09T01:33:23.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 1.419539328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
15192025-01-09T01:33:23.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 1.11376039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
15202025-01-09T01:33:23.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 769.883283ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
15212025-01-09T01:33:23.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 791.110973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
15222025-01-09T01:33:23.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 1.33016507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
15232025-01-09T01:33:23.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 754.222722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
15242025-01-09T01:33:23.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 920.458724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
15252025-01-09T01:33:23.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 1.230366664s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
15262025-01-09T01:33:23.931ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15272025-01-09T01:33:23.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 554.591982ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
15282025-01-09T01:33:23.942ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
15292025-01-09T01:33:23.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 714.798582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
15302025-01-09T01:33:23.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 504.858603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
15312025-01-09T01:33:24.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.037805529s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
15322025-01-09T01:33:24.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 1.375390087s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
15332025-01-09T01:33:24.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 641.600919ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
15342025-01-09T01:33:24.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 42.112682ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
15352025-01-09T01:33:24.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 701.558829ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
15362025-01-09T01:33:24.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 115.957566ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
15372025-01-09T01:33:24.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 637.019137ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
15382025-01-09T01:33:24.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 750.18228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
15392025-01-09T01:33:24.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 1.246476778s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
15402025-01-09T01:33:24.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 223.736759ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
15412025-01-09T01:33:24.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 712.06439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
15422025-01-09T01:33:24.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 556.546648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
15432025-01-09T01:33:24.440ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.024850869s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
15442025-01-09T01:33:24.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 1.10101619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
15452025-01-09T01:33:24.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 1.349787725s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
15462025-01-09T01:33:24.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 773.505214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
15472025-01-09T01:33:24.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 294.040891ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
15482025-01-09T01:33:24.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 1.45189808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
15492025-01-09T01:33:24.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 1.453316129s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
15502025-01-09T01:33:24.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 684.612578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
15512025-01-09T01:33:24.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 1.338667462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
15522025-01-09T01:33:24.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 618.834545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
15532025-01-09T01:33:24.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 942.139278ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
15542025-01-09T01:33:24.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 1.482526423s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
15552025-01-09T01:33:24.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 1.006411242s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
15562025-01-09T01:33:24.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 602.0049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
15572025-01-09T01:33:24.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 992.533726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
15582025-01-09T01:33:24.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.157946885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
15592025-01-09T01:33:25.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 548.972362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
15602025-01-09T01:33:25.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 1.031019053s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
15612025-01-09T01:33:25.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.254607253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
15622025-01-09T01:33:25.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 882.584306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
15632025-01-09T01:33:25.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 1.181972246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
15642025-01-09T01:33:25.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 1.056777453s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
15652025-01-09T01:33:25.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 622.284964ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
15662025-01-09T01:33:25.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 1.211733825s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
15672025-01-09T01:33:25.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 1.018349678s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
15682025-01-09T01:33:25.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 1.147892839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
15692025-01-09T01:33:25.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 778.732923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
15702025-01-09T01:33:25.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 1.207543221s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
15712025-01-09T01:33:25.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 766.967418ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
15722025-01-09T01:33:25.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 1.203411011s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
15732025-01-09T01:33:25.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 1.273252372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
15742025-01-09T01:33:26.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 820.764735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
15752025-01-09T01:33:26.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 687.299879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
15762025-01-09T01:33:26.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 1.093484111s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
15772025-01-09T01:33:26.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 531.977707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
15782025-01-09T01:33:26.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 795.31179ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
15792025-01-09T01:33:26.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.17859607s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
15802025-01-09T01:33:26.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.458886602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
15812025-01-09T01:33:26.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 1.466650982s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
15822025-01-09T01:33:26.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.058805413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
15832025-01-09T01:33:26.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 1.116411556s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
15842025-01-09T01:33:26.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 1.047027519s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
15852025-01-09T01:33:26.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 1.403111082s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
15862025-01-09T01:33:26.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 531.95636ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
15872025-01-09T01:33:26.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 953.263587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
15882025-01-09T01:33:26.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 1.491567337s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
15892025-01-09T01:33:26.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 830.511321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
15902025-01-09T01:33:26.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 655.252461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
15912025-01-09T01:33:26.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 1.063050244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
15922025-01-09T01:33:26.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 652.989791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
15932025-01-09T01:33:26.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 936.350521ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
15942025-01-09T01:33:26.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 601.272394ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
15952025-01-09T01:33:27.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 1.149058995s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
15962025-01-09T01:33:27.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 766.704265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
15972025-01-09T01:33:27.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 1.22830748s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
15982025-01-09T01:33:27.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 736.184928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
15992025-01-09T01:33:27.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 692.137875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
16002025-01-09T01:33:27.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 1.092189327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
16012025-01-09T01:33:27.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.294539304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
16022025-01-09T01:33:27.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 751.597976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
16032025-01-09T01:33:27.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 924.257983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
16042025-01-09T01:33:27.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 720.220155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
16052025-01-09T01:33:27.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 765.234514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
16062025-01-09T01:33:27.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 505.745364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
16072025-01-09T01:33:27.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 1.213032511s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
16082025-01-09T01:33:27.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.176771184s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
16092025-01-09T01:33:27.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 1.193885244s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
16102025-01-09T01:33:27.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 504.805825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
16112025-01-09T01:33:27.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 939.60112ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
16122025-01-09T01:33:27.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 1.220350823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
16132025-01-09T01:33:27.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 937.645914ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
16142025-01-09T01:33:27.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 997.769756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
16152025-01-09T01:33:28.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.187824977s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
16162025-01-09T01:33:28.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 1.421521911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
16172025-01-09T01:33:28.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 1.250176247s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
16182025-01-09T01:33:28.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 1.374222293s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
16192025-01-09T01:33:28.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 1.003855335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
16202025-01-09T01:33:28.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 643.977893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
16212025-01-09T01:33:28.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 767.689894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
16222025-01-09T01:33:28.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 588.836519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
16232025-01-09T01:33:28.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 735.721939ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
16242025-01-09T01:33:28.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 1.358544378s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
16252025-01-09T01:33:28.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 869.591283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
16262025-01-09T01:33:28.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 621.305751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
16272025-01-09T01:33:28.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 988.808753ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
16282025-01-09T01:33:28.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 724.063087ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
16292025-01-09T01:33:28.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.027731285s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
16302025-01-09T01:33:28.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 1.156705641s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
16312025-01-09T01:33:28.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 527.468385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
16322025-01-09T01:33:28.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 1.475888101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
16332025-01-09T01:33:28.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 1.376039371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
16342025-01-09T01:33:29.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 969.903049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
16352025-01-09T01:33:29.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 675.936134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
16362025-01-09T01:33:29.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 1.141347828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
16372025-01-09T01:33:29.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 660.152317ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
16382025-01-09T01:33:29.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.397911667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
16392025-01-09T01:33:29.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 1.221286119s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
16402025-01-09T01:33:29.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 580.238627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
16412025-01-09T01:33:29.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 659.488256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
16422025-01-09T01:33:29.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 1.212476969s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
16432025-01-09T01:33:29.401ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52298
16442025-01-09T01:33:29.417ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13815 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52298 req_id = 9c673a84-a094-438d-bfd1-ecb999f1ac41 response_code = 200 uri = /baseboard
16452025-01-09T01:33:29.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 1.361007647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
16462025-01-09T01:33:29.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 763.604429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
16472025-01-09T01:33:29.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 591.121488ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
16482025-01-09T01:33:29.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 693.469233ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
16492025-01-09T01:33:29.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 1.435121446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
16502025-01-09T01:33:29.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 1.139786777s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
16512025-01-09T01:33:29.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 789.244674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
16522025-01-09T01:33:29.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 865.093426ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
16532025-01-09T01:33:29.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.156980992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
16542025-01-09T01:33:29.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 762.20669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
16552025-01-09T01:33:29.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 1.011230962s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
16562025-01-09T01:33:30.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 1.061435077s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
16572025-01-09T01:33:30.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.161321296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
16582025-01-09T01:33:30.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 1.469028874s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
16592025-01-09T01:33:30.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 597.757879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
16602025-01-09T01:33:30.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 1.11909858s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
16612025-01-09T01:33:30.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 863.443434ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
16622025-01-09T01:33:30.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 903.85018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
16632025-01-09T01:33:30.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 642.258452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
16642025-01-09T01:33:30.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 607.549628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
16652025-01-09T01:33:30.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 1.44748211s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
16662025-01-09T01:33:30.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 641.84683ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
16672025-01-09T01:33:30.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.18435373s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
16682025-01-09T01:33:30.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 1.214836339s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
16692025-01-09T01:33:30.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 862.107118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
16702025-01-09T01:33:30.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 1.034706812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
16712025-01-09T01:33:30.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 1.370661438s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
16722025-01-09T01:33:30.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 1.446389498s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
16732025-01-09T01:33:31.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 967.877836ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
16742025-01-09T01:33:31.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.349847129s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
16752025-01-09T01:33:31.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 943.218751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
16762025-01-09T01:33:31.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 736.317963ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
16772025-01-09T01:33:31.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 1.48940244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
16782025-01-09T01:33:31.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 1.130019234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
16792025-01-09T01:33:31.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 535.873799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
16802025-01-09T01:33:31.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 518.274894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
16812025-01-09T01:33:31.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 1.215805231s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
16822025-01-09T01:33:31.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 682.453953ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
16832025-01-09T01:33:31.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 792.29325ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
16842025-01-09T01:33:31.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 612.042649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
16852025-01-09T01:33:31.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 1.232261744s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
16862025-01-09T01:33:31.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 769.802427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
16872025-01-09T01:33:31.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 685.456913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
16882025-01-09T01:33:31.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 677.281717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
16892025-01-09T01:33:31.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 868.405009ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
16902025-01-09T01:33:31.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 543.585817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
16912025-01-09T01:33:31.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 669.251424ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
16922025-01-09T01:33:31.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 822.138681ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
16932025-01-09T01:33:31.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 1.268505045s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
16942025-01-09T01:33:32.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 655.007122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
16952025-01-09T01:33:32.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 1.471619699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
16962025-01-09T01:33:32.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 1.223652838s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
16972025-01-09T01:33:32.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 629.677194ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
16982025-01-09T01:33:32.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 986.913119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
16992025-01-09T01:33:32.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 1.078932555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
17002025-01-09T01:33:32.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 786.621165ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
17012025-01-09T01:33:32.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.465373557s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
17022025-01-09T01:33:32.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 1.042161387s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
17032025-01-09T01:33:32.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 826.573693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
17042025-01-09T01:33:32.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 934.611214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
17052025-01-09T01:33:32.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.178147109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
17062025-01-09T01:33:32.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.216209926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
17072025-01-09T01:33:32.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 1.466770149s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
17082025-01-09T01:33:32.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 946.853768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
17092025-01-09T01:33:32.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 1.393876258s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
17102025-01-09T01:33:32.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 683.313997ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
17112025-01-09T01:33:32.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 1.310975773s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
17122025-01-09T01:33:32.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 986.817364ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
17132025-01-09T01:33:32.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 503.221647ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
17142025-01-09T01:33:33.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 585.43623ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
17152025-01-09T01:33:33.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 606.578448ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
17162025-01-09T01:33:33.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 1.309398813s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
17172025-01-09T01:33:33.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 573.779735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
17182025-01-09T01:33:33.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 1.31496239s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
17192025-01-09T01:33:33.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 1.206486914s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
17202025-01-09T01:33:33.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 1.140216587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
17212025-01-09T01:33:33.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 685.021991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
17222025-01-09T01:33:33.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 1.455105118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
17232025-01-09T01:33:33.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 1.061601231s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
17242025-01-09T01:33:33.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 638.537891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
17252025-01-09T01:33:33.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 1.280796079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
17262025-01-09T01:33:33.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 654.686394ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
17272025-01-09T01:33:33.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.336421826s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
17282025-01-09T01:33:33.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.326309766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
17292025-01-09T01:33:33.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 1.413335936s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
17302025-01-09T01:33:33.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 806.48482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
17312025-01-09T01:33:33.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 1.470607859s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
17322025-01-09T01:33:34.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 1.322172937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
17332025-01-09T01:33:34.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 537.87342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
17342025-01-09T01:33:34.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 829.824421ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
17352025-01-09T01:33:34.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 1.033273536s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
17362025-01-09T01:33:34.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 505.241555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
17372025-01-09T01:33:34.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 978.830834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
17382025-01-09T01:33:34.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 749.992421ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
17392025-01-09T01:33:34.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 743.289741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
17402025-01-09T01:33:34.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62") failed: Property not found. retry in 1.117775354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
17412025-01-09T01:33:34.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 709.319722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
17422025-01-09T01:33:34.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 570.858082ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
17432025-01-09T01:33:34.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 1.111241094s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
17442025-01-09T01:33:34.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 1.102122137s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
17452025-01-09T01:33:34.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.398762552s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
17462025-01-09T01:33:34.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 660.298491ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
17472025-01-09T01:33:34.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 1.100729557s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
17482025-01-09T01:33:34.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 1.129244253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
17492025-01-09T01:33:34.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 592.719154ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
17502025-01-09T01:33:35.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 749.972939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
17512025-01-09T01:33:35.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 613.359707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
17522025-01-09T01:33:35.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 754.27202ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
17532025-01-09T01:33:35.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 936.582819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
17542025-01-09T01:33:35.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 1.288039035s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
17552025-01-09T01:33:35.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc") failed: Property not found. retry in 849.778656ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
17562025-01-09T01:33:35.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 635.70464ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
17572025-01-09T01:33:35.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 1.284212258s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
17582025-01-09T01:33:35.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 735.002729ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
17592025-01-09T01:33:35.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 691.753873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
17602025-01-09T01:33:35.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 621.661094ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
17612025-01-09T01:33:35.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 956.759614ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
17622025-01-09T01:33:35.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 612.277502ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
17632025-01-09T01:33:35.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 556.941351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
17642025-01-09T01:33:35.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 893.36921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
17652025-01-09T01:33:35.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7f673996-71f3-460d-8744-05523682c460") failed: Property not found. retry in 691.475538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
17662025-01-09T01:33:35.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 1.040781923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
17672025-01-09T01:33:35.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 840.631301ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
17682025-01-09T01:33:35.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 1.397875301s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
17692025-01-09T01:33:36.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 646.539375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
17702025-01-09T01:33:36.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 839.693775ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
17712025-01-09T01:33:36.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 1.022888335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
17722025-01-09T01:33:36.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 825.673797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
17732025-01-09T01:33:36.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 1.105498675s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
17742025-01-09T01:33:36.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 1.009615938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
17752025-01-09T01:33:36.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.129533456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
17762025-01-09T01:33:36.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a") failed: Property not found. retry in 1.261141982s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
17772025-01-09T01:33:36.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 1.010547335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
17782025-01-09T01:33:36.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 755.334099ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
17792025-01-09T01:33:36.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 521.517481ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
17802025-01-09T01:33:36.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 1.079416946s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
17812025-01-09T01:33:36.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189") failed: Property not found. retry in 1.456151797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
17822025-01-09T01:33:36.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be") failed: Property not found. retry in 613.825548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
17832025-01-09T01:33:36.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 709.929356ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
17842025-01-09T01:33:36.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096") failed: Property not found. retry in 1.128659369s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
17852025-01-09T01:33:36.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 953.452093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
17862025-01-09T01:33:36.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 630.121979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
17872025-01-09T01:33:37.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22") failed: Property not found. retry in 1.000668692s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
17882025-01-09T01:33:37.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb") failed: Property not found. retry in 673.744401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
17892025-01-09T01:33:37.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442") failed: Property not found. retry in 1.010930258s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
17902025-01-09T01:33:37.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9") failed: Property not found. retry in 1.266367956s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
17912025-01-09T01:33:37.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 696.645405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
17922025-01-09T01:33:37.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346") failed: Property not found. retry in 1.408289658s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
17932025-01-09T01:33:37.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 532.647457ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
17942025-01-09T01:33:37.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee") failed: Property not found. retry in 643.79496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
17952025-01-09T01:33:37.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a") failed: Property not found. retry in 1.440467719s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
17962025-01-09T01:33:37.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe") failed: Property not found. retry in 583.802588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
17972025-01-09T01:33:37.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98") failed: Property not found. retry in 989.99613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
17982025-01-09T01:33:37.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050") failed: Property not found. retry in 963.285744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
17992025-01-09T01:33:37.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 529.454968ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
18002025-01-09T01:33:37.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112") failed: Property not found. retry in 1.142570153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
18012025-01-09T01:33:38.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec") failed: Property not found. retry in 608.266073ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
18022025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_02ea87e1-ad72-4067-9c09-1c75a6db0346
18032025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_94da342f-e446-47fd-a8fe-112f8b9a9fc9
18042025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_6b405e8e-f031-4046-b8ac-dfbaf3c5ea98
18052025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_6c1355e5-9754-43a6-8942-2feda17ecc62
18062025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_3ca012d2-322f-4398-94cf-49e9d02ebe0a
18072025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_4b9925c3-a895-43c4-bcfa-3fddb51cc112
18082025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_d28db04c-86dc-4788-b08f-467ff8a673dc
18092025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_74d09270-c94b-4c18-b2b3-d5f83a0dc096
18102025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_clickhouse_9ea55d6e-bfe1-41bd-83b2-e6b52df5ecec
18112025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_1d317d7a-f13a-4512-9dbb-1f40f69031cb
18122025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_ffa3c7f5-edad-49e3-89f8-cc158f82d442
18132025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_oximeter_ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a
18142025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_689b4313-df50-4333-a289-9b10cf7a7050
18152025-01-09T01:33:39.233ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_fb10fea9-36d5-42a4-9bd1-be85290923fe
18162025-01-09T01:33:39.234ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_21441bb6-7ed9-4a23-91b8-3b05cb12d9be
18172025-01-09T01:33:39.234ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_3155a5a4-e862-487e-9a3f-c9900ca9a189
18182025-01-09T01:33:39.234ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_7f673996-71f3-460d-8744-05523682c460
18192025-01-09T01:33:39.234ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_5cb79fd4-3b79-4466-bb86-657f7f0ada22
18202025-01-09T01:33:39.234ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_2f42c619-047c-4816-8c03-1b4b869f74ee
18212025-01-09T01:33:39.236ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18222025-01-09T01:33:39.239ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18232025-01-09T01:33:39.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39991726 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62258 req_id = 74c7f8a7-4898-40af-9ba2-7519fe213f77 response_code = 204 uri = /omicron-zones
18242025-01-09T01:33:39.251ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
18252025-01-09T01:33:39.439ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18262025-01-09T01:33:39.442ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
18272025-01-09T01:33:39.500ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
18282025-01-09T01:33:40.515ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18292025-01-09T01:33:40.517ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 46.008179423s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
18302025-01-09T01:33:40.642ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18312025-01-09T01:33:40.772ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18322025-01-09T01:33:40.868ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18332025-01-09T01:33:41.121ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18342025-01-09T01:33:41.278ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18352025-01-09T01:33:41.603ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18362025-01-09T01:33:41.906ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18372025-01-09T01:33:42.210ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18382025-01-09T01:33:42.772ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18392025-01-09T01:33:43.036ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18402025-01-09T01:33:43.571ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/59b29299-38cc-4366-91a5-ce2131096a5f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18412025-01-09T01:33:44.823ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7fce6063-daa7-4dca-a006-47ff223a359e", "content-length": "173", "date": "Thu, 09 Jan 2025 01:33:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"59b29299-38cc-4366-91a5-ce2131096a5f\"", request_id: "7fce6063-daa7-4dca-a006-47ff223a359e" } file = sled-agent/src/rack_setup/service.rs:1078
18422025-01-09T01:33:46.048ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3bb59300-5b25-468f-a93b-b06408485a5f", "content-length": "173", "date": "Thu, 09 Jan 2025 01:33:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"59b29299-38cc-4366-91a5-ce2131096a5f\"", request_id: "3bb59300-5b25-468f-a93b-b06408485a5f" } file = sled-agent/src/rack_setup/service.rs:1078
18432025-01-09T01:33:48.373ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f099e7cb-e99a-48ca-bb0e-51f00be9452f", "content-length": "173", "date": "Thu, 09 Jan 2025 01:33:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "f099e7cb-e99a-48ca-bb0e-51f00be9452f" } file = sled-agent/src/rack_setup/service.rs:1078
18442025-01-09T01:33:50.286ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7eb03630-7eae-486f-979c-c534b0d69362", "content-length": "173", "date": "Thu, 09 Jan 2025 01:33:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "7eb03630-7eae-486f-979c-c534b0d69362" } file = sled-agent/src/rack_setup/service.rs:1078
18452025-01-09T01:33:52.655ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d64b0229-d112-4c0a-8c5f-142b15f746d5", "content-length": "173", "date": "Thu, 09 Jan 2025 01:33:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "d64b0229-d112-4c0a-8c5f-142b15f746d5" } file = sled-agent/src/rack_setup/service.rs:1078
18462025-01-09T01:33:54.334ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "dc072bba-0297-4f80-89f6-736625484159", "content-length": "173", "date": "Thu, 09 Jan 2025 01:33:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "dc072bba-0297-4f80-89f6-736625484159" } file = sled-agent/src/rack_setup/service.rs:1078
18472025-01-09T01:33:56.083ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a3446ec9-95df-47b2-a68d-2975df59217e", "content-length": "173", "date": "Thu, 09 Jan 2025 01:33:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "a3446ec9-95df-47b2-a68d-2975df59217e" } file = sled-agent/src/rack_setup/service.rs:1078
18482025-01-09T01:33:58.527ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c24db7f9-c7da-489d-ad09-3590e52d4b3b", "content-length": "173", "date": "Thu, 09 Jan 2025 01:33:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "c24db7f9-c7da-489d-ad09-3590e52d4b3b" } file = sled-agent/src/rack_setup/service.rs:1078
18492025-01-09T01:33:59.454ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34731
18502025-01-09T01:33:59.454ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34731 req_id = 8dae6021-3a18-4316-be58-6a52af06745c response_code = 200 uri = /baseboard
18512025-01-09T01:34:02.278ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "df57c8ff-50a9-4eec-8e32-773d9c352018", "content-length": "173", "date": "Thu, 09 Jan 2025 01:34:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "df57c8ff-50a9-4eec-8e32-773d9c352018" } file = sled-agent/src/rack_setup/service.rs:1078
18522025-01-09T01:34:07.228ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "82eecf40-9dab-47df-aa34-b0269c35a7bb", "content-length": "173", "date": "Thu, 09 Jan 2025 01:34:07 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "82eecf40-9dab-47df-aa34-b0269c35a7bb" } file = sled-agent/src/rack_setup/service.rs:1078
18532025-01-09T01:34:13.694ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "01e91312-0fad-4736-b138-d46b4e9a2c2a", "content-length": "173", "date": "Thu, 09 Jan 2025 01:34:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "01e91312-0fad-4736-b138-d46b4e9a2c2a" } file = sled-agent/src/rack_setup/service.rs:1078
18542025-01-09T01:34:20.399ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ec356f0f-0c01-4e08-86c0-377a91ea23e0", "content-length": "173", "date": "Thu, 09 Jan 2025 01:34:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"2a5ec8ce-31e5-4982-a156-7cc817b136d7\"", request_id: "ec356f0f-0c01-4e08-86c0-377a91ea23e0" } file = sled-agent/src/rack_setup/service.rs:1078
18552025-01-09T01:34:23.028ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
18562025-01-09T01:34:23.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47954
18572025-01-09T01:34:23.128ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18582025-01-09T01:34:23.128ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18592025-01-09T01:34:23.128ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:177
18602025-01-09T01:34:23.130ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:177
18612025-01-09T01:34:23.146ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18622025-01-09T01:34:23.146ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1
18632025-01-09T01:34:23.173ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18642025-01-09T01:34:23.173ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86
18652025-01-09T01:34:23.197ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18662025-01-09T01:34:23.197ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2
18672025-01-09T01:34:23.217ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18682025-01-09T01:34:23.217ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf
18692025-01-09T01:34:23.237ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18702025-01-09T01:34:23.237ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ff08246-782d-4058-9e5f-ff095db6560c
18712025-01-09T01:34:23.259ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18722025-01-09T01:34:23.259ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59
18732025-01-09T01:34:23.277ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18742025-01-09T01:34:23.277ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5da334f-19cb-4d72-b915-499edbcccd72
18752025-01-09T01:34:23.296ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18762025-01-09T01:34:23.296ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_629544c0-27f4-4020-b514-332802874b60
18772025-01-09T01:34:23.316ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18782025-01-09T01:34:23.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5
18792025-01-09T01:34:23.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47954 req_id = 4309dc21-829b-4acb-8f38-a62a1178a08f response_code = 200 uri = /inventory
18802025-01-09T01:34:29.487ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50851
18812025-01-09T01:34:29.487ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50851 req_id = 705d49c8-d0f2-45d3-abb8-4ca83694c181 response_code = 200 uri = /baseboard
18822025-01-09T01:34:30.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63541
18832025-01-09T01:34:30.642ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18842025-01-09T01:34:30.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18852025-01-09T01:34:30.643ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18862025-01-09T01:34:30.643ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18872025-01-09T01:34:30.643ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18882025-01-09T01:34:30.643ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18892025-01-09T01:34:30.643ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18902025-01-09T01:34:30.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63541 req_id = 33da7c23-375d-48ef-9c11-b359c150ccb8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18912025-01-09T01:34:30.645ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
18922025-01-09T01:34:30.648ZINFOSledAgent (RSS): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18932025-01-09T01:34:30.649ZINFOSledAgent (RSS): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18942025-01-09T01:34:30.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59977
18952025-01-09T01:34:30.839ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18962025-01-09T01:34:30.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18972025-01-09T01:34:30.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18982025-01-09T01:34:30.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18992025-01-09T01:34:30.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19002025-01-09T01:34:30.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19012025-01-09T01:34:30.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19022025-01-09T01:34:30.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59977 req_id = 2102bd84-c2f2-4a2b-a7b1-23d4a070adef response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19032025-01-09T01:34:30.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37421
19042025-01-09T01:34:30.901ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19052025-01-09T01:34:30.901ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19062025-01-09T01:34:30.901ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:177
19072025-01-09T01:34:30.902ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:177
19082025-01-09T01:34:30.915ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19092025-01-09T01:34:30.915ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1
19102025-01-09T01:34:30.938ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19112025-01-09T01:34:30.938ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86
19122025-01-09T01:34:30.959ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19132025-01-09T01:34:30.959ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2
19142025-01-09T01:34:30.980ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19152025-01-09T01:34:30.980ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf
19162025-01-09T01:34:31.000ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19172025-01-09T01:34:31.000ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ff08246-782d-4058-9e5f-ff095db6560c
19182025-01-09T01:34:31.020ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19192025-01-09T01:34:31.020ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59
19202025-01-09T01:34:31.041ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19212025-01-09T01:34:31.041ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5da334f-19cb-4d72-b915-499edbcccd72
19222025-01-09T01:34:31.060ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19232025-01-09T01:34:31.060ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_629544c0-27f4-4020-b514-332802874b60
19242025-01-09T01:34:31.081ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19252025-01-09T01:34:31.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5
19262025-01-09T01:34:31.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37421 req_id = a934f6d5-a1dc-47bc-88b4-f6c134b4afbe response_code = 200 uri = /inventory
19272025-01-09T01:34:32.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46917
19282025-01-09T01:34:32.385ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19292025-01-09T01:34:32.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19302025-01-09T01:34:32.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19312025-01-09T01:34:32.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19322025-01-09T01:34:32.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19332025-01-09T01:34:32.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19342025-01-09T01:34:32.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19352025-01-09T01:34:32.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46917 req_id = 5487184b-08ea-43a1-b692-ff7e5c27ea42 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19362025-01-09T01:34:32.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54392
19372025-01-09T01:34:32.669ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19382025-01-09T01:34:32.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19392025-01-09T01:34:32.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19402025-01-09T01:34:32.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19412025-01-09T01:34:32.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19422025-01-09T01:34:32.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19432025-01-09T01:34:32.669ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19442025-01-09T01:34:32.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54392 req_id = 55e5d001-2ac8-45c3-a032-137908654ff5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19452025-01-09T01:34:37.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37464
19462025-01-09T01:34:37.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1039 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37464 req_id = bd26d70e-314a-48de-9d13-bb10919bd886 response_code = 200 uri = /vpc-routes
19472025-01-09T01:34:37.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
19482025-01-09T01:34:37.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37464 req_id = f3f727d3-e175-43ef-beec-5798f8b90efe response_code = 204 uri = /eip-gateways
19492025-01-09T01:34:38.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3937 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37464 req_id = 13f8fcec-8d93-4c4d-9eff-ee10223fdfcc response_code = 204 uri = /vpc-routes
19502025-01-09T01:34:46.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48803
19512025-01-09T01:34:46.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48803 req_id = 35f7af5c-133d-4c98-9d57-084de4b3c7d6 response_code = 200 uri = /vpc-routes
19522025-01-09T01:34:46.975ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
19532025-01-09T01:34:46.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48803 req_id = cc6a306a-c9d3-46a7-a609-481a045c4f5b response_code = 204 uri = /eip-gateways
19542025-01-09T01:34:46.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48803 req_id = 5b3fb810-f095-4ad0-aec6-187a265c8eb8 response_code = 204 uri = /vpc-routes
19552025-01-09T01:34:47.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54508
19562025-01-09T01:34:47.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 619 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54508 req_id = 2f0c801d-d035-4f43-99e0-bee66e5b840d response_code = 200 uri = /v2p
19572025-01-09T01:34:47.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35664
19582025-01-09T01:34:47.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35664 req_id = a90575c5-bf5a-4f25-9704-d1ef50568f63 response_code = 200 uri = /vpc-routes
19592025-01-09T01:34:47.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
19602025-01-09T01:34:47.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35664 req_id = c2c9d23d-3f5c-4a81-a097-9dc0741ec817 response_code = 204 uri = /eip-gateways
19612025-01-09T01:34:47.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35664 req_id = 448a94ff-b3aa-4453-be4e-0f135558f0e5 response_code = 204 uri = /vpc-routes
19622025-01-09T01:34:47.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36408
19632025-01-09T01:34:47.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19642025-01-09T01:34:47.256ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19652025-01-09T01:34:47.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155182 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36408 req_id = 4d7095cd-c723-40e9-b49c-d7150b1e5c11 response_code = 204 uri = /switch-ports
19662025-01-09T01:34:47.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60850
19672025-01-09T01:34:47.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61168
19682025-01-09T01:34:47.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50743
19692025-01-09T01:34:47.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61168 req_id = 04321b5b-ae3f-4fb6-8e83-fb1f55c5d7bd response_code = 200 uri = /vpc-routes
19702025-01-09T01:34:47.322ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19712025-01-09T01:34:47.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60850 req_id = f34fc1b9-0232-4bbd-b2d6-b1526641aadd response_code = 200 uri = /v2p
19722025-01-09T01:34:47.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36408 req_id = 15b76275-0ece-4dce-ab27-95c3f9391bd4 response_code = 200 uri = /network-bootstore-config
19732025-01-09T01:34:47.337ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
19742025-01-09T01:34:47.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61168 req_id = 54e4eb57-a50c-490f-836b-1c638c3f5cc2 response_code = 204 uri = /eip-gateways
19752025-01-09T01:34:47.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61168 req_id = aa7c128e-7f7e-4c4a-bae6-9a18c17e5a65 response_code = 204 uri = /vpc-routes
19762025-01-09T01:34:47.365ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19772025-01-09T01:34:47.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40264
19782025-01-09T01:34:47.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40264 req_id = 9d7ec1b5-f853-4a39-864c-f49f04b4a0c6 response_code = 200 uri = /v2p
19792025-01-09T01:34:47.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104060 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50743 req_id = df6200dc-7cd3-4041-872b-0522201a450b response_code = 204 uri = /switch-ports
19802025-01-09T01:34:47.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50743 req_id = 2adefb2d-9632-4f6d-a367-42eb3f1b509a response_code = 200 uri = /network-bootstore-config
19812025-01-09T01:34:47.486ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19822025-01-09T01:34:47.486ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19832025-01-09T01:34:47.487ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19842025-01-09T01:34:47.488ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19852025-01-09T01:34:47.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4378 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36408 req_id = f465735f-5b83-4954-824f-d2847b1a4c43 response_code = 204 uri = /network-bootstore-config
19862025-01-09T01:34:47.558ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19872025-01-09T01:34:47.558ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19882025-01-09T01:34:47.558ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19892025-01-09T01:34:47.558ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19902025-01-09T01:34:47.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 909 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50743 req_id = 0ca56d96-9a6f-48ac-8037-630b8c3eb5c1 response_code = 204 uri = /network-bootstore-config
19912025-01-09T01:34:47.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62963
19922025-01-09T01:34:47.644ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19932025-01-09T01:34:47.683ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19942025-01-09T01:34:47.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94445 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62963 req_id = 0299bd6d-1e6c-42fb-80ce-b0414efc013c response_code = 204 uri = /switch-ports
19952025-01-09T01:34:47.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62963 req_id = 9c80b9cd-b901-4b65-96fd-c891e9335f71 response_code = 200 uri = /network-bootstore-config
19962025-01-09T01:34:59.310ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:56703 remote_addr = [fd00:1122:3344:101::d]:53456 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
19972025-01-09T01:34:59.336ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26379 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 31ae478d-1236-4ec6-9ead-1a43eaa4a9bd response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
19982025-01-09T01:34:59.530ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52745
19992025-01-09T01:34:59.530ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52745 req_id = ea2d9769-5402-46c2-ba6d-e42786777323 response_code = 200 uri = /baseboard
20002025-01-09T01:35:16.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53818
20012025-01-09T01:35:16.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53818 req_id = 73b0bf95-3aca-4c52-a8da-d908a99b11c9 response_code = 200 uri = /vpc-routes
20022025-01-09T01:35:16.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46039
20032025-01-09T01:35:16.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46039 req_id = 101ee970-0af0-4a73-b407-5a049cdfced5 response_code = 200 uri = /vpc-routes
20042025-01-09T01:35:16.830ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
20052025-01-09T01:35:16.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53818 req_id = 41a44e14-df3e-415b-851f-b51379224476 response_code = 204 uri = /eip-gateways
20062025-01-09T01:35:16.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53818 req_id = dcb16be1-f988-4eb8-b25e-246ec690e896 response_code = 204 uri = /vpc-routes
20072025-01-09T01:35:16.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
20082025-01-09T01:35:16.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46039 req_id = 61a5f434-52eb-4b08-9896-e58494e350ec response_code = 204 uri = /eip-gateways
20092025-01-09T01:35:16.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46039 req_id = 8d68f54a-e2fc-4b8e-a6ae-0b97c38bd73b response_code = 204 uri = /vpc-routes
20102025-01-09T01:35:16.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34168
20112025-01-09T01:35:16.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34168 req_id = a02b32b3-e331-45ca-8418-671743369b28 response_code = 200 uri = /v2p
20122025-01-09T01:35:17.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50598
20132025-01-09T01:35:17.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20142025-01-09T01:35:17.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20152025-01-09T01:35:17.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111295 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50598 req_id = acbc2c30-baab-42ec-9b2a-23d5d5bee06e response_code = 204 uri = /switch-ports
20162025-01-09T01:35:17.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51073
20172025-01-09T01:35:17.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46367
20182025-01-09T01:35:17.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54934
20192025-01-09T01:35:17.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50598 req_id = 8e9ac3ec-70f6-4210-8923-187b682d7baf response_code = 200 uri = /network-bootstore-config
20202025-01-09T01:35:17.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46367 req_id = 24a64cdf-0466-4683-b697-93b1ec31946d response_code = 200 uri = /vpc-routes
20212025-01-09T01:35:17.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51073 req_id = c0696dbf-fde7-4b1f-81f7-dea75185183a response_code = 200 uri = /v2p
20222025-01-09T01:35:17.131ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20232025-01-09T01:35:17.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43781
20242025-01-09T01:35:17.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43781 req_id = f6b9b152-fcc6-4478-8a59-32b7f984478e response_code = 200 uri = /v2p
20252025-01-09T01:35:17.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
20262025-01-09T01:35:17.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46367 req_id = cb2def02-c67d-4321-8f2f-6ba8653e83ca response_code = 204 uri = /eip-gateways
20272025-01-09T01:35:17.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46367 req_id = 163307e5-7d20-48ce-aa36-b2eef38654a4 response_code = 204 uri = /vpc-routes
20282025-01-09T01:35:17.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20292025-01-09T01:35:17.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33572
20302025-01-09T01:35:17.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101345 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54934 req_id = d363250f-11e5-4889-81d7-cc687f53bba2 response_code = 204 uri = /switch-ports
20312025-01-09T01:35:17.232ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20322025-01-09T01:35:17.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54934 req_id = 0a8ab8ed-8794-4291-8576-62283ba83e20 response_code = 200 uri = /network-bootstore-config
20332025-01-09T01:35:17.268ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20342025-01-09T01:35:17.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33572 req_id = d5e54ade-c35b-40b6-906e-19d104e7c840 response_code = 204 uri = /switch-ports
20352025-01-09T01:35:17.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33572 req_id = b2cc6540-f403-4df9-8dc1-ed936ae6d2a9 response_code = 200 uri = /network-bootstore-config
20362025-01-09T01:35:29.317ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6709 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 1a92db7b-476c-4ee1-8568-044a2022a715 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
20372025-01-09T01:35:29.563ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62143
20382025-01-09T01:35:29.563ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62143 req_id = cd42919b-cda5-4861-9a9c-41e04c8dc56a response_code = 200 uri = /baseboard
20392025-01-09T01:35:46.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35676
20402025-01-09T01:35:46.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35676 req_id = 9e68bde1-3a61-4cec-a03b-dcfa8e7a2825 response_code = 200 uri = /vpc-routes
20412025-01-09T01:35:46.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
20422025-01-09T01:35:46.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35676 req_id = e7bd17ff-5881-4b86-af4c-7247a2be23e6 response_code = 204 uri = /eip-gateways
20432025-01-09T01:35:46.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35676 req_id = 92906542-3586-472f-993a-71b012ebf05b response_code = 204 uri = /vpc-routes
20442025-01-09T01:35:47.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41945
20452025-01-09T01:35:47.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41945 req_id = 7279d9a1-4518-4345-84aa-5e5368687b7b response_code = 200 uri = /v2p
20462025-01-09T01:35:47.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40293
20472025-01-09T01:35:47.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40293 req_id = a3b4e996-e27c-4c49-b48a-a8a13cd5f2df response_code = 200 uri = /v2p
20482025-01-09T01:35:47.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48859
20492025-01-09T01:35:47.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48859 req_id = f3ea0f33-02bb-4824-81a5-1684ff38d11f response_code = 200 uri = /vpc-routes
20502025-01-09T01:35:47.133ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
20512025-01-09T01:35:47.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48859 req_id = 7c339e70-9815-4911-ab9b-8463b6a593d9 response_code = 204 uri = /eip-gateways
20522025-01-09T01:35:47.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48859 req_id = 12f865dc-4042-4e33-8ccb-227914dc5b05 response_code = 204 uri = /vpc-routes
20532025-01-09T01:35:47.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44221
20542025-01-09T01:35:47.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20552025-01-09T01:35:47.185ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20562025-01-09T01:35:47.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98671 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44221 req_id = 03ad25b2-139d-4799-8973-a89fd7a68594 response_code = 204 uri = /switch-ports
20572025-01-09T01:35:47.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44221 req_id = 44245629-a426-418f-9ede-cab6719c47ca response_code = 200 uri = /network-bootstore-config
20582025-01-09T01:35:47.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42337
20592025-01-09T01:35:47.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42337 req_id = fd82435b-6cd1-4bfc-98f3-dc39a440182f response_code = 200 uri = /vpc-routes
20602025-01-09T01:35:47.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41515
20612025-01-09T01:35:47.312ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20622025-01-09T01:35:47.355ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20632025-01-09T01:35:47.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100908 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41515 req_id = 993abfe1-de25-4789-aa15-c9bc44f23095 response_code = 204 uri = /switch-ports
20642025-01-09T01:35:47.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
20652025-01-09T01:35:47.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42337 req_id = 7678473d-742c-451c-a032-688d791c1db4 response_code = 204 uri = /eip-gateways
20662025-01-09T01:35:47.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41515 req_id = 701c8645-92bc-44d9-a8a2-be03c6f6ef92 response_code = 200 uri = /network-bootstore-config
20672025-01-09T01:35:47.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50067
20682025-01-09T01:35:47.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50067 req_id = be0414af-1078-413d-ba25-0ff1b358ddc9 response_code = 200 uri = /v2p
20692025-01-09T01:35:47.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42337 req_id = fc11619f-5943-4b48-a00a-c6061a596635 response_code = 204 uri = /vpc-routes
20702025-01-09T01:35:47.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63215
20712025-01-09T01:35:47.449ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20722025-01-09T01:35:47.488ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20732025-01-09T01:35:47.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92572 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63215 req_id = 6f79893b-c8e5-41df-9cbd-7b3d8b416335 response_code = 204 uri = /switch-ports
20742025-01-09T01:35:47.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63215 req_id = dd945bf1-c426-477f-b721-2f8556a2c4f1 response_code = 200 uri = /network-bootstore-config
20752025-01-09T01:35:52.673ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20762025-01-09T01:35:59.316ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5379 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 8a852756-35e6-4606-8f68-907dcfde4e31 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
20772025-01-09T01:35:59.597ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60066
20782025-01-09T01:35:59.597ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60066 req_id = 0ef1c3c4-e5d3-4266-bc99-043ee0ea66ed response_code = 200 uri = /baseboard
20792025-01-09T01:36:16.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34445
20802025-01-09T01:36:16.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34445 req_id = c87a1695-7906-46c2-bc1a-12feb967729f response_code = 200 uri = /vpc-routes
20812025-01-09T01:36:16.900ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
20822025-01-09T01:36:16.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34445 req_id = eb6f592e-1c55-4457-9aba-0e381cede894 response_code = 204 uri = /eip-gateways
20832025-01-09T01:36:16.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34445 req_id = d5a698c3-2150-4789-ac98-d4a76554530f response_code = 204 uri = /vpc-routes
20842025-01-09T01:36:16.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42917
20852025-01-09T01:36:16.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42917 req_id = b7cc6ab7-3f13-483a-a49f-77e792866850 response_code = 200 uri = /vpc-routes
20862025-01-09T01:36:16.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47293
20872025-01-09T01:36:16.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47293 req_id = de5e2b07-3cfc-4e7c-8e09-3a6f9b42fbe2 response_code = 200 uri = /v2p
20882025-01-09T01:36:17.062ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
20892025-01-09T01:36:17.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42917 req_id = 2496c43b-2e2e-4c22-a5a9-8b979905bc3a response_code = 204 uri = /eip-gateways
20902025-01-09T01:36:17.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42917 req_id = 6a94cde2-63ed-4c11-9911-29b098322437 response_code = 204 uri = /vpc-routes
20912025-01-09T01:36:17.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33307
20922025-01-09T01:36:17.082ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20932025-01-09T01:36:17.120ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20942025-01-09T01:36:17.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33307 req_id = 3482c5a7-78b3-4183-b365-e8212d9516e8 response_code = 204 uri = /switch-ports
20952025-01-09T01:36:17.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42881
20962025-01-09T01:36:17.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55520
20972025-01-09T01:36:17.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51253
20982025-01-09T01:36:17.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33307 req_id = 2d6138db-ee5c-49ea-ae6c-df316c452cd5 response_code = 200 uri = /network-bootstore-config
20992025-01-09T01:36:17.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51253 req_id = 1cc40397-44c2-405a-baa2-4522af83d217 response_code = 200 uri = /vpc-routes
21002025-01-09T01:36:17.177ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21012025-01-09T01:36:17.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55520 req_id = 6fe94d3e-cfae-4694-9414-6fa6ca2d2c67 response_code = 200 uri = /v2p
21022025-01-09T01:36:17.214ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21032025-01-09T01:36:17.226ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
21042025-01-09T01:36:17.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51253 req_id = b3332d9e-c273-4fa1-b778-3a2d2e522646 response_code = 204 uri = /eip-gateways
21052025-01-09T01:36:17.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50695
21062025-01-09T01:36:17.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50695 req_id = b44f0242-928f-4cff-a8f8-23a18524794e response_code = 200 uri = /v2p
21072025-01-09T01:36:17.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51253 req_id = 6a98810a-72a7-41b2-b45f-549e915882c9 response_code = 204 uri = /vpc-routes
21082025-01-09T01:36:17.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42881 req_id = f9a246d9-5742-46eb-8b42-6d983e9efbe5 response_code = 204 uri = /switch-ports
21092025-01-09T01:36:17.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42881 req_id = 2147a533-97c5-4f17-846a-f12eb66681b3 response_code = 200 uri = /network-bootstore-config
21102025-01-09T01:36:17.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57305
21112025-01-09T01:36:17.284ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21122025-01-09T01:36:17.321ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21132025-01-09T01:36:17.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57305 req_id = c35e8149-7f8f-4a5e-9a2c-3bcb916216d4 response_code = 204 uri = /switch-ports
21142025-01-09T01:36:17.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57305 req_id = dedfbd70-d213-45eb-87cd-ae872581a144 response_code = 200 uri = /network-bootstore-config
21152025-01-09T01:36:29.318ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6375 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = da67e954-f4a8-4cad-a1cf-ca9d64cbb7a2 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
21162025-01-09T01:36:29.632ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36973
21172025-01-09T01:36:29.632ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36973 req_id = 4424c622-95e5-4e1d-a0f6-98e75b059134 response_code = 200 uri = /baseboard
21182025-01-09T01:36:46.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51051
21192025-01-09T01:36:46.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51051 req_id = 7356a0ce-6cbf-4af1-89b7-5d5b9edc25f0 response_code = 200 uri = /vpc-routes
21202025-01-09T01:36:47.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42655
21212025-01-09T01:36:47.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42655 req_id = 3d3b8bae-5a05-4cfd-b6ee-01f932924c0c response_code = 200 uri = /vpc-routes
21222025-01-09T01:36:47.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
21232025-01-09T01:36:47.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51051 req_id = e63e47f3-5b77-497e-aa27-eeb569f6fd8b response_code = 204 uri = /eip-gateways
21242025-01-09T01:36:47.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51051 req_id = 63b5f4a5-e598-4f18-8f87-f506fabafa98 response_code = 204 uri = /vpc-routes
21252025-01-09T01:36:47.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
21262025-01-09T01:36:47.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42655 req_id = 16f1ffef-cc0f-45e3-ae1f-0fa4ce73c48c response_code = 204 uri = /eip-gateways
21272025-01-09T01:36:47.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42655 req_id = d804c50a-b131-45fa-8a77-de17e2b1d747 response_code = 204 uri = /vpc-routes
21282025-01-09T01:36:47.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63517
21292025-01-09T01:36:47.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63517 req_id = c0d7bcff-93c2-491e-bd9f-fcc2d1d83aa4 response_code = 200 uri = /v2p
21302025-01-09T01:36:47.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49293
21312025-01-09T01:36:47.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49293 req_id = 5171cdf7-6b6f-4163-a900-4635871ad766 response_code = 200 uri = /v2p
21322025-01-09T01:36:47.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39139
21332025-01-09T01:36:47.268ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21342025-01-09T01:36:47.307ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21352025-01-09T01:36:47.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114207 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39139 req_id = 0b2261e6-c389-47f5-b0b8-4ce8bcb37d50 response_code = 204 uri = /switch-ports
21362025-01-09T01:36:47.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64344
21372025-01-09T01:36:47.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21382025-01-09T01:36:47.420ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21392025-01-09T01:36:47.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100688 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64344 req_id = 24dd5500-3b7e-4819-a189-2311737b7e92 response_code = 204 uri = /switch-ports
21402025-01-09T01:36:47.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59185
21412025-01-09T01:36:47.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41663
21422025-01-09T01:36:47.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59185 req_id = ff4e2bd7-0459-4e0e-bd4b-7112340900d3 response_code = 200 uri = /vpc-routes
21432025-01-09T01:36:47.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64344 req_id = 633c3af9-316f-435f-b701-bc78f508588f response_code = 200 uri = /network-bootstore-config
21442025-01-09T01:36:47.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 384 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39139 req_id = 0fcde353-3035-4d72-a3a8-09f779596295 response_code = 200 uri = /network-bootstore-config
21452025-01-09T01:36:47.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21462025-01-09T01:36:47.528ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
21472025-01-09T01:36:47.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59185 req_id = e494d758-5b3c-439b-8412-8bfb56c55127 response_code = 204 uri = /eip-gateways
21482025-01-09T01:36:47.529ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21492025-01-09T01:36:47.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59185 req_id = 98563b64-64e8-40cd-ad12-b28dd921cffa response_code = 204 uri = /vpc-routes
21502025-01-09T01:36:47.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39708
21512025-01-09T01:36:47.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39708 req_id = 5bbbdb73-44f8-4381-9b63-db3430a8c954 response_code = 200 uri = /v2p
21522025-01-09T01:36:47.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104377 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41663 req_id = 2c59a517-92c9-41ed-acfe-025c093c0c33 response_code = 204 uri = /switch-ports
21532025-01-09T01:36:47.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41663 req_id = 2f7e7643-255b-49d7-a948-dbf2dd364ee7 response_code = 200 uri = /network-bootstore-config
21542025-01-09T01:36:59.318ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6467 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = eb727a2d-2c1e-4817-860d-3e535d328fd2 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
21552025-01-09T01:36:59.666ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45329
21562025-01-09T01:36:59.666ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45329 req_id = 20fbd3e8-825c-4e51-bc4d-5432feed85a6 response_code = 200 uri = /baseboard
21572025-01-09T01:37:16.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40987
21582025-01-09T01:37:16.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40987 req_id = 0b807d10-8e57-44c0-a944-731ea425a15c response_code = 200 uri = /vpc-routes
21592025-01-09T01:37:16.890ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
21602025-01-09T01:37:16.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40987 req_id = 6041fa14-3336-4033-8838-4234fae5e3f9 response_code = 204 uri = /eip-gateways
21612025-01-09T01:37:16.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40987 req_id = 6c390cb2-9427-4069-b110-da30a3111a61 response_code = 204 uri = /vpc-routes
21622025-01-09T01:37:16.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41055
21632025-01-09T01:37:16.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41055 req_id = 4fbe831d-e95c-4cbd-bf87-e5f05858ef6c response_code = 200 uri = /vpc-routes
21642025-01-09T01:37:16.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48066
21652025-01-09T01:37:16.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48066 req_id = bf983cd4-543c-4eac-b0ff-8a7735cec6ca response_code = 200 uri = /v2p
21662025-01-09T01:37:17.022ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
21672025-01-09T01:37:17.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41055 req_id = 57ca97da-a043-4b5b-b37b-ced971e91399 response_code = 204 uri = /eip-gateways
21682025-01-09T01:37:17.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58612
21692025-01-09T01:37:17.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58612 req_id = f9e7bce9-e876-4dc1-9321-045314bacd70 response_code = 200 uri = /v2p
21702025-01-09T01:37:17.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41055 req_id = 708929ca-3153-4b38-b6ce-dc7635846d46 response_code = 204 uri = /vpc-routes
21712025-01-09T01:37:17.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51377
21722025-01-09T01:37:17.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21732025-01-09T01:37:17.084ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21742025-01-09T01:37:17.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51377 req_id = f3d473ef-b986-4160-b681-9110b7106e37 response_code = 204 uri = /switch-ports
21752025-01-09T01:37:17.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49426
21762025-01-09T01:37:17.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62663
21772025-01-09T01:37:17.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62663 req_id = 3ddd4e84-c74a-4dd7-8a21-cfaf27949abc response_code = 200 uri = /vpc-routes
21782025-01-09T01:37:17.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51377 req_id = 595a1c11-399f-4bc2-8a3f-a1355d727f0a response_code = 200 uri = /network-bootstore-config
21792025-01-09T01:37:17.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21802025-01-09T01:37:17.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44781
21812025-01-09T01:37:17.179ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21822025-01-09T01:37:17.185ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
21832025-01-09T01:37:17.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62663 req_id = 5819f6d5-13ae-4a16-9834-b1aaca979571 response_code = 204 uri = /eip-gateways
21842025-01-09T01:37:17.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62663 req_id = 6eba7289-3400-4f93-b1bb-7c24276f9f2a response_code = 204 uri = /vpc-routes
21852025-01-09T01:37:17.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21862025-01-09T01:37:17.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102628 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49426 req_id = bf459302-0a95-467d-bd8e-17d55dc757b4 response_code = 204 uri = /switch-ports
21872025-01-09T01:37:17.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 795 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49426 req_id = 510eab23-b1f1-4fbe-bf33-a00ba5352da6 response_code = 200 uri = /network-bootstore-config
21882025-01-09T01:37:17.281ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21892025-01-09T01:37:17.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44781 req_id = c6f1875f-7522-4a83-a0ae-a5eb1972d231 response_code = 204 uri = /switch-ports
21902025-01-09T01:37:17.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44781 req_id = 5c187677-9353-4a87-8b16-f42406628de5 response_code = 200 uri = /network-bootstore-config
21912025-01-09T01:37:17.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32960
21922025-01-09T01:37:17.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32960 req_id = c5d2e2d9-6e90-492c-833e-d5ebc26e346d response_code = 200 uri = /v2p
21932025-01-09T01:37:29.317ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5749 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 168ed762-0dbe-47e0-bd9a-e5cc0e90aa7c response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
21942025-01-09T01:37:29.699ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35974
21952025-01-09T01:37:29.699ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35974 req_id = 84276fb0-ca38-4412-8363-7a7dc5ea234d response_code = 200 uri = /baseboard
21962025-01-09T01:37:46.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42825
21972025-01-09T01:37:46.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42825 req_id = f5c347b0-c02d-4c38-9bf9-f900c3303105 response_code = 200 uri = /vpc-routes
21982025-01-09T01:37:47.010ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
21992025-01-09T01:37:47.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42825 req_id = c3427cdd-3b4a-4dfe-b518-edb2ff2aea36 response_code = 204 uri = /eip-gateways
22002025-01-09T01:37:47.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42825 req_id = 908e8e30-bb44-4efc-9a22-bb508fd582d3 response_code = 204 uri = /vpc-routes
22012025-01-09T01:37:47.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43425
22022025-01-09T01:37:47.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43425 req_id = b3ae85f7-b4ab-4e55-9430-296c8aa5afa0 response_code = 200 uri = /v2p
22032025-01-09T01:37:47.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45092
22042025-01-09T01:37:47.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45092 req_id = 7ca96058-5de6-428f-9dbc-9ed22564ef3a response_code = 200 uri = /v2p
22052025-01-09T01:37:47.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37653
22062025-01-09T01:37:47.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37653 req_id = 4a48287d-fce4-481a-92ab-3127c15a8d46 response_code = 200 uri = /vpc-routes
22072025-01-09T01:37:47.133ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
22082025-01-09T01:37:47.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37653 req_id = 16d2d887-dc46-473b-8b90-d1ae90ab1aa8 response_code = 204 uri = /eip-gateways
22092025-01-09T01:37:47.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37653 req_id = 50ae94fa-7db3-425d-a9fe-b714e28a3a21 response_code = 204 uri = /vpc-routes
22102025-01-09T01:37:47.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32857
22112025-01-09T01:37:47.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22122025-01-09T01:37:47.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22132025-01-09T01:37:47.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92401 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32857 req_id = f56ba75b-72b0-4ea6-9ac6-8035cf5d3d41 response_code = 204 uri = /switch-ports
22142025-01-09T01:37:47.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44579
22152025-01-09T01:37:47.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32857 req_id = 21021b5f-7455-47b8-8342-f8d55b5f9e47 response_code = 200 uri = /network-bootstore-config
22162025-01-09T01:37:47.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44579 req_id = 62bac8a5-8424-4b6d-a3ed-5d3093ddea9e response_code = 200 uri = /vpc-routes
22172025-01-09T01:37:47.412ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
22182025-01-09T01:37:47.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44579 req_id = 7ebf2908-6578-478c-a9ba-c4a8ba88c389 response_code = 204 uri = /eip-gateways
22192025-01-09T01:37:47.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33900
22202025-01-09T01:37:47.442ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22212025-01-09T01:37:47.479ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22222025-01-09T01:37:47.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96995 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33900 req_id = a3c3b569-20ac-4f7c-8347-a7dbc6e4da7e response_code = 204 uri = /switch-ports
22232025-01-09T01:37:47.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59599
22242025-01-09T01:37:47.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33900 req_id = f8d87903-57bf-4562-9c68-55df9bcf0feb response_code = 200 uri = /network-bootstore-config
22252025-01-09T01:37:47.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59599 req_id = 9ed08772-c787-4157-ac31-c6a0c0287286 response_code = 200 uri = /v2p
22262025-01-09T01:37:47.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 488 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44579 req_id = 00c25baa-81b4-4b75-8037-1bbb3aeff0aa response_code = 204 uri = /vpc-routes
22272025-01-09T01:37:47.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44894
22282025-01-09T01:37:47.551ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22292025-01-09T01:37:47.588ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22302025-01-09T01:37:47.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91570 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44894 req_id = ff245eea-af96-406a-a18d-f15bc27bb682 response_code = 204 uri = /switch-ports
22312025-01-09T01:37:47.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44894 req_id = 9acc5703-6a05-4f32-9a69-05517be16897 response_code = 200 uri = /network-bootstore-config
22322025-01-09T01:37:59.319ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5943 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = f713d47f-d1f2-44bf-a626-b1fa41ca2f7c response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
22332025-01-09T01:37:59.733ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65528
22342025-01-09T01:37:59.733ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65528 req_id = e9233793-a012-4736-a48b-40806ba1d1f4 response_code = 200 uri = /baseboard
22352025-01-09T01:38:16.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61687
22362025-01-09T01:38:16.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61687 req_id = c03d18ce-e58e-4557-9159-af01575b0bdb response_code = 200 uri = /vpc-routes
22372025-01-09T01:38:16.818ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
22382025-01-09T01:38:16.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61687 req_id = 27c07bc9-84ff-4af9-b257-3ddda76570d6 response_code = 204 uri = /eip-gateways
22392025-01-09T01:38:16.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61687 req_id = 3a3b7aa3-19da-4de5-9963-0e706d18ad53 response_code = 204 uri = /vpc-routes
22402025-01-09T01:38:16.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60205
22412025-01-09T01:38:16.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60205 req_id = 4518dcbb-90b6-4886-95b2-77b97f285390 response_code = 200 uri = /v2p
22422025-01-09T01:38:16.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44215
22432025-01-09T01:38:16.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44215 req_id = 62d6ae54-d4fa-4abb-97e4-460572c7acb2 response_code = 200 uri = /vpc-routes
22442025-01-09T01:38:16.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46607
22452025-01-09T01:38:16.992ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22462025-01-09T01:38:17.033ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22472025-01-09T01:38:17.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46607 req_id = f637d6a0-10cf-4271-9272-6016172b6324 response_code = 204 uri = /switch-ports
22482025-01-09T01:38:17.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49577
22492025-01-09T01:38:17.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49577 req_id = edc7f021-b3a8-4c12-8c71-95f7b2f3e7ae response_code = 200 uri = /v2p
22502025-01-09T01:38:17.095ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
22512025-01-09T01:38:17.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44215 req_id = 3117acb0-3e36-4aa5-ae4d-e329ed06a189 response_code = 204 uri = /eip-gateways
22522025-01-09T01:38:17.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46607 req_id = 06b951d0-905c-4e06-92be-350950e770b5 response_code = 200 uri = /network-bootstore-config
22532025-01-09T01:38:17.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46535
22542025-01-09T01:38:17.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46535 req_id = 90431b8f-3786-4dfb-bc19-714f52025e55 response_code = 200 uri = /vpc-routes
22552025-01-09T01:38:17.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44215 req_id = b8cd26c8-8926-42e8-9766-c5e551217f51 response_code = 204 uri = /vpc-routes
22562025-01-09T01:38:17.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
22572025-01-09T01:38:17.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46535 req_id = 55c2db4e-48d1-4455-9df7-83c9ad3d2497 response_code = 204 uri = /eip-gateways
22582025-01-09T01:38:17.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46535 req_id = 1c2cd4c8-ede3-479f-afc2-78a21eb27895 response_code = 204 uri = /vpc-routes
22592025-01-09T01:38:17.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33170
22602025-01-09T01:38:17.160ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22612025-01-09T01:38:17.196ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22622025-01-09T01:38:17.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88508 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33170 req_id = 3a6a1062-e4d8-4c60-85fd-a8a79e96e2fb response_code = 204 uri = /switch-ports
22632025-01-09T01:38:17.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33170 req_id = dc471129-1711-4d5c-953e-7f14be9b69d2 response_code = 200 uri = /network-bootstore-config
22642025-01-09T01:38:17.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57632
22652025-01-09T01:38:17.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57632 req_id = b33e09ad-5aa6-4dd0-b3fc-8f611fa17f85 response_code = 200 uri = /v2p
22662025-01-09T01:38:17.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42735
22672025-01-09T01:38:17.347ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22682025-01-09T01:38:17.382ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22692025-01-09T01:38:17.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87889 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42735 req_id = dfc9cd9a-c306-4ea4-b97f-fcdf04c6637d response_code = 204 uri = /switch-ports
22702025-01-09T01:38:17.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42735 req_id = a25df715-bcbc-4126-b7a4-0fb7c92f9fc7 response_code = 200 uri = /network-bootstore-config
22712025-01-09T01:38:29.319ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6099 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 84883aea-37af-494b-a4c9-88dc283112f3 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
22722025-01-09T01:38:29.767ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50376
22732025-01-09T01:38:29.767ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50376 req_id = 5751a07e-6215-4542-ab5e-bf02ab33d470 response_code = 200 uri = /baseboard
22742025-01-09T01:38:47.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55338
22752025-01-09T01:38:47.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55338 req_id = 655810eb-baeb-4d9a-9240-4fe67560f5c5 response_code = 200 uri = /v2p
22762025-01-09T01:38:47.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61953
22772025-01-09T01:38:47.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61953 req_id = 1afe2051-fb5b-4997-9ae4-9a267aef2ce2 response_code = 200 uri = /vpc-routes
22782025-01-09T01:38:47.127ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
22792025-01-09T01:38:47.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61953 req_id = 170ecfc9-e5ef-42a4-a11c-23c88b2a763b response_code = 204 uri = /eip-gateways
22802025-01-09T01:38:47.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48075
22812025-01-09T01:38:47.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48075 req_id = f4a30aa8-18d2-465b-9cfa-4a1806be2dca response_code = 200 uri = /vpc-routes
22822025-01-09T01:38:47.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61953 req_id = 42702abe-a3c8-4ae9-aec2-8b59de37f600 response_code = 204 uri = /vpc-routes
22832025-01-09T01:38:47.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58806
22842025-01-09T01:38:47.140ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22852025-01-09T01:38:47.199ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22862025-01-09T01:38:47.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139413 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58806 req_id = 2a5fb792-417d-4501-bf45-25fc8d11a6ce response_code = 204 uri = /switch-ports
22872025-01-09T01:38:47.279ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
22882025-01-09T01:38:47.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48075 req_id = 611a3dba-f4c6-40e9-a40f-7c412ed99616 response_code = 204 uri = /eip-gateways
22892025-01-09T01:38:47.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38833
22902025-01-09T01:38:47.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42157
22912025-01-09T01:38:47.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42157 req_id = bbda459e-8dfb-421e-b67a-2c6e3cd1fe2a response_code = 200 uri = /vpc-routes
22922025-01-09T01:38:47.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58806 req_id = a7b2b473-6b60-43be-b368-304f19c51c02 response_code = 200 uri = /network-bootstore-config
22932025-01-09T01:38:47.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38833 req_id = 693368ba-ca36-46e2-aa51-26443c24df0f response_code = 200 uri = /v2p
22942025-01-09T01:38:47.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 412 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48075 req_id = e7f5ac3b-fd57-468b-ad1d-c8dfb56396e4 response_code = 204 uri = /vpc-routes
22952025-01-09T01:38:47.335ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
22962025-01-09T01:38:47.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42157 req_id = 2c15a43c-019c-4a27-918b-e6b5f73ff6c5 response_code = 204 uri = /eip-gateways
22972025-01-09T01:38:47.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59337
22982025-01-09T01:38:47.336ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22992025-01-09T01:38:47.376ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23002025-01-09T01:38:47.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59337 req_id = e2c15a52-a087-443f-87ff-d98a9bb931d5 response_code = 204 uri = /switch-ports
23012025-01-09T01:38:47.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39368
23022025-01-09T01:38:47.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63520
23032025-01-09T01:38:47.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59337 req_id = 6074c313-229b-457f-9f3c-0472c5591b59 response_code = 200 uri = /network-bootstore-config
23042025-01-09T01:38:47.433ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23052025-01-09T01:38:47.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39368 req_id = f30235bb-18d4-4b26-8194-4a321ecf362f response_code = 200 uri = /v2p
23062025-01-09T01:38:47.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42157 req_id = a061b1f0-a67a-440e-ba13-a8b4ca8ac971 response_code = 204 uri = /vpc-routes
23072025-01-09T01:38:47.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41325
23082025-01-09T01:38:47.440ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23092025-01-09T01:38:47.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23102025-01-09T01:38:47.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23112025-01-09T01:38:47.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23122025-01-09T01:38:47.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23132025-01-09T01:38:47.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23142025-01-09T01:38:47.440ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23152025-01-09T01:38:47.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 738 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41325 req_id = 32225799-8bdd-443a-b83e-4d5fe9ec1e12 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23162025-01-09T01:38:47.473ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23172025-01-09T01:38:47.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63520 req_id = 0657f293-d875-402e-82d2-d0d26bcff1cb response_code = 204 uri = /switch-ports
23182025-01-09T01:38:47.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63520 req_id = 768ce43f-7e7a-4ffe-b72e-2ea8ae53f198 response_code = 200 uri = /network-bootstore-config
23192025-01-09T01:38:47.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38363
23202025-01-09T01:38:47.679ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23212025-01-09T01:38:47.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23222025-01-09T01:38:47.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23232025-01-09T01:38:47.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23242025-01-09T01:38:47.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23252025-01-09T01:38:47.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23262025-01-09T01:38:47.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23272025-01-09T01:38:47.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38363 req_id = ddeb6566-bd4d-4adb-a392-6de906b39ab5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23282025-01-09T01:38:47.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38349
23292025-01-09T01:38:47.695ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23302025-01-09T01:38:47.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23312025-01-09T01:38:47.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23322025-01-09T01:38:47.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23332025-01-09T01:38:47.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23342025-01-09T01:38:47.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23352025-01-09T01:38:47.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23362025-01-09T01:38:47.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38349 req_id = 6c8704ed-cdbb-4521-9f55-5489aee112e6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23372025-01-09T01:38:59.319ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6229 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 7cda4fad-b117-418a-b50a-6af568cf4cb3 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
23382025-01-09T01:38:59.803ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63039
23392025-01-09T01:38:59.803ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63039 req_id = c7afb5f6-cdf8-4eb0-8970-602539eb1da9 response_code = 200 uri = /baseboard
23402025-01-09T01:39:16.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63543
23412025-01-09T01:39:16.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63543 req_id = a3909ad9-4a3a-49c6-8646-93011aab6573 response_code = 200 uri = /vpc-routes
23422025-01-09T01:39:16.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56861
23432025-01-09T01:39:16.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56861 req_id = e1ab93d2-2732-4d98-b8ef-422c3f4047e2 response_code = 200 uri = /vpc-routes
23442025-01-09T01:39:16.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
23452025-01-09T01:39:16.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63543 req_id = 69581a56-6676-4d38-b951-e2d45aa4c530 response_code = 204 uri = /eip-gateways
23462025-01-09T01:39:16.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39599
23472025-01-09T01:39:16.958ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23482025-01-09T01:39:17.006ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23492025-01-09T01:39:17.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113218 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39599 req_id = 9871acd7-341b-4feb-8901-3b2879faf114 response_code = 204 uri = /switch-ports
23502025-01-09T01:39:17.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59230
23512025-01-09T01:39:17.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
23522025-01-09T01:39:17.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56861 req_id = 49e276e4-27aa-4d3b-b873-7c3bd67f3925 response_code = 204 uri = /eip-gateways
23532025-01-09T01:39:17.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58509
23542025-01-09T01:39:17.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50148
23552025-01-09T01:39:17.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39599 req_id = 6a2a6377-2beb-4897-a98f-848deae234c3 response_code = 200 uri = /network-bootstore-config
23562025-01-09T01:39:17.072ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23572025-01-09T01:39:17.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 510 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63543 req_id = a72357dd-d27f-4f80-8741-d4c1148b3785 response_code = 204 uri = /vpc-routes
23582025-01-09T01:39:17.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4852 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59230 req_id = e5508e7b-8497-4d75-8bda-e01b3943cbb3 response_code = 200 uri = /v2p
23592025-01-09T01:39:17.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 654 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58509 req_id = 16ca09c9-d1f1-45cd-95c6-7f81cf00b995 response_code = 200 uri = /v2p
23602025-01-09T01:39:17.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56861 req_id = 05393b80-674e-4b34-b187-713969a81f61 response_code = 204 uri = /vpc-routes
23612025-01-09T01:39:17.114ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23622025-01-09T01:39:17.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100350 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50148 req_id = 612cc05f-b179-4aaa-94cf-c21027a1eecb response_code = 204 uri = /switch-ports
23632025-01-09T01:39:17.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50148 req_id = 425d7bb1-54f9-4e1f-aa1f-072402b17471 response_code = 200 uri = /network-bootstore-config
23642025-01-09T01:39:17.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54309
23652025-01-09T01:39:17.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54309 req_id = 972e31e7-cf20-4f9e-a0a0-3b99a9fb05d3 response_code = 200 uri = /vpc-routes
23662025-01-09T01:39:17.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
23672025-01-09T01:39:17.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54309 req_id = 14b7721a-fc82-43f9-a9a7-7e2f2e541003 response_code = 204 uri = /eip-gateways
23682025-01-09T01:39:17.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49376
23692025-01-09T01:39:17.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49376 req_id = f8ac77c7-17c1-4757-951a-007d430f9a77 response_code = 200 uri = /v2p
23702025-01-09T01:39:17.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54309 req_id = fd3c148c-7997-4011-8f96-842c71efd316 response_code = 204 uri = /vpc-routes
23712025-01-09T01:39:17.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52700
23722025-01-09T01:39:17.304ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23732025-01-09T01:39:17.340ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23742025-01-09T01:39:17.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90222 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52700 req_id = 0e8ab098-5dfc-4c11-9e2f-3f7ac3799579 response_code = 204 uri = /switch-ports
23752025-01-09T01:39:17.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52700 req_id = 70d499d5-b0e7-4826-af80-c231647484c0 response_code = 200 uri = /network-bootstore-config
23762025-01-09T01:39:29.319ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6188 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = a5759eca-078a-48b7-ac7b-0cfa59a9a4ed response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
23772025-01-09T01:39:29.836ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61290
23782025-01-09T01:39:29.836ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61290 req_id = 16be80b1-a16a-41cb-8fac-7357a97390bc response_code = 200 uri = /baseboard
23792025-01-09T01:39:47.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36761
23802025-01-09T01:39:47.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36761 req_id = 96d40f60-c2e8-4f77-baea-91a25368ea6b response_code = 200 uri = /vpc-routes
23812025-01-09T01:39:47.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64207
23822025-01-09T01:39:47.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64207 req_id = 080187dc-e4d0-4e7f-9953-ded8119ecab2 response_code = 200 uri = /vpc-routes
23832025-01-09T01:39:47.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
23842025-01-09T01:39:47.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36761 req_id = 419d56ad-d60e-409c-99f0-b58884e5461b response_code = 204 uri = /eip-gateways
23852025-01-09T01:39:47.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36761 req_id = df3fc591-6cbd-4c32-ba0b-cd88989527d2 response_code = 204 uri = /vpc-routes
23862025-01-09T01:39:47.101ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
23872025-01-09T01:39:47.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64207 req_id = 0bb79d55-6785-43d5-bd19-e0dd7e64992c response_code = 204 uri = /eip-gateways
23882025-01-09T01:39:47.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64207 req_id = a1d7367a-586f-463d-a530-4a06ee8254be response_code = 204 uri = /vpc-routes
23892025-01-09T01:39:47.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45044
23902025-01-09T01:39:47.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23912025-01-09T01:39:47.178ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23922025-01-09T01:39:47.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144257 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45044 req_id = 068f2651-736d-4493-ae96-ea8231fc30ce response_code = 204 uri = /switch-ports
23932025-01-09T01:39:47.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45369
23942025-01-09T01:39:47.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62915
23952025-01-09T01:39:47.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47354
23962025-01-09T01:39:47.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45369 req_id = 9749982d-4a92-4551-b898-1666d748b412 response_code = 200 uri = /vpc-routes
23972025-01-09T01:39:47.262ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23982025-01-09T01:39:47.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62915 req_id = c4b3457a-247f-4b56-b76b-f6524503c66d response_code = 200 uri = /v2p
23992025-01-09T01:39:47.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45044 req_id = 65446d62-3f19-4127-9307-8efb712e466e response_code = 200 uri = /network-bootstore-config
24002025-01-09T01:39:47.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58964
24012025-01-09T01:39:47.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58964 req_id = 2ecb037b-4575-456f-8db6-298b5087147a response_code = 200 uri = /v2p
24022025-01-09T01:39:47.310ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24032025-01-09T01:39:47.320ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
24042025-01-09T01:39:47.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45369 req_id = 38174e6b-637b-41bd-b95c-f50d03aec63c response_code = 204 uri = /eip-gateways
24052025-01-09T01:39:47.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 474 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45369 req_id = 3da3de17-29a1-4f93-9df4-68c2ef34fb81 response_code = 204 uri = /vpc-routes
24062025-01-09T01:39:47.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65119
24072025-01-09T01:39:47.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65119 req_id = 3e2192e8-7e30-4d06-99fb-d20461025440 response_code = 200 uri = /v2p
24082025-01-09T01:39:47.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47354 req_id = d37f3dbb-0b35-426c-b269-219846c68af1 response_code = 204 uri = /switch-ports
24092025-01-09T01:39:47.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47354 req_id = 20bfda1e-e2d9-408b-b89f-75d38f9d9f5f response_code = 200 uri = /network-bootstore-config
24102025-01-09T01:39:47.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63970
24112025-01-09T01:39:47.474ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24122025-01-09T01:39:47.516ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24132025-01-09T01:39:47.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95863 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63970 req_id = c1caf9b3-6ff8-4a5b-b038-27f81b2bf6b2 response_code = 204 uri = /switch-ports
24142025-01-09T01:39:47.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63970 req_id = 5e71b17a-25d9-4c47-82b1-39023cd04d09 response_code = 200 uri = /network-bootstore-config
24152025-01-09T01:39:59.319ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5915 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 3fd6488b-af4f-48a1-a94a-b0a6a370b5b8 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
24162025-01-09T01:39:59.868ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46311
24172025-01-09T01:39:59.868ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46311 req_id = d6f0f4cf-fecf-44c9-9753-06aded24cf7f response_code = 200 uri = /baseboard
24182025-01-09T01:40:16.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61881
24192025-01-09T01:40:16.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61881 req_id = f4cf8622-18c8-459d-8b27-a529b49b7d43 response_code = 200 uri = /vpc-routes
24202025-01-09T01:40:16.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
24212025-01-09T01:40:16.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61881 req_id = 6c25d5b3-3829-4ae1-9995-d6a4460d3c95 response_code = 204 uri = /eip-gateways
24222025-01-09T01:40:16.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61881 req_id = 90c03765-4553-432d-a95e-323a2f7cc227 response_code = 204 uri = /vpc-routes
24232025-01-09T01:40:16.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49633
24242025-01-09T01:40:16.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49633 req_id = ae903763-4251-49bb-a6c8-875ef61a9e22 response_code = 200 uri = /vpc-routes
24252025-01-09T01:40:16.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
24262025-01-09T01:40:16.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49633 req_id = 8c1e847b-2002-459c-a937-39944977591a response_code = 204 uri = /eip-gateways
24272025-01-09T01:40:16.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49633 req_id = 2b2f976f-7f15-4179-b545-fd1090288d3a response_code = 204 uri = /vpc-routes
24282025-01-09T01:40:17.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62451
24292025-01-09T01:40:17.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24302025-01-09T01:40:17.047ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24312025-01-09T01:40:17.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93176 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62451 req_id = 35654866-49fc-42dd-a44a-c712aa79dbb7 response_code = 204 uri = /switch-ports
24322025-01-09T01:40:17.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54009
24332025-01-09T01:40:17.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53710
24342025-01-09T01:40:17.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53012
24352025-01-09T01:40:17.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43274
24362025-01-09T01:40:17.105ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24372025-01-09T01:40:17.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62451 req_id = 6fc7c166-b704-4f32-8088-9301ade713dd response_code = 200 uri = /network-bootstore-config
24382025-01-09T01:40:17.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53710 req_id = 6a2331f9-d164-4ce5-b04b-f266ad81ef7f response_code = 200 uri = /v2p
24392025-01-09T01:40:17.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54009 req_id = 68c1bd85-3d94-4493-8f59-94d209e7684b response_code = 200 uri = /v2p
24402025-01-09T01:40:17.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53012 req_id = c531c691-195b-49cb-a32c-3bc96bc0951c response_code = 200 uri = /vpc-routes
24412025-01-09T01:40:17.125ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
24422025-01-09T01:40:17.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53012 req_id = 4fde3581-66aa-4631-8069-99fcb1325942 response_code = 204 uri = /eip-gateways
24432025-01-09T01:40:17.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 939 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53012 req_id = 6085d034-ffe9-489f-88d5-2029b390e4cc response_code = 204 uri = /vpc-routes
24442025-01-09T01:40:17.147ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24452025-01-09T01:40:17.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41852
24462025-01-09T01:40:17.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24472025-01-09T01:40:17.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103588 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43274 req_id = 14b0abe9-d194-4f29-8777-cf451ed6d5e9 response_code = 204 uri = /switch-ports
24482025-01-09T01:40:17.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 781 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43274 req_id = 5ce97b17-b1be-42b6-81b7-b7cfa938cbb9 response_code = 200 uri = /network-bootstore-config
24492025-01-09T01:40:17.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24502025-01-09T01:40:17.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43841
24512025-01-09T01:40:17.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43841 req_id = d19c85f4-00a0-4259-a4b3-4bdecbd541b6 response_code = 200 uri = /v2p
24522025-01-09T01:40:17.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41852 req_id = 43dd4e07-3882-4d92-aadd-b268dfab9d79 response_code = 204 uri = /switch-ports
24532025-01-09T01:40:17.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41852 req_id = e2262569-21b7-4950-aec2-76a2f3fe6f34 response_code = 200 uri = /network-bootstore-config
24542025-01-09T01:40:29.322ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6969 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 804d27d1-14d9-492f-a44b-c5af8a75c668 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
24552025-01-09T01:40:29.901ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32965
24562025-01-09T01:40:29.901ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32965 req_id = 67f69474-4d4d-40ff-bc35-9e5543f92753 response_code = 200 uri = /baseboard
24572025-01-09T01:40:38.393ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24582025-01-09T01:40:38.393ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24592025-01-09T01:40:38.426ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1970, tv_nsec: 825918672 } time_to_next_cleanup = 599.99999556s
24602025-01-09T01:40:47.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53092
24612025-01-09T01:40:47.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53092 req_id = 61f3b8dd-7025-4706-aeb0-1d3ab1417da3 response_code = 200 uri = /vpc-routes
24622025-01-09T01:40:47.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47824
24632025-01-09T01:40:47.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47824 req_id = abb48e43-91be-45a7-ba0d-0b3de08f781f response_code = 200 uri = /v2p
24642025-01-09T01:40:47.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50758
24652025-01-09T01:40:47.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50758 req_id = e81ed8a9-dc7a-47f5-9e60-000f200ccbe2 response_code = 200 uri = /vpc-routes
24662025-01-09T01:40:47.194ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
24672025-01-09T01:40:47.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53092 req_id = 6e5c71fa-d4a2-4ea0-a1ed-f266745b2e8c response_code = 204 uri = /eip-gateways
24682025-01-09T01:40:47.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53092 req_id = 0b927306-7e7f-4d86-9017-e799de3c4a89 response_code = 204 uri = /vpc-routes
24692025-01-09T01:40:47.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
24702025-01-09T01:40:47.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50758 req_id = 7b1526c6-4fef-4c63-8cf8-c2a93ff2e7f3 response_code = 204 uri = /eip-gateways
24712025-01-09T01:40:47.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50758 req_id = 62344f55-0ef5-481c-9d4f-d06690dc5672 response_code = 204 uri = /vpc-routes
24722025-01-09T01:40:47.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38805
24732025-01-09T01:40:47.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38805 req_id = 82d62044-357a-4c92-aaef-8ec348af2198 response_code = 200 uri = /vpc-routes
24742025-01-09T01:40:47.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38071
24752025-01-09T01:40:47.239ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24762025-01-09T01:40:47.278ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24772025-01-09T01:40:47.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38071 req_id = 7380ece9-7ce2-4459-b50d-0e3e17567781 response_code = 204 uri = /switch-ports
24782025-01-09T01:40:47.340ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
24792025-01-09T01:40:47.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38805 req_id = 07ba63ab-e140-4918-aa7d-757522f89625 response_code = 204 uri = /eip-gateways
24802025-01-09T01:40:47.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38071 req_id = 82bd8c57-8f47-48e1-84d6-5fa878e6e209 response_code = 200 uri = /network-bootstore-config
24812025-01-09T01:40:47.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37790
24822025-01-09T01:40:47.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37790 req_id = 46efc745-85cf-47ef-b7b1-410b75f26c28 response_code = 200 uri = /v2p
24832025-01-09T01:40:47.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38805 req_id = c45210cc-175b-4dcb-82af-a14b2f05d7eb response_code = 204 uri = /vpc-routes
24842025-01-09T01:40:47.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42318
24852025-01-09T01:40:47.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24862025-01-09T01:40:47.391ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24872025-01-09T01:40:47.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92220 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42318 req_id = d4d74050-2b4b-4dcc-a95c-c16682663430 response_code = 204 uri = /switch-ports
24882025-01-09T01:40:47.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54959
24892025-01-09T01:40:47.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36119
24902025-01-09T01:40:47.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42318 req_id = caf388f4-d01d-439b-845d-6cc77588a375 response_code = 200 uri = /network-bootstore-config
24912025-01-09T01:40:47.447ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24922025-01-09T01:40:47.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54959 req_id = 401602f5-26dd-4f21-8a37-3667aadff907 response_code = 200 uri = /v2p
24932025-01-09T01:40:47.485ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24942025-01-09T01:40:47.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36119 req_id = 4c8ddcc8-9282-4dfd-921c-669873d488bd response_code = 204 uri = /switch-ports
24952025-01-09T01:40:47.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36119 req_id = 35263265-a86c-4e20-9512-3018ceae710c response_code = 200 uri = /network-bootstore-config
24962025-01-09T01:40:52.678ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24972025-01-09T01:40:59.319ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5270 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = d994e8e1-c960-4061-8c16-30ce3a7b5395 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
24982025-01-09T01:40:59.935ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44402
24992025-01-09T01:40:59.935ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44402 req_id = 2fee845a-1492-4a65-b40a-45f6f69d9227 response_code = 200 uri = /baseboard
25002025-01-09T01:41:16.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52714
25012025-01-09T01:41:16.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52714 req_id = f99f95e4-7f2c-4b8d-b9bb-15547f98dcfc response_code = 200 uri = /v2p
25022025-01-09T01:41:16.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53635
25032025-01-09T01:41:16.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53635 req_id = d9421cd2-b605-4421-becd-bad26ce19d6f response_code = 200 uri = /vpc-routes
25042025-01-09T01:41:16.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34579
25052025-01-09T01:41:16.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34579 req_id = 58738aa1-c318-48ec-a818-c2d2cb1853b1 response_code = 200 uri = /v2p
25062025-01-09T01:41:16.925ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
25072025-01-09T01:41:16.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53635 req_id = e772690d-98f1-4e41-b9a8-8b4f73dff3f6 response_code = 204 uri = /eip-gateways
25082025-01-09T01:41:16.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53635 req_id = f61f9311-9eb9-4240-badd-60c1c47762f5 response_code = 204 uri = /vpc-routes
25092025-01-09T01:41:17.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56958
25102025-01-09T01:41:17.000ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25112025-01-09T01:41:17.043ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25122025-01-09T01:41:17.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56958 req_id = 92204eed-0a80-43c4-8156-4b99c8a1d355 response_code = 204 uri = /switch-ports
25132025-01-09T01:41:17.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33206
25142025-01-09T01:41:17.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33206 req_id = dc820af7-b49e-4a14-8fbf-7e834af0fa06 response_code = 200 uri = /vpc-routes
25152025-01-09T01:41:17.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56958 req_id = 49f0805c-7ac1-4c31-bc7c-c636de0c4e1c response_code = 200 uri = /network-bootstore-config
25162025-01-09T01:41:17.117ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
25172025-01-09T01:41:17.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33206 req_id = 59cd74b2-beef-4769-a360-a7ef86bfa51e response_code = 204 uri = /eip-gateways
25182025-01-09T01:41:17.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33206 req_id = d146457a-1bd9-4b26-ac9c-0dd1ea61d584 response_code = 204 uri = /vpc-routes
25192025-01-09T01:41:17.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40418
25202025-01-09T01:41:17.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40418 req_id = d94afe21-f4e9-4721-9a98-7a9aa800b5be response_code = 200 uri = /vpc-routes
25212025-01-09T01:41:17.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64091
25222025-01-09T01:41:17.174ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25232025-01-09T01:41:17.213ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25242025-01-09T01:41:17.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93215 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64091 req_id = fc0505a5-8216-4dd5-9f14-6699eee19deb response_code = 204 uri = /switch-ports
25252025-01-09T01:41:17.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52200
25262025-01-09T01:41:17.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47020
25272025-01-09T01:41:17.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
25282025-01-09T01:41:17.267ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25292025-01-09T01:41:17.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40418 req_id = dc67fb31-e333-4b83-8317-e9a1cb6e7b11 response_code = 204 uri = /eip-gateways
25302025-01-09T01:41:17.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64091 req_id = 078c26df-9969-4512-b82e-f1c0b5f5e835 response_code = 200 uri = /network-bootstore-config
25312025-01-09T01:41:17.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47020 req_id = 634f55d7-af2b-40b2-9e89-8d5a35135e74 response_code = 200 uri = /v2p
25322025-01-09T01:41:17.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40418 req_id = a5221588-380f-4010-8ab9-a93db486f39f response_code = 204 uri = /vpc-routes
25332025-01-09T01:41:17.303ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25342025-01-09T01:41:17.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87706 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52200 req_id = b1ac5287-9561-498e-b63e-09f9e58d578c response_code = 204 uri = /switch-ports
25352025-01-09T01:41:17.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52200 req_id = 7988703c-aa25-4ed9-979b-4ad97fa3ea4f response_code = 200 uri = /network-bootstore-config
25362025-01-09T01:41:29.321ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6157 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = c243cd70-5809-4491-9b46-4e48c504211a response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
25372025-01-09T01:41:29.968ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33470
25382025-01-09T01:41:29.968ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33470 req_id = 6936bf69-e754-4ff6-9990-412acf1bfa73 response_code = 200 uri = /baseboard
25392025-01-09T01:41:46.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34278
25402025-01-09T01:41:46.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34278 req_id = 07e9938d-9cb1-4564-89d8-ce6c70f917da response_code = 200 uri = /vpc-routes
25412025-01-09T01:41:47.016ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
25422025-01-09T01:41:47.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34278 req_id = 689af0e3-8fb1-4392-80f7-064134acb0d7 response_code = 204 uri = /eip-gateways
25432025-01-09T01:41:47.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34278 req_id = 0a8963a2-d833-4393-bb48-c9ac53d2d376 response_code = 204 uri = /vpc-routes
25442025-01-09T01:41:47.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49168
25452025-01-09T01:41:47.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49168 req_id = 709c19f8-9e99-4d66-bc9a-604b38b1f0bc response_code = 200 uri = /v2p
25462025-01-09T01:41:47.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44812
25472025-01-09T01:41:47.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44812 req_id = 60c8989e-94b5-4e34-bd0a-25e2d9413e76 response_code = 200 uri = /vpc-routes
25482025-01-09T01:41:47.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36123
25492025-01-09T01:41:47.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36123 req_id = bcf52010-cc3f-4749-a33c-991567306953 response_code = 200 uri = /v2p
25502025-01-09T01:41:47.218ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
25512025-01-09T01:41:47.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44812 req_id = 82ba2984-dade-4e30-8dc1-93654a413e8b response_code = 204 uri = /eip-gateways
25522025-01-09T01:41:47.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44812 req_id = e80c0d9d-1dd8-45e1-9f55-d6d8356526cd response_code = 204 uri = /vpc-routes
25532025-01-09T01:41:47.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34986
25542025-01-09T01:41:47.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34986 req_id = 2c5c4414-d330-4b7a-bb76-a361d0a8b9b3 response_code = 200 uri = /vpc-routes
25552025-01-09T01:41:47.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53085
25562025-01-09T01:41:47.247ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25572025-01-09T01:41:47.295ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25582025-01-09T01:41:47.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53085 req_id = 071636cf-55c7-4467-a9b1-eacd87292543 response_code = 204 uri = /switch-ports
25592025-01-09T01:41:47.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
25602025-01-09T01:41:47.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34986 req_id = b26e8353-06e8-4656-814a-f0a000ecc98a response_code = 204 uri = /eip-gateways
25612025-01-09T01:41:47.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53085 req_id = ccf4e9e2-ff2f-499a-b6ca-5faca02d5d1d response_code = 200 uri = /network-bootstore-config
25622025-01-09T01:41:47.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34986 req_id = 3c7a488a-b618-45ba-a1c9-4001d90e3815 response_code = 204 uri = /vpc-routes
25632025-01-09T01:41:47.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56686
25642025-01-09T01:41:47.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56686 req_id = 9a786456-74a1-4c1c-8adc-4108d5bf4e84 response_code = 200 uri = /v2p
25652025-01-09T01:41:47.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52891
25662025-01-09T01:41:47.410ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25672025-01-09T01:41:47.448ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25682025-01-09T01:41:47.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96079 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52891 req_id = b850455a-7ba9-48d1-b267-d618007c2a5d response_code = 204 uri = /switch-ports
25692025-01-09T01:41:47.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54592
25702025-01-09T01:41:47.506ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25712025-01-09T01:41:47.540ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25722025-01-09T01:41:47.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54592 req_id = a47c5641-25c6-4c0f-82a1-d3bc0998057c response_code = 204 uri = /switch-ports
25732025-01-09T01:41:47.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52891 req_id = e8084ba5-d512-4e78-9e86-f28ce3f61ce1 response_code = 200 uri = /network-bootstore-config
25742025-01-09T01:41:47.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54592 req_id = d6316f9c-c70c-446c-98ab-9c95932d852f response_code = 200 uri = /network-bootstore-config
25752025-01-09T01:41:59.321ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5507 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = b3a387e1-062a-4bde-bea4-5f6916232555 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
25762025-01-09T01:42:00.001ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37711
25772025-01-09T01:42:00.001ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37711 req_id = bc96f367-0711-4d56-ac5c-cd5bafc8de33 response_code = 200 uri = /baseboard
25782025-01-09T01:42:16.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41807
25792025-01-09T01:42:16.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41807 req_id = dea493ad-15b5-4f4d-a229-d5de43edf7ff response_code = 200 uri = /vpc-routes
25802025-01-09T01:42:16.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46157
25812025-01-09T01:42:16.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46157 req_id = a05bd82d-b0a2-45a9-9e66-076488dde567 response_code = 200 uri = /vpc-routes
25822025-01-09T01:42:16.973ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
25832025-01-09T01:42:16.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41807 req_id = b4ffb564-1882-44ce-8759-c972c9174ac6 response_code = 204 uri = /eip-gateways
25842025-01-09T01:42:16.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41807 req_id = 42a6d76d-8674-41af-af43-e61c503cf070 response_code = 204 uri = /vpc-routes
25852025-01-09T01:42:17.015ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
25862025-01-09T01:42:17.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46157 req_id = 3378322d-7bea-45f2-9116-e54ddbc0019e response_code = 204 uri = /eip-gateways
25872025-01-09T01:42:17.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46823
25882025-01-09T01:42:17.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46823 req_id = c41a4609-290f-4f53-aa98-b24f175af4d5 response_code = 200 uri = /v2p
25892025-01-09T01:42:17.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54810
25902025-01-09T01:42:17.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25912025-01-09T01:42:17.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 408 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46157 req_id = afaf10c3-ab3b-4d1b-8a51-ad791b8462f3 response_code = 204 uri = /vpc-routes
25922025-01-09T01:42:17.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62300
25932025-01-09T01:42:17.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62300 req_id = 224f733e-0dc6-4aa1-bf25-866cef1a8b0d response_code = 200 uri = /v2p
25942025-01-09T01:42:17.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25952025-01-09T01:42:17.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43516
25962025-01-09T01:42:17.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43516 req_id = 0938a394-4d38-4e82-ad3d-c8f5eddd9a23 response_code = 200 uri = /v2p
25972025-01-09T01:42:17.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53095
25982025-01-09T01:42:17.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53095 req_id = c383c3d5-64c8-48eb-9a1c-ca27a49f1536 response_code = 200 uri = /vpc-routes
25992025-01-09T01:42:17.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54810 req_id = 639091c0-f639-478c-a0e0-75bdcd784d21 response_code = 204 uri = /switch-ports
26002025-01-09T01:42:17.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54810 req_id = 8e7c728e-be1a-4713-a28d-b31f25b18ffb response_code = 200 uri = /network-bootstore-config
26012025-01-09T01:42:17.127ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
26022025-01-09T01:42:17.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53095 req_id = 1a44197b-41e3-4304-bc89-e6c211fab36c response_code = 204 uri = /eip-gateways
26032025-01-09T01:42:17.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53095 req_id = c7d5d688-4811-4668-811d-12c9438e1885 response_code = 204 uri = /vpc-routes
26042025-01-09T01:42:17.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58459
26052025-01-09T01:42:17.153ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26062025-01-09T01:42:17.188ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26072025-01-09T01:42:17.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88603 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58459 req_id = 5a537b1a-5d74-4837-bfbe-65cd7cc87010 response_code = 204 uri = /switch-ports
26082025-01-09T01:42:17.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46403
26092025-01-09T01:42:17.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58459 req_id = d85e6673-f694-443a-83f6-191d44fa3abf response_code = 200 uri = /network-bootstore-config
26102025-01-09T01:42:17.242ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26112025-01-09T01:42:17.281ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26122025-01-09T01:42:17.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91992 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46403 req_id = 3f9e9f50-148c-4b3a-85b9-cd605ffb50eb response_code = 204 uri = /switch-ports
26132025-01-09T01:42:17.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46403 req_id = d5161e5b-8e0b-4fd5-a665-41bfbf446fce response_code = 200 uri = /network-bootstore-config
26142025-01-09T01:42:29.322ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5934 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = fdb919f6-1f08-418e-afd2-bd846507c596 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
26152025-01-09T01:42:30.034ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56733
26162025-01-09T01:42:30.034ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56733 req_id = 710fd699-6bc4-4a5e-9d6b-278ec39847e6 response_code = 200 uri = /baseboard
26172025-01-09T01:42:46.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48706
26182025-01-09T01:42:46.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48706 req_id = 6245cf65-e163-4c1c-8066-c736ca78d79c response_code = 200 uri = /vpc-routes
26192025-01-09T01:42:47.041ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
26202025-01-09T01:42:47.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48706 req_id = 2256be43-14ec-4522-bce8-af3625013997 response_code = 204 uri = /eip-gateways
26212025-01-09T01:42:47.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54196
26222025-01-09T01:42:47.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54196 req_id = facfa1fc-9c35-4b41-a190-b78502a10939 response_code = 200 uri = /vpc-routes
26232025-01-09T01:42:47.108ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
26242025-01-09T01:42:47.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54196 req_id = 2cd67382-2124-4364-ad85-106492550dda response_code = 204 uri = /eip-gateways
26252025-01-09T01:42:47.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46878
26262025-01-09T01:42:47.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46878 req_id = 0d57a14a-2274-42cf-8579-029204a1b20e response_code = 200 uri = /v2p
26272025-01-09T01:42:47.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63115
26282025-01-09T01:42:47.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63115 req_id = 81857c56-dd7a-48e1-9077-a8787c1aa72f response_code = 200 uri = /v2p
26292025-01-09T01:42:47.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48706 req_id = 93efc60a-a1f7-4203-b1d7-1b1cdd2ba1b9 response_code = 204 uri = /vpc-routes
26302025-01-09T01:42:47.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54196 req_id = 8f890d92-530c-4ca0-8c8b-ef397d576093 response_code = 204 uri = /vpc-routes
26312025-01-09T01:42:47.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32834
26322025-01-09T01:42:47.171ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26332025-01-09T01:42:47.216ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26342025-01-09T01:42:47.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104537 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32834 req_id = d48abbfc-1c94-48f2-9413-028eebe32cf1 response_code = 204 uri = /switch-ports
26352025-01-09T01:42:47.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41306
26362025-01-09T01:42:47.276ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26372025-01-09T01:42:47.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3825 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32834 req_id = e1c12aee-6cc3-4f40-b5d4-0fa651a4fbf9 response_code = 200 uri = /network-bootstore-config
26382025-01-09T01:42:47.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26392025-01-09T01:42:47.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38046
26402025-01-09T01:42:47.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3525 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38046 req_id = fc2a9008-c1e8-4576-b40e-d1d6a20fcf71 response_code = 200 uri = /v2p
26412025-01-09T01:42:47.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61245
26422025-01-09T01:42:47.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61245 req_id = 375e1bd3-12db-4c52-934b-f05d2e48da7f response_code = 200 uri = /vpc-routes
26432025-01-09T01:42:47.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98153 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41306 req_id = 785ebec3-8cf2-4d6c-9956-b5ca06119744 response_code = 204 uri = /switch-ports
26442025-01-09T01:42:47.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41306 req_id = 416a81c4-ee91-41a9-893c-41d1234b36ad response_code = 200 uri = /network-bootstore-config
26452025-01-09T01:42:47.410ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
26462025-01-09T01:42:47.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61245 req_id = 4994d01c-d48a-429c-93d5-129b33ef8bd1 response_code = 204 uri = /eip-gateways
26472025-01-09T01:42:47.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61245 req_id = a336bc60-8e53-4888-8d6c-8cb517d847f1 response_code = 204 uri = /vpc-routes
26482025-01-09T01:42:47.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49008
26492025-01-09T01:42:47.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26502025-01-09T01:42:47.520ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26512025-01-09T01:42:47.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90975 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49008 req_id = 344c3adf-6c6f-4454-94be-5897c950063c response_code = 204 uri = /switch-ports
26522025-01-09T01:42:47.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49008 req_id = 40a11389-3d4f-4d2d-8a6a-3b33edee9263 response_code = 200 uri = /network-bootstore-config
26532025-01-09T01:42:59.324ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7858 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 10a63a4d-858c-4983-a4e2-84f5e550d7b2 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
26542025-01-09T01:43:00.067ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49753
26552025-01-09T01:43:00.067ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49753 req_id = 0bdc9ded-22d0-4dea-9688-664f5452e8f3 response_code = 200 uri = /baseboard
26562025-01-09T01:43:16.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55367
26572025-01-09T01:43:16.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55367 req_id = 9c7f9ecd-4329-4745-ab28-0d5d48d52e58 response_code = 200 uri = /vpc-routes
26582025-01-09T01:43:16.904ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
26592025-01-09T01:43:16.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55367 req_id = f1da038f-df6a-4f19-9d92-0323384a59b4 response_code = 204 uri = /eip-gateways
26602025-01-09T01:43:16.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35707
26612025-01-09T01:43:16.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35707 req_id = ef88dc15-3614-437b-9369-0cc2510aec1f response_code = 200 uri = /v2p
26622025-01-09T01:43:16.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55367 req_id = ae78f1a8-5de0-4e2b-ad44-02bad138e8d3 response_code = 204 uri = /vpc-routes
26632025-01-09T01:43:16.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33681
26642025-01-09T01:43:16.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33681 req_id = 6f8c842f-1ca9-46c2-8583-f35bc566dcb9 response_code = 200 uri = /vpc-routes
26652025-01-09T01:43:16.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
26662025-01-09T01:43:16.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33681 req_id = 53c78a25-1ee4-4101-a476-b6cbb7bfbaa1 response_code = 204 uri = /eip-gateways
26672025-01-09T01:43:16.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63683
26682025-01-09T01:43:16.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63683 req_id = bce0c2af-86c3-4bab-b077-df28a6f8c159 response_code = 200 uri = /v2p
26692025-01-09T01:43:16.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56134
26702025-01-09T01:43:16.999ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26712025-01-09T01:43:17.042ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26722025-01-09T01:43:17.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100656 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56134 req_id = 3a7a18a6-d4da-445b-959b-401f65fec67e response_code = 204 uri = /switch-ports
26732025-01-09T01:43:17.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54897
26742025-01-09T01:43:17.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57560
26752025-01-09T01:43:17.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 426 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56134 req_id = 1a0dfb6d-30d9-4092-8372-cc33d8164097 response_code = 200 uri = /network-bootstore-config
26762025-01-09T01:43:17.100ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26772025-01-09T01:43:17.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 748 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33681 req_id = 4ad82dbd-8553-43a0-9bc9-5b14007c8492 response_code = 204 uri = /vpc-routes
26782025-01-09T01:43:17.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57560 req_id = c64be8c4-1e22-4b40-bd04-89ce7e308541 response_code = 200 uri = /vpc-routes
26792025-01-09T01:43:17.147ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26802025-01-09T01:43:17.153ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
26812025-01-09T01:43:17.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57560 req_id = e4e90cd0-f29c-4ec7-b338-8e3e2c01878d response_code = 204 uri = /eip-gateways
26822025-01-09T01:43:17.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1084 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57560 req_id = 4e4d3228-8b7d-43ac-8e99-c1c06fa00d19 response_code = 204 uri = /vpc-routes
26832025-01-09T01:43:17.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42548
26842025-01-09T01:43:17.211ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26852025-01-09T01:43:17.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110997 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54897 req_id = deeb6dcb-4474-4464-ab86-ccedfe4df36d response_code = 204 uri = /switch-ports
26862025-01-09T01:43:17.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 789 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54897 req_id = 355ed4cd-ef6d-41b8-a236-eba9f106ff21 response_code = 200 uri = /network-bootstore-config
26872025-01-09T01:43:17.254ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26882025-01-09T01:43:17.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37395
26892025-01-09T01:43:17.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37395 req_id = 512518a0-b2c3-4d81-93f7-bd395dcd80bc response_code = 200 uri = /v2p
26902025-01-09T01:43:17.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108876 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42548 req_id = 0e32e67c-9614-472e-b3a4-2a54180bb42c response_code = 204 uri = /switch-ports
26912025-01-09T01:43:17.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42548 req_id = 3a96fd83-4f7c-43a3-adf9-d743688ad96e response_code = 200 uri = /network-bootstore-config
26922025-01-09T01:43:29.322ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5890 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 0e7f62d5-cebc-4a1f-b16f-484518ebcd18 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
26932025-01-09T01:43:30.100ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57226
26942025-01-09T01:43:30.100ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57226 req_id = ec8938a3-b54d-47e8-9376-7f57e8c80b0b response_code = 200 uri = /baseboard
26952025-01-09T01:43:46.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46209
26962025-01-09T01:43:46.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46209 req_id = 1ae241d0-101e-43cf-9d1c-dfe49a515337 response_code = 200 uri = /vpc-routes
26972025-01-09T01:43:47.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
26982025-01-09T01:43:47.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46209 req_id = 69094ba3-f589-4a22-8d23-84b09985ea33 response_code = 204 uri = /eip-gateways
26992025-01-09T01:43:47.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37320
27002025-01-09T01:43:47.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37320 req_id = 68f76cb9-caae-4f7e-bed5-a6c4b8039361 response_code = 200 uri = /v2p
27012025-01-09T01:43:47.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46209 req_id = ce10288c-8470-4ea0-a88a-ad58e2726410 response_code = 204 uri = /vpc-routes
27022025-01-09T01:43:47.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62294
27032025-01-09T01:43:47.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62294 req_id = 5b3378f5-2521-4ef9-baef-098ca1a0b433 response_code = 200 uri = /vpc-routes
27042025-01-09T01:43:47.173ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
27052025-01-09T01:43:47.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62294 req_id = 0aca4b81-32a6-4685-93fe-92b099a4330a response_code = 204 uri = /eip-gateways
27062025-01-09T01:43:47.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62294 req_id = 47795ec4-4500-4d58-89b1-64c81467ddc7 response_code = 204 uri = /vpc-routes
27072025-01-09T01:43:47.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45066
27082025-01-09T01:43:47.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27092025-01-09T01:43:47.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27102025-01-09T01:43:47.266ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:177
27112025-01-09T01:43:47.267ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:177
27122025-01-09T01:43:47.283ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27132025-01-09T01:43:47.283ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1
27142025-01-09T01:43:47.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41934
27152025-01-09T01:43:47.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41934 req_id = 1ccb0496-7bdc-4f3c-8006-cb43eb55f82e response_code = 200 uri = /v2p
27162025-01-09T01:43:47.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61098
27172025-01-09T01:43:47.308ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27182025-01-09T01:43:47.313ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27192025-01-09T01:43:47.314ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86
27202025-01-09T01:43:47.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48570
27212025-01-09T01:43:47.351ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27222025-01-09T01:43:47.351ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2
27232025-01-09T01:43:47.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36535
27242025-01-09T01:43:47.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33628
27252025-01-09T01:43:47.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48570 req_id = cda4e4b8-37a7-47d7-b5f8-604bb6c0191e response_code = 200 uri = /vpc-routes
27262025-01-09T01:43:47.358ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27272025-01-09T01:43:47.358ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27282025-01-09T01:43:47.358ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27292025-01-09T01:43:47.359ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27302025-01-09T01:43:47.359ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27312025-01-09T01:43:47.359ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27322025-01-09T01:43:47.359ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27332025-01-09T01:43:47.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1029 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33628 req_id = 79348ccf-6b8f-467f-8462-2e86575afa36 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27342025-01-09T01:43:47.364ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27352025-01-09T01:43:47.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27362025-01-09T01:43:47.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27372025-01-09T01:43:47.371ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:177
27382025-01-09T01:43:47.376ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:177
27392025-01-09T01:43:47.386ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27402025-01-09T01:43:47.387ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf
27412025-01-09T01:43:47.404ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27422025-01-09T01:43:47.404ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1
27432025-01-09T01:43:47.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42540
27442025-01-09T01:43:47.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
27452025-01-09T01:43:47.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 858 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48570 req_id = 0310ca90-6428-4d87-b6d8-e5524624061d response_code = 204 uri = /eip-gateways
27462025-01-09T01:43:47.432ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27472025-01-09T01:43:47.432ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86
27482025-01-09T01:43:47.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55835
27492025-01-09T01:43:47.438ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27502025-01-09T01:43:47.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27512025-01-09T01:43:47.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27522025-01-09T01:43:47.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27532025-01-09T01:43:47.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27542025-01-09T01:43:47.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27552025-01-09T01:43:47.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27562025-01-09T01:43:47.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 690 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55835 req_id = 459d258d-559c-44c8-8467-23dbd527b508 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27572025-01-09T01:43:47.442ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27582025-01-09T01:43:47.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133418 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61098 req_id = 0a3af82a-c46c-4ca3-b313-54a9c1ae2c55 response_code = 204 uri = /switch-ports
27592025-01-09T01:43:47.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61098 req_id = 4a2b9650-8941-4ed1-b179-dd2f93918467 response_code = 200 uri = /network-bootstore-config
27602025-01-09T01:43:47.448ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27612025-01-09T01:43:47.448ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ff08246-782d-4058-9e5f-ff095db6560c
27622025-01-09T01:43:47.466ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27632025-01-09T01:43:47.466ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2
27642025-01-09T01:43:47.485ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27652025-01-09T01:43:47.489ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27662025-01-09T01:43:47.489ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59
27672025-01-09T01:43:47.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47898
27682025-01-09T01:43:47.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38834
27692025-01-09T01:43:47.507ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27702025-01-09T01:43:47.507ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf
27712025-01-09T01:43:47.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5847 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48570 req_id = 4d50cec4-4563-463e-ba7b-d81ce2e0defb response_code = 204 uri = /vpc-routes
27722025-01-09T01:43:47.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5005 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38834 req_id = b9899855-fe3f-4e36-87c4-0fdc59bae563 response_code = 200 uri = /v2p
27732025-01-09T01:43:47.522ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27742025-01-09T01:43:47.522ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27752025-01-09T01:43:47.522ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27762025-01-09T01:43:47.522ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5da334f-19cb-4d72-b915-499edbcccd72
27772025-01-09T01:43:47.537ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/config/omicron-zones.json file = common/src/ledger.rs:177
27782025-01-09T01:43:47.540ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27792025-01-09T01:43:47.540ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ff08246-782d-4058-9e5f-ff095db6560c
27802025-01-09T01:43:47.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54391
27812025-01-09T01:43:47.551ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/config/omicron-zones.json file = common/src/ledger.rs:177
27822025-01-09T01:43:47.557ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27832025-01-09T01:43:47.557ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_629544c0-27f4-4020-b514-332802874b60
27842025-01-09T01:43:47.561ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27852025-01-09T01:43:47.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152058 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42540 req_id = 35bc1db6-dc10-4eab-8048-2ecd5d38866a response_code = 204 uri = /switch-ports
27862025-01-09T01:43:47.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 712 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42540 req_id = 09559a74-4a0e-42da-bcdb-0ed7b1a5f46f response_code = 200 uri = /network-bootstore-config
27872025-01-09T01:43:47.571ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9979ed37-d6a2-48bf-a63c-5d900fb82be1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27882025-01-09T01:43:47.571ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9979ed37-d6a2-48bf-a63c-5d900fb82be1
27892025-01-09T01:43:47.589ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27902025-01-09T01:43:47.589ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59
27912025-01-09T01:43:47.609ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27922025-01-09T01:43:47.613ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 83efebd9-d04a-4495-9c2a-3f0e609d5d86 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27932025-01-09T01:43:47.613ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_83efebd9-d04a-4495-9c2a-3f0e609d5d86
27942025-01-09T01:43:47.626ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27952025-01-09T01:43:47.626ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5
27962025-01-09T01:43:47.642ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27972025-01-09T01:43:47.643ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5da334f-19cb-4d72-b915-499edbcccd72
27982025-01-09T01:43:47.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 385061 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45066 req_id = 06946059-e8e6-40c4-932a-50bfb3d1de2b response_code = 200 uri = /inventory
27992025-01-09T01:43:47.657ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16cfcf81-c429-4ad0-9803-f2c7d8af58c2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28002025-01-09T01:43:47.657ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16cfcf81-c429-4ad0-9803-f2c7d8af58c2
28012025-01-09T01:43:47.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39233
28022025-01-09T01:43:47.665ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28032025-01-09T01:43:47.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28042025-01-09T01:43:47.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28052025-01-09T01:43:47.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28062025-01-09T01:43:47.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28072025-01-09T01:43:47.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28082025-01-09T01:43:47.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28092025-01-09T01:43:47.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 730 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39233 req_id = 61451576-ef13-4fbd-b980-f9f8a3922c9f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28102025-01-09T01:43:47.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119207 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54391 req_id = 74fb39dd-7c26-4fff-a375-6ab162c589af response_code = 204 uri = /switch-ports
28112025-01-09T01:43:47.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 760 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54391 req_id = 355596d8-8246-4072-9104-72ef525e2f83 response_code = 200 uri = /network-bootstore-config
28122025-01-09T01:43:47.683ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9cd62b00-ac25-4ba0-9920-be1d74493ebf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28132025-01-09T01:43:47.683ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9cd62b00-ac25-4ba0-9920-be1d74493ebf
28142025-01-09T01:43:47.696ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28152025-01-09T01:43:47.696ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_629544c0-27f4-4020-b514-332802874b60
28162025-01-09T01:43:47.711ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ff08246-782d-4058-9e5f-ff095db6560c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28172025-01-09T01:43:47.711ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ff08246-782d-4058-9e5f-ff095db6560c
28182025-01-09T01:43:47.726ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28192025-01-09T01:43:47.726ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5
28202025-01-09T01:43:47.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 385527 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36535 req_id = cd92dec0-c03c-4e5e-a881-c756a8b5208b response_code = 200 uri = /inventory
28212025-01-09T01:43:47.749ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2c401d-cd11-4b98-97b7-da3f7ca8fb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28222025-01-09T01:43:47.749ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2c401d-cd11-4b98-97b7-da3f7ca8fb59
28232025-01-09T01:43:47.774ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5da334f-19cb-4d72-b915-499edbcccd72 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28242025-01-09T01:43:47.774ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5da334f-19cb-4d72-b915-499edbcccd72
28252025-01-09T01:43:47.798ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 629544c0-27f4-4020-b514-332802874b60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28262025-01-09T01:43:47.798ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_629544c0-27f4-4020-b514-332802874b60
28272025-01-09T01:43:47.823ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28282025-01-09T01:43:47.823ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5
28292025-01-09T01:43:47.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324708 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47898 req_id = 08aef2ef-a9e0-401f-bb02-b37b9435cf3c response_code = 200 uri = /inventory
28302025-01-09T01:43:59.323ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6121 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 42484003-5b83-46ca-9c80-fa081f9e93e9 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
28312025-01-09T01:44:00.133ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40245
28322025-01-09T01:44:00.133ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40245 req_id = 188470ee-ce49-4eaf-b5d3-3c48e51b7a31 response_code = 200 uri = /baseboard
28332025-01-09T01:44:16.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48729
28342025-01-09T01:44:16.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48729 req_id = a3c17030-93db-4cde-92bf-ad87b40de05b response_code = 200 uri = /vpc-routes
28352025-01-09T01:44:16.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38362
28362025-01-09T01:44:16.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38362 req_id = 04c92324-2d12-450a-8be4-24efa3923c62 response_code = 200 uri = /vpc-routes
28372025-01-09T01:44:16.901ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
28382025-01-09T01:44:16.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48729 req_id = b0b94462-f269-4ad3-80df-bd45770f2a6a response_code = 204 uri = /eip-gateways
28392025-01-09T01:44:16.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33372
28402025-01-09T01:44:16.907ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28412025-01-09T01:44:16.960ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28422025-01-09T01:44:17.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133646 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33372 req_id = d6e3e29c-c18e-4f84-a9e9-951e8f960a79 response_code = 204 uri = /switch-ports
28432025-01-09T01:44:17.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40336
28442025-01-09T01:44:17.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39923
28452025-01-09T01:44:17.042ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
28462025-01-09T01:44:17.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38362 req_id = 47f89898-a1fc-4689-a738-fe26ae866b23 response_code = 204 uri = /eip-gateways
28472025-01-09T01:44:17.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33372 req_id = 1225484a-145c-431d-82ca-d909c9c1f6bc response_code = 200 uri = /network-bootstore-config
28482025-01-09T01:44:17.042ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28492025-01-09T01:44:17.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39923 req_id = 39c28cd6-0d4f-4a58-b0d2-af0c206b0b84 response_code = 200 uri = /v2p
28502025-01-09T01:44:17.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 702 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48729 req_id = e447ac38-d9e9-4bff-902f-c3d142fc8586 response_code = 204 uri = /vpc-routes
28512025-01-09T01:44:17.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38362 req_id = 5d4b4907-f075-4636-9421-c0a66e791c06 response_code = 204 uri = /vpc-routes
28522025-01-09T01:44:17.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56989
28532025-01-09T01:44:17.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56989 req_id = 7ebdd397-40d7-4683-ba4f-320d173f5141 response_code = 200 uri = /vpc-routes
28542025-01-09T01:44:17.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28552025-01-09T01:44:17.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
28562025-01-09T01:44:17.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56989 req_id = 5c79116d-aad7-414d-bf6c-d6d823bd6f5b response_code = 204 uri = /eip-gateways
28572025-01-09T01:44:17.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56989 req_id = 77840f7f-35b1-436e-80bc-c5d2df56ac38 response_code = 204 uri = /vpc-routes
28582025-01-09T01:44:17.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36555
28592025-01-09T01:44:17.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36555 req_id = 95c272aa-fcbb-4584-bd2e-84ef67913c4b response_code = 200 uri = /v2p
28602025-01-09T01:44:17.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40449
28612025-01-09T01:44:17.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40449 req_id = 25bbfa2b-0f98-4ffe-9505-2857822b8673 response_code = 200 uri = /v2p
28622025-01-09T01:44:17.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40336 req_id = a3e2e6e1-6ad7-49fd-aee0-84264ad7d044 response_code = 204 uri = /switch-ports
28632025-01-09T01:44:17.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40336 req_id = 67f6f699-be5b-47be-892f-56f3f5bf13ab response_code = 200 uri = /network-bootstore-config
28642025-01-09T01:44:17.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42739
28652025-01-09T01:44:17.188ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28662025-01-09T01:44:17.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28672025-01-09T01:44:17.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86878 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42739 req_id = 7c67cf06-f5ee-4555-bf0f-5dedd1d5488f response_code = 204 uri = /switch-ports
28682025-01-09T01:44:17.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42739 req_id = 4c4a1cb7-185a-4280-a4c4-1823945005d0 response_code = 200 uri = /network-bootstore-config
28692025-01-09T01:44:29.328ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7325 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 7b0eb6f1-cb3f-4044-8977-a588aeef0cba response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
28702025-01-09T01:44:30.166ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58159
28712025-01-09T01:44:30.166ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58159 req_id = 0a6ec79f-0092-42f5-a1b4-85d6b856d379 response_code = 200 uri = /baseboard
28722025-01-09T01:44:47.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39138
28732025-01-09T01:44:47.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39138 req_id = ea6e88b7-19a1-4f43-a0a4-7ff9b785f361 response_code = 200 uri = /vpc-routes
28742025-01-09T01:44:47.131ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
28752025-01-09T01:44:47.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39138 req_id = af813ed1-039a-45d5-95af-6e0d71dea3bd response_code = 204 uri = /eip-gateways
28762025-01-09T01:44:47.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39138 req_id = a7151c67-9b96-4af1-8ad1-50b3419dc69f response_code = 204 uri = /vpc-routes
28772025-01-09T01:44:47.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44043
28782025-01-09T01:44:47.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44043 req_id = d3899b25-b9b1-47ed-9f31-2a63ea81319b response_code = 200 uri = /vpc-routes
28792025-01-09T01:44:47.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54513
28802025-01-09T01:44:47.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54513 req_id = ae119df9-3659-4200-9bb2-665ac0c63980 response_code = 200 uri = /v2p
28812025-01-09T01:44:47.217ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
28822025-01-09T01:44:47.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44043 req_id = 9a71a309-7754-4f6c-8665-0c0c3ab3f583 response_code = 204 uri = /eip-gateways
28832025-01-09T01:44:47.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44043 req_id = 8ae13e75-ed93-4e8f-aae3-bfb568436e70 response_code = 204 uri = /vpc-routes
28842025-01-09T01:44:47.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61613
28852025-01-09T01:44:47.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61613 req_id = d74a084d-1cce-4104-ad12-bcd0176c0577 response_code = 200 uri = /v2p
28862025-01-09T01:44:47.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56851
28872025-01-09T01:44:47.280ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28882025-01-09T01:44:47.322ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28892025-01-09T01:44:47.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105904 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56851 req_id = 58a0dcb5-4d81-4f9d-b7a5-93ba53381fa3 response_code = 204 uri = /switch-ports
28902025-01-09T01:44:47.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32988
28912025-01-09T01:44:47.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36936
28922025-01-09T01:44:47.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59702
28932025-01-09T01:44:47.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56851 req_id = bb3fa460-53d8-4e78-8d77-3bf9a6ffa681 response_code = 200 uri = /network-bootstore-config
28942025-01-09T01:44:47.387ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28952025-01-09T01:44:47.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59702 req_id = 56b17113-6ac7-41dd-80f1-a2bb81a45a71 response_code = 200 uri = /vpc-routes
28962025-01-09T01:44:47.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32988 req_id = b35ef2bf-44d3-43e4-b7b6-8e6727d8819c response_code = 200 uri = /v2p
28972025-01-09T01:44:47.430ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28982025-01-09T01:44:47.435ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
28992025-01-09T01:44:47.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59702 req_id = b9a1ea3a-edaf-45ad-8599-63eedca6caf0 response_code = 204 uri = /eip-gateways
29002025-01-09T01:44:47.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 997 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59702 req_id = 62f1a77c-4bad-44b2-9b79-a0dfbfc1f163 response_code = 204 uri = /vpc-routes
29012025-01-09T01:44:47.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101079 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36936 req_id = 9b029558-4bf6-44f6-911d-e0462ff4c5a4 response_code = 204 uri = /switch-ports
29022025-01-09T01:44:47.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36936 req_id = 0be8f1cf-f1fd-4548-971c-2d1e58716beb response_code = 200 uri = /network-bootstore-config
29032025-01-09T01:44:47.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40090
29042025-01-09T01:44:47.496ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29052025-01-09T01:44:47.530ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29062025-01-09T01:44:47.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40090 req_id = d918a640-eac3-4887-b621-03a78cb733b9 response_code = 204 uri = /switch-ports
29072025-01-09T01:44:47.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40090 req_id = 11af69b6-2d7a-4cc7-8378-b966b95dfa0a response_code = 200 uri = /network-bootstore-config
29082025-01-09T01:44:59.323ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5872 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 27b46f43-975f-4430-b399-b9ea24724aa2 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
29092025-01-09T01:45:00.204ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61765
29102025-01-09T01:45:00.204ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61765 req_id = 416997bf-2863-4a87-8536-962a16ebb9b7 response_code = 200 uri = /baseboard
29112025-01-09T01:45:00.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50938
29122025-01-09T01:45:00.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50938 req_id = 929cb703-714e-4be5-a75b-056171669b2c response_code = 200 uri = /v2p
29132025-01-09T01:45:00.709ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(2554039) }
29142025-01-09T01:45:00.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50938 req_id = 8a8c122e-7c63-478c-9871-0694a60acdec response_code = 204 uri = /v2p
29152025-01-09T01:45:00.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45081
29162025-01-09T01:45:00.905ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a09f8642-5806-4b50-b24c-be61c2f4d667, kind: Instance { id: 2a287340-c2bb-444f-9fa5-21434d22199a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2554039), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a09f8642-5806-4b50-b24c-be61c2f4d667, kind: Instance { id: 2a287340-c2bb-444f-9fa5-21434d22199a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2554039), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a09f8642-5806-4b50-b24c-be61c2f4d667, kind: Instance { id: 2a287340-c2bb-444f-9fa5-21434d22199a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2554039), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(2554039))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a09f8642-5806-4b50-b24c-be61c2f4d667, kind: Instance { id: 2a287340-c2bb-444f-9fa5-21434d22199a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2554039), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: bc317357-d6cc-43b6-9861-2b170977d91d, slot: 0, read_only: false, vcr_json: .., name: "disk-59e2e387210" }], boot_settings: Some(InstanceBootSettings { order: [bc317357-d6cc-43b6-9861-2b170977d91d] }), cloud_init_bytes: Some(..) } instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a metadata = InstanceMetadata { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, project_id: 223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-09T01:45:00.898622477Z }
29172025-01-09T01:45:00.905ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a migration_id = None propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29182025-01-09T01:45:00.905ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a migration_id = None propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a09f8642-5806-4b50-b24c-be61c2f4d667, kind: Instance { id: 2a287340-c2bb-444f-9fa5-21434d22199a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2554039), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a09f8642-5806-4b50-b24c-be61c2f4d667, kind: Instance { id: 2a287340-c2bb-444f-9fa5-21434d22199a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2554039), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a09f8642-5806-4b50-b24c-be61c2f4d667, kind: Instance { id: 2a287340-c2bb-444f-9fa5-21434d22199a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2554039), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(2554039))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a09f8642-5806-4b50-b24c-be61c2f4d667, kind: Instance { id: 2a287340-c2bb-444f-9fa5-21434d22199a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2554039), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: bc317357-d6cc-43b6-9861-2b170977d91d, slot: 0, read_only: false, vcr_json: .., name: "disk-59e2e387210" }], boot_settings: Some(InstanceBootSettings { order: [bc317357-d6cc-43b6-9861-2b170977d91d] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-09T01:45:00.898622477Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29192025-01-09T01:45:00.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10047 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45081 req_id = 91498512-c71a-4a4d-943c-afb54c18148d response_code = 200 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29202025-01-09T01:45:01.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32849
29212025-01-09T01:45:01.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 989 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32849 req_id = 0c15dcd1-4b21-4fc8-b0aa-138606b3d5fd response_code = 200 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602/state
29222025-01-09T01:45:01.025ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 2554039 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29232025-01-09T01:45:01.025ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29242025-01-09T01:45:01.076ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602 file = illumos-utils/src/zone.rs:325 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29252025-01-09T01:45:01.107ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602 file = illumos-utils/src/zone.rs:363 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29262025-01-09T01:45:01.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48017
29272025-01-09T01:45:01.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48017 req_id = d1772ad9-6ba8-4bf7-955a-0c030ca959e2 response_code = 200 uri = /vpc-routes
29282025-01-09T01:45:01.174ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {a09f8642-5806-4b50-b24c-be61c2f4d667: {10.151.1.176: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}, 10.151.1.175: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}}} }
29292025-01-09T01:45:03.261ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29302025-01-09T01:45:03.261ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29312025-01-09T01:45:03.520ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 39.485006ms file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29322025-01-09T01:45:03.569ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 101.965531ms file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29332025-01-09T01:45:03.687ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 191.371602ms file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29342025-01-09T01:45:03.897ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 516.945313ms file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29352025-01-09T01:45:04.430ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 1.177815091s file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29362025-01-09T01:45:05.621ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 1.289078777s file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29372025-01-09T01:45:06.921ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 915.220265ms file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29382025-01-09T01:45:07.848ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 1.023520906s file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 zone = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29392025-01-09T01:45:08.898ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602 file = sled-agent/src/instance.rs:2067 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29402025-01-09T01:45:08.906ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 69.500883ms file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29412025-01-09T01:45:08.984ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602") failed: Property not found. retry in 149.273383ms file = illumos-utils/src/svc.rs:36 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29422025-01-09T01:45:09.145ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29432025-01-09T01:45:09.180ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29442025-01-09T01:45:09.319ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29452025-01-09T01:45:09.320ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
29462025-01-09T01:45:09.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8147892 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48017 req_id = 1a7bf9da-b0c6-4980-9e0a-c15b462d8b01 response_code = 204 uri = /eip-gateways
29472025-01-09T01:45:09.321ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-09T01:45:09.321701159Z } file = sled-agent/src/instance.rs:780 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29482025-01-09T01:45:09.321ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-09T01:45:09.321701159Z } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29492025-01-09T01:45:09.321ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-09T01:45:09.321701159Z }, migration_in: None, migration_out: None }
29502025-01-09T01:45:09.357ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-09T01:45:09.357769309Z } file = sled-agent/src/instance.rs:780 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29512025-01-09T01:45:09.357ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-09T01:45:09.357769309Z } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29522025-01-09T01:45:09.357ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-09T01:45:09.357769309Z }, migration_in: None, migration_out: None }
29532025-01-09T01:45:09.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48017 req_id = 40b87e08-f1fb-4ee1-b98a-9b3d932a9423 response_code = 204 uri = /vpc-routes
29542025-01-09T01:45:16.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56288
29552025-01-09T01:45:16.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56288 req_id = 197e824d-ee1f-4e2c-9055-74652f7cab14 response_code = 200 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602/state
29562025-01-09T01:45:16.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48643
29572025-01-09T01:45:16.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48643 req_id = 5d63f080-c56b-4a77-bea2-c37c241cb46d response_code = 200 uri = /vpc-routes
29582025-01-09T01:45:16.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38847
29592025-01-09T01:45:16.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38847 req_id = 51612eea-40c5-4ac4-912b-4362b5e9f014 response_code = 200 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602/state
29602025-01-09T01:45:16.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {a09f8642-5806-4b50-b24c-be61c2f4d667: {10.151.1.176: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}, 10.151.1.175: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}}} }
29612025-01-09T01:45:16.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48643 req_id = 9d98153b-43e9-428b-9223-d987f2334f5b response_code = 204 uri = /eip-gateways
29622025-01-09T01:45:17.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61920
29632025-01-09T01:45:17.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61920 req_id = 10feea23-bcf0-4fdb-a74c-8b86c66bd7a8 response_code = 200 uri = /v2p
29642025-01-09T01:45:17.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48643 req_id = 629415f5-202f-40a7-be70-1885736ede8e response_code = 204 uri = /vpc-routes
29652025-01-09T01:45:17.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37758
29662025-01-09T01:45:17.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29672025-01-09T01:45:17.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29682025-01-09T01:45:17.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96812 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37758 req_id = c2114265-e5bc-4f24-a950-2a5fddec6663 response_code = 204 uri = /switch-ports
29692025-01-09T01:45:17.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42621
29702025-01-09T01:45:17.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56709
29712025-01-09T01:45:17.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56709 req_id = 9f33e97e-13c5-44dd-b29e-41f3b3452757 response_code = 200 uri = /v2p
29722025-01-09T01:45:17.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42621 req_id = 9857f480-f24b-4643-a75d-2f85331a8b3c response_code = 200 uri = /vpc-routes
29732025-01-09T01:45:17.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37758 req_id = e06dfedd-e42e-4acb-a49a-0e355f5a955c response_code = 200 uri = /network-bootstore-config
29742025-01-09T01:45:17.147ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {a09f8642-5806-4b50-b24c-be61c2f4d667: {10.151.1.175: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}, 10.151.1.176: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}}} }
29752025-01-09T01:45:17.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42621 req_id = 1c51a360-ae5e-4055-8756-5d2c9ce5da04 response_code = 204 uri = /eip-gateways
29762025-01-09T01:45:17.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56808
29772025-01-09T01:45:17.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29782025-01-09T01:45:17.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29792025-01-09T01:45:17.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56808 req_id = f69f9599-aca4-4137-aedb-8d526b430a5b response_code = 204 uri = /switch-ports
29802025-01-09T01:45:17.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52553
29812025-01-09T01:45:17.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34244
29822025-01-09T01:45:17.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52553 req_id = 6f50a6e2-f4cb-4fa6-8d99-516fca6cb421 response_code = 200 uri = /vpc-routes
29832025-01-09T01:45:17.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56808 req_id = 37518a29-cd1e-4028-9815-ce2d52813f0e response_code = 200 uri = /network-bootstore-config
29842025-01-09T01:45:17.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34244 req_id = f4ec229e-a053-4806-9d51-60af395a8ea6 response_code = 200 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602/state
29852025-01-09T01:45:17.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 569 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42621 req_id = 663d300a-1fa4-46d2-b22e-b74488c547db response_code = 204 uri = /vpc-routes
29862025-01-09T01:45:17.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44324
29872025-01-09T01:45:17.279ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29882025-01-09T01:45:17.321ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29892025-01-09T01:45:17.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101925 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44324 req_id = 1bf75da2-4b83-4a9d-87e8-029bee274f5c response_code = 204 uri = /switch-ports
29902025-01-09T01:45:17.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44324 req_id = 7f6377f4-568b-41b3-823a-4c1cc4768344 response_code = 200 uri = /network-bootstore-config
29912025-01-09T01:45:17.381ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {a09f8642-5806-4b50-b24c-be61c2f4d667: {10.151.1.176: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}, 10.151.1.175: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}}} }
29922025-01-09T01:45:17.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52553 req_id = d05af6b5-a97e-4dcc-a7ce-80af1428a772 response_code = 204 uri = /eip-gateways
29932025-01-09T01:45:17.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52553 req_id = d28e58c9-c922-419c-a1fa-3e9aa65ead89 response_code = 204 uri = /vpc-routes
29942025-01-09T01:45:17.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35629
29952025-01-09T01:45:17.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35629 req_id = d054a0df-8512-4885-85ac-edf9dc0409db response_code = 200 uri = /v2p
29962025-01-09T01:45:18.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58264
29972025-01-09T01:45:18.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58264 req_id = 8f22de90-51bb-4cc3-b4e2-481e975d69cc response_code = 200 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602/state
29982025-01-09T01:45:18.659ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-09T01:45:18.659806040Z } file = sled-agent/src/instance.rs:780 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
29992025-01-09T01:45:18.659ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-09T01:45:18.659806040Z } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
30002025-01-09T01:45:18.659ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-09T01:45:18.659806040Z }, migration_in: None, migration_out: None }
30012025-01-09T01:45:18.704ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-09T01:45:18.704635121Z } file = sled-agent/src/instance.rs:780 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
30022025-01-09T01:45:18.704ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-09T01:45:18.704635121Z } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
30032025-01-09T01:45:18.704ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
30042025-01-09T01:45:18.704ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30052025-01-09T01:45:18.705ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30062025-01-09T01:45:18.705ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/0fd3c3fa-6a57-4068-95d9-59f288374d68/debug/bundle/zone", "/pool/int/b26b17b4-316d-4586-8c99-78f69b3c6fa1/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/9979ed37-d6a2-48bf-a63c-5d900fb82be1/crypt/debug", "/pool/ext/83efebd9-d04a-4495-9c2a-3f0e609d5d86/crypt/debug", "/pool/ext/16cfcf81-c429-4ad0-9803-f2c7d8af58c2/crypt/debug", "/pool/ext/9cd62b00-ac25-4ba0-9920-be1d74493ebf/crypt/debug", "/pool/ext/6ff08246-782d-4058-9e5f-ff095db6560c/crypt/debug", "/pool/ext/5d2c401d-cd11-4b98-97b7-da3f7ca8fb59/crypt/debug", "/pool/ext/a5da334f-19cb-4d72-b915-499edbcccd72/crypt/debug", "/pool/ext/629544c0-27f4-4020-b514-332802874b60/crypt/debug", "/pool/ext/1f19b5a0-1514-4bd1-aec0-dcd636bd3fa5/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602
30072025-01-09T01:45:19.326ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602", bundle_id: 15de8b5e-3eec-475a-9800-79a26413aaba }, time_created: 2025-01-09T01:45:18.705506835Z, version: 0, cause: TerminatedInstance }
30082025-01-09T01:45:19.326ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_3d2ea020-a9fd-4f71-ae3d-38fcefd12602 file = sled-agent/src/instance.rs:1313 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
30092025-01-09T01:45:21.078ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
30102025-01-09T01:45:21.094ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(2554039), kind: System }
30112025-01-09T01:45:21.094ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(2554039), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30122025-01-09T01:45:21.096ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T01:45:21.096023188Z }, migration_in: None, migration_out: None }
30132025-01-09T01:45:21.162ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T01:45:21.096023188Z }, migration_in: None, migration_out: None }
30142025-01-09T01:45:21.167ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
30152025-01-09T01:45:21.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44392
30162025-01-09T01:45:21.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44392 req_id = 2be18812-cbf9-4344-84d2-6721d1e94738 response_code = 200 uri = /vpc-routes
30172025-01-09T01:45:21.742ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
30182025-01-09T01:45:21.742ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7
30192025-01-09T01:45:21.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44392 req_id = 86b6eb45-5fd4-4fe0-8b63-3a777917b6c0 response_code = 204 uri = /eip-gateways
30202025-01-09T01:45:21.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44392 req_id = 8749ba6d-6b18-40a5-a5ae-6513c761e26c response_code = 204 uri = /vpc-routes
30212025-01-09T01:45:21.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53958
30222025-01-09T01:45:21.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53958 req_id = a5f5b960-029e-4edd-9f7e-5571f2a8e6dc response_code = 200 uri = /v2p
30232025-01-09T01:45:22.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59762
30242025-01-09T01:45:22.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59762 req_id = 356ab1d9-c72c-4da0-bccb-448baf96c503 response_code = 200 uri = /v2p
30252025-01-09T01:45:23.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58018
30262025-01-09T01:45:23.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58018 req_id = 0ea3887d-d940-4e97-a0d2-a826daf75a90 response_code = 200 uri = /vpc-routes
30272025-01-09T01:45:23.056ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
30282025-01-09T01:45:23.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58018 req_id = 9993386c-0825-423a-bd0d-d83bd3856234 response_code = 204 uri = /eip-gateways
30292025-01-09T01:45:23.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58018 req_id = 0908c7b4-20b8-43fd-9ddd-783e67f336d4 response_code = 204 uri = /vpc-routes
30302025-01-09T01:45:23.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36527
30312025-01-09T01:45:23.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36527 req_id = 343016b6-03ae-4f7b-a725-898c28a20d3a response_code = 200 uri = /vpc-routes
30322025-01-09T01:45:23.738ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
30332025-01-09T01:45:23.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36527 req_id = f745fa88-c24b-4514-9798-18b967f1ee4b response_code = 204 uri = /eip-gateways
30342025-01-09T01:45:23.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36527 req_id = b1190cc3-c762-4ace-b69c-f6df38eef0af response_code = 204 uri = /vpc-routes
30352025-01-09T01:45:29.325ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6567 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = a11fd37d-9d94-4e34-8401-2bd43930a919 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
30362025-01-09T01:45:30.239ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49385
30372025-01-09T01:45:30.239ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49385 req_id = 5314eecf-bf22-4978-af81-c0c616d418fc response_code = 200 uri = /baseboard
30382025-01-09T01:45:46.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41439
30392025-01-09T01:45:46.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41439 req_id = abf4d781-514c-4707-975c-502dabdb3c8e response_code = 200 uri = /vpc-routes
30402025-01-09T01:45:46.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63352
30412025-01-09T01:45:46.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63352 req_id = 7e52e7ca-6d9d-42d7-80dd-7bdf669baab3 response_code = 200 uri = /vpc-routes
30422025-01-09T01:45:46.948ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
30432025-01-09T01:45:46.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41439 req_id = c1d1e649-e849-4658-92e7-7f230b8ceecd response_code = 204 uri = /eip-gateways
30442025-01-09T01:45:47.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
30452025-01-09T01:45:47.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63352 req_id = 33c2bb07-e03a-4fa5-9239-e3b3b45f240a response_code = 204 uri = /eip-gateways
30462025-01-09T01:45:47.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 384 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63352 req_id = 8362f035-5e45-4591-ac62-65588583e320 response_code = 204 uri = /vpc-routes
30472025-01-09T01:45:47.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59623
30482025-01-09T01:45:47.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59623 req_id = bbe492e1-d012-4836-8ca0-2bd471012693 response_code = 200 uri = /v2p
30492025-01-09T01:45:47.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41439 req_id = 5a8b09c6-cdf5-4abc-8788-c703ead777f8 response_code = 204 uri = /vpc-routes
30502025-01-09T01:45:47.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54964
30512025-01-09T01:45:47.248ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
30522025-01-09T01:45:47.292ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
30532025-01-09T01:45:47.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103603 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54964 req_id = 3f1fcaa1-546e-4e16-8b8d-53c6651281e4 response_code = 204 uri = /switch-ports
30542025-01-09T01:45:47.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62778
30552025-01-09T01:45:47.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62753
30562025-01-09T01:45:47.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59336
30572025-01-09T01:45:47.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54964 req_id = ac100100-5478-4c2d-bb83-2f3614b25d78 response_code = 200 uri = /network-bootstore-config
30582025-01-09T01:45:47.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62778 req_id = e3e38cd0-23ef-4bd3-885a-b25b0eb4d57d response_code = 200 uri = /v2p
30592025-01-09T01:45:47.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62753 req_id = 53eec058-fdbf-48f2-bdc3-0beb8675b132 response_code = 200 uri = /vpc-routes
30602025-01-09T01:45:47.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59336 req_id = 14da9d90-60f8-4cb4-bdad-d9596066c9ac response_code = 200 uri = /v2p
30612025-01-09T01:45:47.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47626
30622025-01-09T01:45:47.376ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
30632025-01-09T01:45:47.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
30642025-01-09T01:45:47.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104393 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47626 req_id = 4796faff-9473-4546-bbc1-1acc0ce5a323 response_code = 204 uri = /switch-ports
30652025-01-09T01:45:47.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65500
30662025-01-09T01:45:47.481ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 values = ExternalIpGatewayMap { mappings: {} }
30672025-01-09T01:45:47.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62753 req_id = 62c7a94b-b649-4453-893a-398002eadf38 response_code = 204 uri = /eip-gateways
30682025-01-09T01:45:47.481ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
30692025-01-09T01:45:47.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47626 req_id = b7e0d179-45d7-4c44-b3e5-1772130c9c53 response_code = 200 uri = /network-bootstore-config
30702025-01-09T01:45:47.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62753 req_id = 7c47491f-287e-4f50-a9af-875a9ca7bc06 response_code = 204 uri = /vpc-routes
30712025-01-09T01:45:47.524ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
30722025-01-09T01:45:47.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103752 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65500 req_id = d105932e-87e3-45fc-b7c6-ffc56578f233 response_code = 204 uri = /switch-ports
30732025-01-09T01:45:47.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65500 req_id = e6c5ff9f-d7ce-47bc-9a0a-e113bbf3f36b response_code = 200 uri = /network-bootstore-config
30742025-01-09T01:45:52.683ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
30752025-01-09T01:45:59.465ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7398 local_addr = [fd00:1122:3344:101::1]:56703 method = GET remote_addr = [fd00:1122:3344:101::d]:53456 req_id = 97124c5b-f28e-4e0e-a690-f3ea8a17cb70 response_code = 200 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 uri = /2a5ec8ce-31e5-4982-a156-7cc817b136d7
30762025-01-09T01:46:00.410ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54483
30772025-01-09T01:46:00.411ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54483 req_id = 8513a1f9-225d-45f1-8682-f42ccd576a66 response_code = 200 uri = /baseboard