Max level shown:
1 [ Mar 1 01:12:05 Enabled. ]
2 [ Mar 1 01:12:05 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Mar 1 01:12:05 Method "start" exited with status 0. ]
4 [ Mar 1 01:12:05 Rereading configuration. ]
5 [ Mar 1 01:12:05 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-03-01T01:12:05.118ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-03-01T01:12:05.118ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-03-01T01:12:05.171ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-03-01T01:12:05.171ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-03-01T01:12:05.285ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-03-01T01:12:05.294ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-03-01T01:12:05.302ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-03-01T01:12:05.907ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-03-01T01:12:06.057ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-03-01T01:12:06.057ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-03-01T01:12:06.057ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-03-01T01:12:06.057ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-03-01T01:12:06.057ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-03-01T01:12:06.057ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-03-01T01:12:06.060ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-03-01T01:12:06.060ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-03-01T01:12:06.060ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-03-01T01:12:06.060ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-03-01T01:12:06.060ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-03-01T01:12:06.060ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-03-01T01:12:06.060ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-03-01T01:12:06.060ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-03-01T01:12:06.060ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-03-01T01:12:06.073ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-03-01T01:12:06.073ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool)
322025-03-01T01:12:06.174ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal }
332025-03-01T01:12:06.552ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-03-01T01:12:06.552ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-03-01T01:12:06.552ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-03-01T01:12:06.552ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-03-01T01:12:06.552ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-03-01T01:12:06.552ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-03-01T01:12:06.552ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-03-01T01:12:06.561ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-03-01T01:12:06.561ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 9cd28a53-09cc-4801-86f8-a44529822435 (zpool)
422025-03-01T01:12:06.651ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal }
432025-03-01T01:12:07.018ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-03-01T01:12:07.018ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-03-01T01:12:07.018ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
472025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482025-03-01T01:12:07.018ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-03-01T01:12:07.018ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
502025-03-01T01:12:07.018ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
512025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-03-01T01:12:07.018ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-03-01T01:12:07.018ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-03-01T01:12:07.018ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-03-01T01:12:07.018ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-03-01T01:12:07.018ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-03-01T01:12:07.018ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-03-01T01:12:07.018ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-03-01T01:12:07.018ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632025-03-01T01:12:07.018ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642025-03-01T01:12:07.018ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-03-01T01:12:07.018ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
672025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
682025-03-01T01:12:07.018ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
692025-03-01T01:12:07.018ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702025-03-01T01:12:07.018ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732025-03-01T01:12:07.018ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-03-01T01:12:07.018ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-03-01T01:12:07.018ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-03-01T01:12:07.018ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-03-01T01:12:07.018ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-03-01T01:12:07.018ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-03-01T01:12:07.018ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-03-01T01:12:07.018ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-03-01T01:12:07.019ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-03-01T01:12:07.019ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-03-01T01:12:07.019ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-03-01T01:12:07.019ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-03-01T01:12:07.019ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-03-01T01:12:07.019ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902025-03-01T01:12:07.019ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912025-03-01T01:12:07.019ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922025-03-01T01:12:07.019ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-03-01T01:12:07.019ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-03-01T01:12:07.019ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952025-03-01T01:12:07.019ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962025-03-01T01:12:07.019ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972025-03-01T01:12:07.019ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
982025-03-01T01:12:07.019ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
992025-03-01T01:12:07.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002025-03-01T01:12:07.019ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-03-01T01:12:07.019ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-03-01T01:12:07.019ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-03-01T01:12:07.019ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-03-01T01:12:07.019ZINFOSledAgent (bootstore): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-03-01T01:12:07.019ZINFOSledAgent (bootstore): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-03-01T01:12:07.019ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-03-01T01:12:07.019ZINFOSledAgent (bootstore): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-03-01T01:12:07.019ZINFOSledAgent (bootstore): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-03-01T01:12:07.019ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-03-01T01:12:07.019ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-03-01T01:12:07.019ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-03-01T01:12:07.030ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:715
1132025-03-01T01:12:07.030ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1336, tv_nsec: 953718722 } time_to_next_cleanup = 599.999921719s
1142025-03-01T01:12:07.030ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3936
1152025-03-01T01:12:07.030ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-03-01T01:12:07.031ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-03-01T01:12:07.031ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-03-01T01:12:07.034ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-03-01T01:12:07.035ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-03-01T01:12:07.036ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1195
1212025-03-01T01:12:07.036ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-03-01T01:12:07.036ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-03-01T01:12:07.036ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-03-01T01:12:07.036ZINFOSledAgent (RSS): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/rss-started.marker file = common/src/ledger.rs:188
1252025-03-01T01:12:07.036ZINFOSledAgent (RSS): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/rss-started.marker file = common/src/ledger.rs:188
1262025-03-01T01:12:07.036ZINFOSledAgent (RSS): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-03-01T01:12:07.036ZINFOSledAgent (RSS): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-03-01T01:12:07.036ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1244
1292025-03-01T01:12:07.036ZINFOSledAgent (RSS): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-03-01T01:12:07.036ZINFOSledAgent (RSS): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-03-01T01:12:07.036ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1276
1322025-03-01T01:12:07.036ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-03-01T01:12:07.036ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-03-01T01:12:07.036ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1307
1352025-03-01T01:12:07.037ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-03-01T01:12:07.037ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-03-01T01:12:07.037ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-03-01T01:12:07.037ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-03-01T01:12:07.037ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 3471264f-127e-4a25-bc10-2e8249e8d70a (sled), rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-03-01T01:12:07.038ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4233
1412025-03-01T01:12:07.038ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4633
1422025-03-01T01:12:07.042ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-03-01T01:12:07.048ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-03-01T01:12:07.048ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-03-01T01:12:07.053ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-03-01T01:12:07.053ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-03-01T01:12:07.053ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:58083
1482025-03-01T01:12:07.053ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 3471264f-127e-4a25-bc10-2e8249e8d70a (sled), rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-03-01T01:12:07.053ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-03-01T01:12:07.054ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-03-01T01:12:07.054ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-03-01T01:12:07.054ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-03-01T01:12:07.054ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-03-01T01:12:07.054ZINFOSledAgent (StorageManager): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-03-01T01:12:07.054ZINFOSledAgent (StorageManager): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-03-01T01:12:07.054ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1572025-03-01T01:12:07.054ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1582025-03-01T01:12:07.054ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1592025-03-01T01:12:07.054ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1602025-03-01T01:12:07.054ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-03-01T01:12:07.054ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-03-01T01:12:07.072ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-03-01T01:12:07.094ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-03-01T01:12:07.112ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-03-01T01:12:07.134ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1662025-03-01T01:12:07.134ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-03-01T01:12:07.134ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1682025-03-01T01:12:07.134ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-03-01T01:12:07.138ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 132.779575ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "50fd2e2b-fdfc-4e83-985e-58df92d2ea7d", "content-length": "124", "date": "Sat, 01 Mar 2025 01:12:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "50fd2e2b-fdfc-4e83-985e-58df92d2ea7d" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-03-01T01:12:07.149ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-03-01T01:12:07.174ZINFOSledAgent: successfully created encrypted zvol: name="oxi_c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-03-01T01:12:07.174ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/swap" file = sled-agent/src/swap_device.rs:96
1732025-03-01T01:12:07.179ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1742025-03-01T01:12:07.179ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-03-01T01:12:07.179ZINFOSledAgent (BackingFs): Ensuring dataset oxi_c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-03-01T01:12:07.249ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-03-01T01:12:07.272ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782025-03-01T01:12:07.272ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 113.025126ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "20316931-0604-458d-bd14-c6945490aed2", "content-length": "124", "date": "Sat, 01 Mar 2025 01:12:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "20316931-0604-458d-bd14-c6945490aed2" } file = clients/ddm-admin-client/src/lib.rs:177
1792025-03-01T01:12:07.386ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-03-01T01:12:07.387ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 164.775627ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d2db0dc7-ca9e-46e4-91f3-ecb8de062b58", "content-length": "124", "date": "Sat, 01 Mar 2025 01:12:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d2db0dc7-ca9e-46e4-91f3-ecb8de062b58" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-03-01T01:12:07.468ZINFOSledAgent (BackingFs): Mounting oxi_c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-03-01T01:12:07.480ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-03-01T01:12:07.480ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-03-01T01:12:07.480ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-03-01T01:12:07.480ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-03-01T01:12:07.553ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-03-01T01:12:07.554ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 230.915042ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7f4e10c6-8a97-424c-98d7-5d026a7223ac", "content-length": "124", "date": "Sat, 01 Mar 2025 01:12:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7f4e10c6-8a97-424c-98d7-5d026a7223ac" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-03-01T01:12:07.786ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-03-01T01:12:07.787ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 233.597264ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3745559d-3e54-4b69-a12d-f447e84de2bb", "content-length": "124", "date": "Sat, 01 Mar 2025 01:12:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3745559d-3e54-4b69-a12d-f447e84de2bb" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-03-01T01:12:08.022ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-03-01T01:12:08.023ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 281.034883ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8c8aef99-513d-42bd-a333-ed2da564e520", "content-length": "124", "date": "Sat, 01 Mar 2025 01:12:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8c8aef99-513d-42bd-a333-ed2da564e520" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-03-01T01:12:08.215ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1932025-03-01T01:12:08.220ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:60769 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1942025-03-01T01:12:08.220ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1952025-03-01T01:12:08.220ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:60769 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 3471264f-127e-4a25-bc10-2e8249e8d70a sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1962025-03-01T01:12:08.222ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 185.242382ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1972025-03-01T01:12:08.223ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1982025-03-01T01:12:08.223ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
1992025-03-01T01:12:08.223ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:899 underlay_address = fd00:1122:3344:101::1
2002025-03-01T01:12:08.223ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012025-03-01T01:12:08.305ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022025-03-01T01:12:08.408ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 301.383792ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2032025-03-01T01:12:08.712ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 505.875802ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2042025-03-01T01:12:09.219ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.336476334s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2052025-03-01T01:12:10.818ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2653
2062025-03-01T01:12:10.818ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2898
2072025-03-01T01:12:10.818ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2523
2082025-03-01T01:12:10.818ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2570
2092025-03-01T01:12:10.818ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2979
2102025-03-01T01:12:10.818ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3024
2112025-03-01T01:12:10.820ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2823
2122025-03-01T01:12:10.822ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2564
2132025-03-01T01:12:10.822ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='6b2e87e9-1ee4-42d6-ba1f-82f36c08fbdb'/> <propval type="astring" name="rack_id" value='4854cb88-dfba-4609-8f9d-72aac08cef66'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe00:4cda'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='4854cb88-dfba-4609-8f9d-72aac08cef66'/> <propval type="astring" name="sled_id" value='3471264f-127e-4a25-bc10-2e8249e8d70a'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='3471264f-127e-4a25-bc10-2e8249e8d70a'/> <propval type="astring" name="rack_uuid" value='4854cb88-dfba-4609-8f9d-72aac08cef66'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='3471264f-127e-4a25-bc10-2e8249e8d70a'/> <propval type="astring" name="rack_uuid" value='4854cb88-dfba-4609-8f9d-72aac08cef66'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-03-01T01:12:10.822ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152025-03-01T01:12:11.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 34.117278ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-03-01T01:12:11.404ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 67.942453ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-03-01T01:12:11.635ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 215.931806ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-03-01T01:12:11.636ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.191180056s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2192025-03-01T01:12:12.018ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 347.288511ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-03-01T01:12:12.451ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 417.073129ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-03-01T01:12:12.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.361617311s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-03-01T01:12:14.403ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.084445549s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-03-01T01:12:14.829ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.560026341s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2242025-03-01T01:12:15.648ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 647.1457ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-03-01T01:12:16.324ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 990.806022ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-03-01T01:12:17.746ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272025-03-01T01:12:17.746ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2282025-03-01T01:12:17.747ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3471264f-127e-4a25-bc10-2e8249e8d70a) file = sled-agent/src/nexus.rs:530 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2292025-03-01T01:12:17.748ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2302025-03-01T01:12:17.748ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312025-03-01T01:12:17.748ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322025-03-01T01:12:17.748ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-03-01T01:12:17.748ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-03-01T01:12:17.748ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352025-03-01T01:12:17.748ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362025-03-01T01:12:17.748ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3936
2372025-03-01T01:12:17.748ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:58083
2382025-03-01T01:12:17.939ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2392025-03-01T01:12:17.939ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2402025-03-01T01:12:17.944ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4257 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412025-03-01T01:12:17.944ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4273
2422025-03-01T01:12:17.944ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2432025-03-01T01:12:18.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40411
2442025-03-01T01:12:18.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-03-01T01:12:18.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-03-01T01:12:18.184ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-03-01T01:12:18.184ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-03-01T01:12:18.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 446 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40411 req_id = 2ef823df-7884-42ac-ab3b-e5ab12da7711 response_code = 200 uri = /inventory
2492025-03-01T01:12:18.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61659
2502025-03-01T01:12:18.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61659 req_id = 556b3b83-e888-42c5-8e12-7cff511938f4 response_code = 200 uri = /sled-role
2512025-03-01T01:12:18.225ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2737746046214527941 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2522025-03-01T01:12:18.225ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5116615490741304288 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2532025-03-01T01:12:18.246ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 14788b34-1806-4d42-9be3-6dfbf26dd685 (physical_disk), pool_id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 2724558a-7f18-4e30-accb-56dae0450468 (physical_disk), pool_id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2f3a5614-48a6-42bd-b452-bdc7aba6e164 (physical_disk), pool_id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7feb6f42-372a-4f03-9777-6d418b59ba19 (physical_disk), pool_id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 8ace8623-a919-4a66-bf71-4266e4a31070 (physical_disk), pool_id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: e5365731-20f3-4b2f-a696-08faf99c2bf5 (physical_disk), pool_id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: eabfbb43-88b4-4f71-a342-947389a18dae (physical_disk), pool_id: 275f9857-4588-4c99-8074-92222be09c5b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f8386a14-9353-4faf-b2fc-74f1ca73f35f (physical_disk), pool_id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: fb40cab3-6852-473f-92a9-792d0810b3cb (physical_disk), pool_id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2542025-03-01T01:12:18.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55490
2552025-03-01T01:12:18.246ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:891 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2562025-03-01T01:12:18.246ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 14788b34-1806-4d42-9be3-6dfbf26dd685 (physical_disk), pool_id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 2724558a-7f18-4e30-accb-56dae0450468 (physical_disk), pool_id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2f3a5614-48a6-42bd-b452-bdc7aba6e164 (physical_disk), pool_id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7feb6f42-372a-4f03-9777-6d418b59ba19 (physical_disk), pool_id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 8ace8623-a919-4a66-bf71-4266e4a31070 (physical_disk), pool_id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: e5365731-20f3-4b2f-a696-08faf99c2bf5 (physical_disk), pool_id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: eabfbb43-88b4-4f71-a342-947389a18dae (physical_disk), pool_id: 275f9857-4588-4c99-8074-92222be09c5b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f8386a14-9353-4faf-b2fc-74f1ca73f35f (physical_disk), pool_id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: fb40cab3-6852-473f-92a9-792d0810b3cb (physical_disk), pool_id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2572025-03-01T01:12:18.246ZINFOSledAgent (StorageManager): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582025-03-01T01:12:18.246ZINFOSledAgent (StorageManager): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592025-03-01T01:12:18.246ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2602025-03-01T01:12:18.246ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2612025-03-01T01:12:18.246ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2622025-03-01T01:12:18.246ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2632025-03-01T01:12:18.246ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2642025-03-01T01:12:18.387ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2652025-03-01T01:12:18.387ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool)
2662025-03-01T01:12:18.636ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2672025-03-01T01:12:18.729ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }
2682025-03-01T01:12:18.738ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2692025-03-01T01:12:18.738ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2702025-03-01T01:12:18.738ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2712025-03-01T01:12:18.738ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2722025-03-01T01:12:18.738ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-03-01T01:12:18.738ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742025-03-01T01:12:18.738ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2752025-03-01T01:12:18.749ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3471264f-127e-4a25-bc10-2e8249e8d70a) file = sled-agent/src/probe_manager.rs:238 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
2762025-03-01T01:12:18.773ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772025-03-01T01:12:18.782ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/zone file = sled-storage/src/dataset.rs:302
2782025-03-01T01:12:18.924ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22 file = sled-storage/src/dataset.rs:388
2792025-03-01T01:12:18.932ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802025-03-01T01:12:18.932ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812025-03-01T01:12:18.932ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822025-03-01T01:12:18.932ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832025-03-01T01:12:18.932ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842025-03-01T01:12:18.943ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852025-03-01T01:12:18.943ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool)
2862025-03-01T01:12:19.039ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }
2872025-03-01T01:12:19.047ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2882025-03-01T01:12:19.047ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2892025-03-01T01:12:19.047ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2902025-03-01T01:12:19.047ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2912025-03-01T01:12:19.048ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-03-01T01:12:19.048ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932025-03-01T01:12:19.048ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2942025-03-01T01:12:19.083ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952025-03-01T01:12:19.091ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/zone file = sled-storage/src/dataset.rs:302
2962025-03-01T01:12:19.229ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7 file = sled-storage/src/dataset.rs:388
2972025-03-01T01:12:19.237ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982025-03-01T01:12:19.237ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992025-03-01T01:12:19.237ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002025-03-01T01:12:19.237ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012025-03-01T01:12:19.237ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022025-03-01T01:12:19.247ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032025-03-01T01:12:19.247ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 275f9857-4588-4c99-8074-92222be09c5b (zpool)
3042025-03-01T01:12:19.341ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }
3052025-03-01T01:12:19.349ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062025-03-01T01:12:19.349ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072025-03-01T01:12:19.349ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082025-03-01T01:12:19.349ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092025-03-01T01:12:19.349ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-03-01T01:12:19.349ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112025-03-01T01:12:19.349ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122025-03-01T01:12:19.384ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132025-03-01T01:12:19.391ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 22.512105571s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
3142025-03-01T01:12:19.392ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_275f9857-4588-4c99-8074-92222be09c5b/crypt/zone file = sled-storage/src/dataset.rs:302
3152025-03-01T01:12:19.529ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_275f9857-4588-4c99-8074-92222be09c5b file = sled-storage/src/dataset.rs:388
3162025-03-01T01:12:19.537ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3172025-03-01T01:12:19.537ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3182025-03-01T01:12:19.537ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3192025-03-01T01:12:19.537ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3202025-03-01T01:12:19.537ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3212025-03-01T01:12:19.548ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3222025-03-01T01:12:19.548ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool)
3232025-03-01T01:12:19.639ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }
3242025-03-01T01:12:19.647ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3252025-03-01T01:12:19.647ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3262025-03-01T01:12:19.647ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3272025-03-01T01:12:19.647ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3282025-03-01T01:12:19.647ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292025-03-01T01:12:19.647ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302025-03-01T01:12:19.647ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3312025-03-01T01:12:19.684ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322025-03-01T01:12:19.692ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone file = sled-storage/src/dataset.rs:302
3332025-03-01T01:12:19.752ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3471264f-127e-4a25-bc10-2e8249e8d70a) file = sled-agent/src/probe_manager.rs:238 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
3342025-03-01T01:12:19.833ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1 file = sled-storage/src/dataset.rs:388
3352025-03-01T01:12:19.841ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3362025-03-01T01:12:19.841ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3372025-03-01T01:12:19.841ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3382025-03-01T01:12:19.841ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3392025-03-01T01:12:19.841ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402025-03-01T01:12:19.851ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3412025-03-01T01:12:19.851ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool)
3422025-03-01T01:12:19.944ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }
3432025-03-01T01:12:19.953ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3442025-03-01T01:12:19.953ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3452025-03-01T01:12:19.953ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3462025-03-01T01:12:19.953ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3472025-03-01T01:12:19.953ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482025-03-01T01:12:19.953ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492025-03-01T01:12:19.953ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3502025-03-01T01:12:19.988ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512025-03-01T01:12:19.996ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/zone file = sled-storage/src/dataset.rs:302
3522025-03-01T01:12:20.136ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 file = sled-storage/src/dataset.rs:388
3532025-03-01T01:12:20.145ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3542025-03-01T01:12:20.145ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3552025-03-01T01:12:20.145ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3562025-03-01T01:12:20.145ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3572025-03-01T01:12:20.145ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582025-03-01T01:12:20.154ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3592025-03-01T01:12:20.154ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool)
3602025-03-01T01:12:20.248ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }
3612025-03-01T01:12:20.255ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3622025-03-01T01:12:20.255ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3632025-03-01T01:12:20.255ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3642025-03-01T01:12:20.255ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3652025-03-01T01:12:20.255ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662025-03-01T01:12:20.255ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672025-03-01T01:12:20.255ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3682025-03-01T01:12:20.291ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692025-03-01T01:12:20.298ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc/crypt/zone file = sled-storage/src/dataset.rs:302
3702025-03-01T01:12:20.426ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc file = sled-storage/src/dataset.rs:388
3712025-03-01T01:12:20.433ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3722025-03-01T01:12:20.433ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3732025-03-01T01:12:20.433ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3742025-03-01T01:12:20.433ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752025-03-01T01:12:20.433ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762025-03-01T01:12:20.441ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3772025-03-01T01:12:20.441ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c995cf87-df16-4488-b492-a0cb308dc53a (zpool)
3782025-03-01T01:12:20.534ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }
3792025-03-01T01:12:20.541ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3802025-03-01T01:12:20.541ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3812025-03-01T01:12:20.541ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3822025-03-01T01:12:20.541ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3832025-03-01T01:12:20.541ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842025-03-01T01:12:20.542ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852025-03-01T01:12:20.542ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3862025-03-01T01:12:20.574ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872025-03-01T01:12:20.581ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone file = sled-storage/src/dataset.rs:302
3882025-03-01T01:12:20.718ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c995cf87-df16-4488-b492-a0cb308dc53a file = sled-storage/src/dataset.rs:388
3892025-03-01T01:12:20.725ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902025-03-01T01:12:20.725ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912025-03-01T01:12:20.725ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922025-03-01T01:12:20.725ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932025-03-01T01:12:20.725ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942025-03-01T01:12:20.735ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952025-03-01T01:12:20.735ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool)
3962025-03-01T01:12:20.830ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }
3972025-03-01T01:12:20.838ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3982025-03-01T01:12:20.838ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3992025-03-01T01:12:20.838ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4002025-03-01T01:12:20.838ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4012025-03-01T01:12:20.838ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-03-01T01:12:20.838ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032025-03-01T01:12:20.838ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4042025-03-01T01:12:20.842ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3471264f-127e-4a25-bc10-2e8249e8d70a) file = sled-agent/src/probe_manager.rs:238 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4052025-03-01T01:12:20.871ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4062025-03-01T01:12:20.880ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/zone file = sled-storage/src/dataset.rs:302
4072025-03-01T01:12:21.016ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7 file = sled-storage/src/dataset.rs:388
4082025-03-01T01:12:21.025ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4092025-03-01T01:12:21.025ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4102025-03-01T01:12:21.025ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4112025-03-01T01:12:21.025ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4122025-03-01T01:12:21.025ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4132025-03-01T01:12:21.035ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4142025-03-01T01:12:21.035ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool)
4152025-03-01T01:12:21.147ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }
4162025-03-01T01:12:21.155ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4172025-03-01T01:12:21.155ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4182025-03-01T01:12:21.155ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4192025-03-01T01:12:21.155ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4202025-03-01T01:12:21.155ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212025-03-01T01:12:21.156ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222025-03-01T01:12:21.156ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4232025-03-01T01:12:21.195ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4242025-03-01T01:12:21.203ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone file = sled-storage/src/dataset.rs:302
4252025-03-01T01:12:21.344ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9 file = sled-storage/src/dataset.rs:388
4262025-03-01T01:12:21.352ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4272025-03-01T01:12:21.352ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4282025-03-01T01:12:21.352ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4292025-03-01T01:12:21.352ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9cd28a53-09cc-4801-86f8-a44529822435 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4302025-03-01T01:12:21.352ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4312025-03-01T01:12:21.352ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4322025-03-01T01:12:21.352ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332025-03-01T01:12:21.353ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:895 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4342025-03-01T01:12:21.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4352025-03-01T01:12:21.353ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:921 generation = Generation(2) sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4362025-03-01T01:12:21.353ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:926 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4372025-03-01T01:12:21.353ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:931 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4382025-03-01T01:12:21.353ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4392025-03-01T01:12:21.353ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:937 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4402025-03-01T01:12:21.353ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4412025-03-01T01:12:21.353ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:942 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4422025-03-01T01:12:21.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3106895 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55490 req_id = 0252f4b3-de74-4281-b9f5-9e83973537f0 response_code = 200 uri = /omicron-physical-disks
4432025-03-01T01:12:21.384ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {06376062-7a60-40e2-8635-95627c947c84 (dataset): DatasetConfig { id: 06376062-7a60-40e2-8635-95627c947c84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ea770af-98fa-4440-91d9-a204cf9e0b00 (dataset): DatasetConfig { id: 0ea770af-98fa-4440-91d9-a204cf9e0b00 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 118d8517-aaf7-46d5-8aea-6ebea6a4ffbd (dataset): DatasetConfig { id: 118d8517-aaf7-46d5-8aea-6ebea6a4ffbd (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 134dfa85-8824-467d-b606-7a0123d0ee96 (dataset): DatasetConfig { id: 134dfa85-8824-467d-b606-7a0123d0ee96 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15f31da5-59ed-4e92-a315-538de1be71e3 (dataset): DatasetConfig { id: 15f31da5-59ed-4e92-a315-538de1be71e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c3968d5-8fcd-4f88-918f-6c0abf31f01b (dataset): DatasetConfig { id: 1c3968d5-8fcd-4f88-918f-6c0abf31f01b (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2271b5e2-bee2-4dd3-9c82-6044215ff726 (dataset): DatasetConfig { id: 2271b5e2-bee2-4dd3-9c82-6044215ff726 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 25d7be55-3c1e-4e4f-ba52-c26abe370e4f (dataset): DatasetConfig { id: 25d7be55-3c1e-4e4f-ba52-c26abe370e4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2a4a45a0-f02f-4e78-ab60-cf7c00a45792 (dataset): DatasetConfig { id: 2a4a45a0-f02f-4e78-ab60-cf7c00a45792 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ba7b2ff-a333-4877-b285-99bdcd0491a7 (dataset): DatasetConfig { id: 2ba7b2ff-a333-4877-b285-99bdcd0491a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d735247-89bb-4041-91df-2cb7a8b6b572 (dataset): DatasetConfig { id: 2d735247-89bb-4041-91df-2cb7a8b6b572 (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37fbe40d-dc8a-4d78-b994-1eb4ff960d69 (dataset): DatasetConfig { id: 37fbe40d-dc8a-4d78-b994-1eb4ff960d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38f53f18-5ed4-433a-9333-1f8de4cb23eb (dataset): DatasetConfig { id: 38f53f18-5ed4-433a-9333-1f8de4cb23eb (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f432a5e-2d11-4361-baa7-de65b95f6d92 (dataset): DatasetConfig { id: 3f432a5e-2d11-4361-baa7-de65b95f6d92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47cb3822-6c4a-486a-9fba-9b677e89cf19 (dataset): DatasetConfig { id: 47cb3822-6c4a-486a-9fba-9b677e89cf19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 49f50f41-9396-4a31-b717-63f1054b6fb6 (dataset): DatasetConfig { id: 49f50f41-9396-4a31-b717-63f1054b6fb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b82c309-1b72-46d5-aa33-079024434dfe (dataset): DatasetConfig { id: 4b82c309-1b72-46d5-aa33-079024434dfe (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d2e8402-df31-4281-8eb6-897a52dc29f3 (dataset): DatasetConfig { id: 4d2e8402-df31-4281-8eb6-897a52dc29f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53228cf9-b57c-49b4-b3b5-c04ab53d5164 (dataset): DatasetConfig { id: 53228cf9-b57c-49b4-b3b5-c04ab53d5164 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59f4eee3-31bc-4434-b5ff-4b6998c3f34a (dataset): DatasetConfig { id: 59f4eee3-31bc-4434-b5ff-4b6998c3f34a (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59fdb4ee-66d2-4381-a1eb-7c4601ba9018 (dataset): DatasetConfig { id: 59fdb4ee-66d2-4381-a1eb-7c4601ba9018 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cd42d44-5baa-4b5d-9e90-520c7b1f24ec (dataset): DatasetConfig { id: 5cd42d44-5baa-4b5d-9e90-520c7b1f24ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f8a1b27-27c6-43fa-9822-36aafb87804e (dataset): DatasetConfig { id: 5f8a1b27-27c6-43fa-9822-36aafb87804e (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fdc7b36-3f59-4264-ab17-b913c560ad4a (dataset): DatasetConfig { id: 5fdc7b36-3f59-4264-ab17-b913c560ad4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 603fa279-7803-491a-bbc8-e65a1f36f9f7 (dataset): DatasetConfig { id: 603fa279-7803-491a-bbc8-e65a1f36f9f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6197eedb-0653-401c-979c-a68797d9b3a0 (dataset): DatasetConfig { id: 6197eedb-0653-401c-979c-a68797d9b3a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65fd00e8-8cef-48b4-ab20-90d9d3dbfb4c (dataset): DatasetConfig { id: 65fd00e8-8cef-48b4-ab20-90d9d3dbfb4c (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ba70be4-c5ee-4c9e-a9cc-b85df0dfce03 (dataset): DatasetConfig { id: 6ba70be4-c5ee-4c9e-a9cc-b85df0dfce03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73a1e6b9-7842-4391-a420-4af520489e51 (dataset): DatasetConfig { id: 73a1e6b9-7842-4391-a420-4af520489e51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75e8bcee-d046-4057-ab09-93f2e7a21916 (dataset): DatasetConfig { id: 75e8bcee-d046-4057-ab09-93f2e7a21916 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 76b48e8c-de37-4df2-b9e8-6c7c2d8b4d49 (dataset): DatasetConfig { id: 76b48e8c-de37-4df2-b9e8-6c7c2d8b4d49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7955e9df-83fe-4f09-b03b-5f6006654a9c (dataset): DatasetConfig { id: 7955e9df-83fe-4f09-b03b-5f6006654a9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79f83d12-db99-4498-8545-e6a5d70e1f18 (dataset): DatasetConfig { id: 79f83d12-db99-4498-8545-e6a5d70e1f18 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c7c3bfa-5fe7-409f-9c24-ed36c481bb9b (dataset): DatasetConfig { id: 7c7c3bfa-5fe7-409f-9c24-ed36c481bb9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 804c0ce5-aa36-463b-99a9-af7c07eba285 (dataset): DatasetConfig { id: 804c0ce5-aa36-463b-99a9-af7c07eba285 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85d39d02-36de-4261-96a3-02f689a4b312 (dataset): DatasetConfig { id: 85d39d02-36de-4261-96a3-02f689a4b312 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 863e4c9a-87cb-4323-b0cb-8db2e4afeb05 (dataset): DatasetConfig { id: 863e4c9a-87cb-4323-b0cb-8db2e4afeb05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9840461a-bee8-4994-9906-98d58d2d00f1 (dataset): DatasetConfig { id: 9840461a-bee8-4994-9906-98d58d2d00f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f0429dd-5e7d-4aaa-bd76-9d25f60aff79 (dataset): DatasetConfig { id: 9f0429dd-5e7d-4aaa-bd76-9d25f60aff79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a34a9182-f085-4f93-ba8a-7099f46369cc (dataset): DatasetConfig { id: a34a9182-f085-4f93-ba8a-7099f46369cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a3742675-bef6-4da2-b9de-4ca8ea098c54 (dataset): DatasetConfig { id: a3742675-bef6-4da2-b9de-4ca8ea098c54 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4820cf5-8e95-4cc8-8a61-c67509bebfca (dataset): DatasetConfig { id: a4820cf5-8e95-4cc8-8a61-c67509bebfca (dataset), name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6d1a2c6-c9e6-48a1-8897-cd0652d983e5 (dataset): DatasetConfig { id: a6d1a2c6-c9e6-48a1-8897-cd0652d983e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad7ce554-093f-48fa-8215-94bbec0e6ce4 (dataset): DatasetConfig { id: ad7ce554-093f-48fa-8215-94bbec0e6ce4 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0606f8b-8ee7-465f-90fe-94379588b78a (dataset): DatasetConfig { id: b0606f8b-8ee7-465f-90fe-94379588b78a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2f8d910-9613-48a7-90ff-4878b1d0fc11 (dataset): DatasetConfig { id: b2f8d910-9613-48a7-90ff-4878b1d0fc11 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7c19412-784e-4d7e-b83b-b0a28e3fdef8 (dataset): DatasetConfig { id: b7c19412-784e-4d7e-b83b-b0a28e3fdef8 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd13443b-e93c-4bfd-8400-6ec0fec2039c (dataset): DatasetConfig { id: bd13443b-e93c-4bfd-8400-6ec0fec2039c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c012d917-faef-4f25-a709-a4832f5fa89d (dataset): DatasetConfig { id: c012d917-faef-4f25-a709-a4832f5fa89d (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c0d3bec3-02d5-4ae9-964d-f88e693f61df (dataset): DatasetConfig { id: c0d3bec3-02d5-4ae9-964d-f88e693f61df (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c63dcaa4-c5b6-4a78-ae65-9d3134ac4c0d (dataset): DatasetConfig { id: c63dcaa4-c5b6-4a78-ae65-9d3134ac4c0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c99b0d82-b263-478b-824b-bce7ae4651b1 (dataset): DatasetConfig { id: c99b0d82-b263-478b-824b-bce7ae4651b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc2a89da-7264-464d-ad43-7d374020b8d7 (dataset): DatasetConfig { id: cc2a89da-7264-464d-ad43-7d374020b8d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df757264-6ea5-4b52-8497-090298f3acf9 (dataset): DatasetConfig { id: df757264-6ea5-4b52-8497-090298f3acf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4b9bb54-2e83-415a-9369-ed6a3b35663d (dataset): DatasetConfig { id: e4b9bb54-2e83-415a-9369-ed6a3b35663d (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e63e598b-0f2b-48e6-a842-ddff402148cf (dataset): DatasetConfig { id: e63e598b-0f2b-48e6-a842-ddff402148cf (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8fef3be-9977-4b03-b551-d638109ec4c2 (dataset): DatasetConfig { id: e8fef3be-9977-4b03-b551-d638109ec4c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb535043-fa26-41c4-bcdc-c885d4b3731c (dataset): DatasetConfig { id: eb535043-fa26-41c4-bcdc-c885d4b3731c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eba3184e-d966-43b9-9d9f-071249bca456 (dataset): DatasetConfig { id: eba3184e-d966-43b9-9d9f-071249bca456 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0d9c9bf-88a1-465a-a40d-0cd430226e54 (dataset): DatasetConfig { id: f0d9c9bf-88a1-465a-a40d-0cd430226e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3770169-c33b-42e5-96c3-c372eaa1c2ec (dataset): DatasetConfig { id: f3770169-c33b-42e5-96c3-c372eaa1c2ec (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3cd5c4f-e51b-487d-a91b-e17d1b7cf753 (dataset): DatasetConfig { id: f3cd5c4f-e51b-487d-a91b-e17d1b7cf753 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f45f4cce-88d6-4cac-b5c1-00d40f28535d (dataset): DatasetConfig { id: f45f4cce-88d6-4cac-b5c1-00d40f28535d (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fde12dd3-f699-49c1-913f-16d04e9c6164 (dataset): DatasetConfig { id: fde12dd3-f699-49c1-913f-16d04e9c6164 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdedce74-0590-4c1e-b9c6-afb161a24525 (dataset): DatasetConfig { id: fdedce74-0590-4c1e-b9c6-afb161a24525 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffa9647c-ae32-4093-a043-0745a443db92 (dataset): DatasetConfig { id: ffa9647c-ae32-4093-a043-0745a443db92 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4442025-03-01T01:12:21.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34515
4452025-03-01T01:12:21.385ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:857 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4462025-03-01T01:12:21.385ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {06376062-7a60-40e2-8635-95627c947c84 (dataset): DatasetConfig { id: 06376062-7a60-40e2-8635-95627c947c84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ea770af-98fa-4440-91d9-a204cf9e0b00 (dataset): DatasetConfig { id: 0ea770af-98fa-4440-91d9-a204cf9e0b00 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 118d8517-aaf7-46d5-8aea-6ebea6a4ffbd (dataset): DatasetConfig { id: 118d8517-aaf7-46d5-8aea-6ebea6a4ffbd (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 134dfa85-8824-467d-b606-7a0123d0ee96 (dataset): DatasetConfig { id: 134dfa85-8824-467d-b606-7a0123d0ee96 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15f31da5-59ed-4e92-a315-538de1be71e3 (dataset): DatasetConfig { id: 15f31da5-59ed-4e92-a315-538de1be71e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c3968d5-8fcd-4f88-918f-6c0abf31f01b (dataset): DatasetConfig { id: 1c3968d5-8fcd-4f88-918f-6c0abf31f01b (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2271b5e2-bee2-4dd3-9c82-6044215ff726 (dataset): DatasetConfig { id: 2271b5e2-bee2-4dd3-9c82-6044215ff726 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 25d7be55-3c1e-4e4f-ba52-c26abe370e4f (dataset): DatasetConfig { id: 25d7be55-3c1e-4e4f-ba52-c26abe370e4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2a4a45a0-f02f-4e78-ab60-cf7c00a45792 (dataset): DatasetConfig { id: 2a4a45a0-f02f-4e78-ab60-cf7c00a45792 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ba7b2ff-a333-4877-b285-99bdcd0491a7 (dataset): DatasetConfig { id: 2ba7b2ff-a333-4877-b285-99bdcd0491a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d735247-89bb-4041-91df-2cb7a8b6b572 (dataset): DatasetConfig { id: 2d735247-89bb-4041-91df-2cb7a8b6b572 (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37fbe40d-dc8a-4d78-b994-1eb4ff960d69 (dataset): DatasetConfig { id: 37fbe40d-dc8a-4d78-b994-1eb4ff960d69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38f53f18-5ed4-433a-9333-1f8de4cb23eb (dataset): DatasetConfig { id: 38f53f18-5ed4-433a-9333-1f8de4cb23eb (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f432a5e-2d11-4361-baa7-de65b95f6d92 (dataset): DatasetConfig { id: 3f432a5e-2d11-4361-baa7-de65b95f6d92 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47cb3822-6c4a-486a-9fba-9b677e89cf19 (dataset): DatasetConfig { id: 47cb3822-6c4a-486a-9fba-9b677e89cf19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 49f50f41-9396-4a31-b717-63f1054b6fb6 (dataset): DatasetConfig { id: 49f50f41-9396-4a31-b717-63f1054b6fb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b82c309-1b72-46d5-aa33-079024434dfe (dataset): DatasetConfig { id: 4b82c309-1b72-46d5-aa33-079024434dfe (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d2e8402-df31-4281-8eb6-897a52dc29f3 (dataset): DatasetConfig { id: 4d2e8402-df31-4281-8eb6-897a52dc29f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53228cf9-b57c-49b4-b3b5-c04ab53d5164 (dataset): DatasetConfig { id: 53228cf9-b57c-49b4-b3b5-c04ab53d5164 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59f4eee3-31bc-4434-b5ff-4b6998c3f34a (dataset): DatasetConfig { id: 59f4eee3-31bc-4434-b5ff-4b6998c3f34a (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59fdb4ee-66d2-4381-a1eb-7c4601ba9018 (dataset): DatasetConfig { id: 59fdb4ee-66d2-4381-a1eb-7c4601ba9018 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cd42d44-5baa-4b5d-9e90-520c7b1f24ec (dataset): DatasetConfig { id: 5cd42d44-5baa-4b5d-9e90-520c7b1f24ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f8a1b27-27c6-43fa-9822-36aafb87804e (dataset): DatasetConfig { id: 5f8a1b27-27c6-43fa-9822-36aafb87804e (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fdc7b36-3f59-4264-ab17-b913c560ad4a (dataset): DatasetConfig { id: 5fdc7b36-3f59-4264-ab17-b913c560ad4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 603fa279-7803-491a-bbc8-e65a1f36f9f7 (dataset): DatasetConfig { id: 603fa279-7803-491a-bbc8-e65a1f36f9f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6197eedb-0653-401c-979c-a68797d9b3a0 (dataset): DatasetConfig { id: 6197eedb-0653-401c-979c-a68797d9b3a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65fd00e8-8cef-48b4-ab20-90d9d3dbfb4c (dataset): DatasetConfig { id: 65fd00e8-8cef-48b4-ab20-90d9d3dbfb4c (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ba70be4-c5ee-4c9e-a9cc-b85df0dfce03 (dataset): DatasetConfig { id: 6ba70be4-c5ee-4c9e-a9cc-b85df0dfce03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73a1e6b9-7842-4391-a420-4af520489e51 (dataset): DatasetConfig { id: 73a1e6b9-7842-4391-a420-4af520489e51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75e8bcee-d046-4057-ab09-93f2e7a21916 (dataset): DatasetConfig { id: 75e8bcee-d046-4057-ab09-93f2e7a21916 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 76b48e8c-de37-4df2-b9e8-6c7c2d8b4d49 (dataset): DatasetConfig { id: 76b48e8c-de37-4df2-b9e8-6c7c2d8b4d49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7955e9df-83fe-4f09-b03b-5f6006654a9c (dataset): DatasetConfig { id: 7955e9df-83fe-4f09-b03b-5f6006654a9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79f83d12-db99-4498-8545-e6a5d70e1f18 (dataset): DatasetConfig { id: 79f83d12-db99-4498-8545-e6a5d70e1f18 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c7c3bfa-5fe7-409f-9c24-ed36c481bb9b (dataset): DatasetConfig { id: 7c7c3bfa-5fe7-409f-9c24-ed36c481bb9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 804c0ce5-aa36-463b-99a9-af7c07eba285 (dataset): DatasetConfig { id: 804c0ce5-aa36-463b-99a9-af7c07eba285 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85d39d02-36de-4261-96a3-02f689a4b312 (dataset): DatasetConfig { id: 85d39d02-36de-4261-96a3-02f689a4b312 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 863e4c9a-87cb-4323-b0cb-8db2e4afeb05 (dataset): DatasetConfig { id: 863e4c9a-87cb-4323-b0cb-8db2e4afeb05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9840461a-bee8-4994-9906-98d58d2d00f1 (dataset): DatasetConfig { id: 9840461a-bee8-4994-9906-98d58d2d00f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f0429dd-5e7d-4aaa-bd76-9d25f60aff79 (dataset): DatasetConfig { id: 9f0429dd-5e7d-4aaa-bd76-9d25f60aff79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a34a9182-f085-4f93-ba8a-7099f46369cc (dataset): DatasetConfig { id: a34a9182-f085-4f93-ba8a-7099f46369cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a3742675-bef6-4da2-b9de-4ca8ea098c54 (dataset): DatasetConfig { id: a3742675-bef6-4da2-b9de-4ca8ea098c54 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4820cf5-8e95-4cc8-8a61-c67509bebfca (dataset): DatasetConfig { id: a4820cf5-8e95-4cc8-8a61-c67509bebfca (dataset), name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6d1a2c6-c9e6-48a1-8897-cd0652d983e5 (dataset): DatasetConfig { id: a6d1a2c6-c9e6-48a1-8897-cd0652d983e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad7ce554-093f-48fa-8215-94bbec0e6ce4 (dataset): DatasetConfig { id: ad7ce554-093f-48fa-8215-94bbec0e6ce4 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0606f8b-8ee7-465f-90fe-94379588b78a (dataset): DatasetConfig { id: b0606f8b-8ee7-465f-90fe-94379588b78a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2f8d910-9613-48a7-90ff-4878b1d0fc11 (dataset): DatasetConfig { id: b2f8d910-9613-48a7-90ff-4878b1d0fc11 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7c19412-784e-4d7e-b83b-b0a28e3fdef8 (dataset): DatasetConfig { id: b7c19412-784e-4d7e-b83b-b0a28e3fdef8 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd13443b-e93c-4bfd-8400-6ec0fec2039c (dataset): DatasetConfig { id: bd13443b-e93c-4bfd-8400-6ec0fec2039c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c012d917-faef-4f25-a709-a4832f5fa89d (dataset): DatasetConfig { id: c012d917-faef-4f25-a709-a4832f5fa89d (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c0d3bec3-02d5-4ae9-964d-f88e693f61df (dataset): DatasetConfig { id: c0d3bec3-02d5-4ae9-964d-f88e693f61df (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c63dcaa4-c5b6-4a78-ae65-9d3134ac4c0d (dataset): DatasetConfig { id: c63dcaa4-c5b6-4a78-ae65-9d3134ac4c0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c99b0d82-b263-478b-824b-bce7ae4651b1 (dataset): DatasetConfig { id: c99b0d82-b263-478b-824b-bce7ae4651b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc2a89da-7264-464d-ad43-7d374020b8d7 (dataset): DatasetConfig { id: cc2a89da-7264-464d-ad43-7d374020b8d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df757264-6ea5-4b52-8497-090298f3acf9 (dataset): DatasetConfig { id: df757264-6ea5-4b52-8497-090298f3acf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4b9bb54-2e83-415a-9369-ed6a3b35663d (dataset): DatasetConfig { id: e4b9bb54-2e83-415a-9369-ed6a3b35663d (dataset), name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e63e598b-0f2b-48e6-a842-ddff402148cf (dataset): DatasetConfig { id: e63e598b-0f2b-48e6-a842-ddff402148cf (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8fef3be-9977-4b03-b551-d638109ec4c2 (dataset): DatasetConfig { id: e8fef3be-9977-4b03-b551-d638109ec4c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb535043-fa26-41c4-bcdc-c885d4b3731c (dataset): DatasetConfig { id: eb535043-fa26-41c4-bcdc-c885d4b3731c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eba3184e-d966-43b9-9d9f-071249bca456 (dataset): DatasetConfig { id: eba3184e-d966-43b9-9d9f-071249bca456 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0d9c9bf-88a1-465a-a40d-0cd430226e54 (dataset): DatasetConfig { id: f0d9c9bf-88a1-465a-a40d-0cd430226e54 (dataset), name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3770169-c33b-42e5-96c3-c372eaa1c2ec (dataset): DatasetConfig { id: f3770169-c33b-42e5-96c3-c372eaa1c2ec (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3cd5c4f-e51b-487d-a91b-e17d1b7cf753 (dataset): DatasetConfig { id: f3cd5c4f-e51b-487d-a91b-e17d1b7cf753 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f45f4cce-88d6-4cac-b5c1-00d40f28535d (dataset): DatasetConfig { id: f45f4cce-88d6-4cac-b5c1-00d40f28535d (dataset), name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fde12dd3-f699-49c1-913f-16d04e9c6164 (dataset): DatasetConfig { id: fde12dd3-f699-49c1-913f-16d04e9c6164 (dataset), name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdedce74-0590-4c1e-b9c6-afb161a24525 (dataset): DatasetConfig { id: fdedce74-0590-4c1e-b9c6-afb161a24525 (dataset), name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffa9647c-ae32-4093-a043-0745a443db92 (dataset): DatasetConfig { id: ffa9647c-ae32-4093-a043-0745a443db92 (dataset), name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4472025-03-01T01:12:21.385ZINFOSledAgent (StorageManager): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482025-03-01T01:12:21.385ZINFOSledAgent (StorageManager): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492025-03-01T01:12:21.385ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4502025-03-01T01:12:21.400ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4512025-03-01T01:12:21.400ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4522025-03-01T01:12:21.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone" } file = sled-storage/src/manager.rs:1431
4532025-03-01T01:12:21.429ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542025-03-01T01:12:21.429ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4552025-03-01T01:12:21.429ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4562025-03-01T01:12:21.480ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572025-03-01T01:12:21.480ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582025-03-01T01:12:21.480ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/zone/oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee"), full_name: "oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/zone/oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee" } file = sled-storage/src/manager.rs:1431
4592025-03-01T01:12:21.542ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602025-03-01T01:12:21.542ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612025-03-01T01:12:21.542ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/zone/oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da"), full_name: "oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/zone/oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da" } file = sled-storage/src/manager.rs:1431
4622025-03-01T01:12:21.602ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632025-03-01T01:12:21.602ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4642025-03-01T01:12:21.602ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/zone"), full_name: "oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/zone" } file = sled-storage/src/manager.rs:1431
4652025-03-01T01:12:21.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662025-03-01T01:12:21.632ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4672025-03-01T01:12:21.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/zone"), full_name: "oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/zone" } file = sled-storage/src/manager.rs:1431
4682025-03-01T01:12:21.661ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692025-03-01T01:12:21.661ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4702025-03-01T01:12:21.661ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/debug"), full_name: "oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/debug" } file = sled-storage/src/manager.rs:1431
4712025-03-01T01:12:21.690ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722025-03-01T01:12:21.690ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4732025-03-01T01:12:21.690ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/debug"), full_name: "oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/debug" } file = sled-storage/src/manager.rs:1431
4742025-03-01T01:12:21.719ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752025-03-01T01:12:21.719ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762025-03-01T01:12:21.719ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4772025-03-01T01:12:21.768ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782025-03-01T01:12:21.768ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4792025-03-01T01:12:21.768ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/debug"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/debug" } file = sled-storage/src/manager.rs:1431
4802025-03-01T01:12:21.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812025-03-01T01:12:21.797ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822025-03-01T01:12:21.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/zone/oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1"), full_name: "oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/zone/oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1" } file = sled-storage/src/manager.rs:1431
4832025-03-01T01:12:21.844ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3471264f-127e-4a25-bc10-2e8249e8d70a) file = sled-agent/src/probe_manager.rs:238 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
4842025-03-01T01:12:21.857ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852025-03-01T01:12:21.857ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4862025-03-01T01:12:21.857ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/275f9857-4588-4c99-8074-92222be09c5b/crypt/zone"), full_name: "oxp_275f9857-4588-4c99-8074-92222be09c5b/crypt/zone" } file = sled-storage/src/manager.rs:1431
4872025-03-01T01:12:21.887ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882025-03-01T01:12:21.887ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4892025-03-01T01:12:21.887ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crucible" } file = sled-storage/src/manager.rs:1431
4902025-03-01T01:12:21.938ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912025-03-01T01:12:21.938ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4922025-03-01T01:12:21.938ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/zone/oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101"), full_name: "oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/zone/oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101" } file = sled-storage/src/manager.rs:1431
4932025-03-01T01:12:21.998ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942025-03-01T01:12:21.998ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4952025-03-01T01:12:21.998ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/debug"), full_name: "oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/debug" } file = sled-storage/src/manager.rs:1431
4962025-03-01T01:12:22.028ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972025-03-01T01:12:22.028ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4982025-03-01T01:12:22.028ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c" } file = sled-storage/src/manager.rs:1431
4992025-03-01T01:12:22.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002025-03-01T01:12:22.090ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5012025-03-01T01:12:22.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/275f9857-4588-4c99-8074-92222be09c5b/crypt/zone/oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc"), full_name: "oxp_275f9857-4588-4c99-8074-92222be09c5b/crypt/zone/oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc" } file = sled-storage/src/manager.rs:1431
5022025-03-01T01:12:22.150ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032025-03-01T01:12:22.150ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5042025-03-01T01:12:22.150ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crucible" } file = sled-storage/src/manager.rs:1431
5052025-03-01T01:12:22.198ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062025-03-01T01:12:22.198ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5072025-03-01T01:12:22.199ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93" } file = sled-storage/src/manager.rs:1431
5082025-03-01T01:12:22.258ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092025-03-01T01:12:22.259ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5102025-03-01T01:12:22.259ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7/crucible" } file = sled-storage/src/manager.rs:1431
5112025-03-01T01:12:22.306ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122025-03-01T01:12:22.306ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5132025-03-01T01:12:22.306ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70" } file = sled-storage/src/manager.rs:1431
5142025-03-01T01:12:22.365ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152025-03-01T01:12:22.365ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5162025-03-01T01:12:22.365ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158" } file = sled-storage/src/manager.rs:1431
5172025-03-01T01:12:22.426ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182025-03-01T01:12:22.426ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5192025-03-01T01:12:22.426ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone" } file = sled-storage/src/manager.rs:1431
5202025-03-01T01:12:22.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212025-03-01T01:12:22.457ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5222025-03-01T01:12:22.457ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/zone/oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89"), full_name: "oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/zone/oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89" } file = sled-storage/src/manager.rs:1431
5232025-03-01T01:12:22.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242025-03-01T01:12:22.517ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252025-03-01T01:12:22.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5262025-03-01T01:12:22.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272025-03-01T01:12:22.569ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5282025-03-01T01:12:22.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_275f9857-4588-4c99-8074-92222be09c5b/crucible" } file = sled-storage/src/manager.rs:1431
5292025-03-01T01:12:22.617ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302025-03-01T01:12:22.617ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5312025-03-01T01:12:22.617ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5322025-03-01T01:12:22.647ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-03-01T01:12:22.647ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342025-03-01T01:12:22.647ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703" } file = sled-storage/src/manager.rs:1431
5352025-03-01T01:12:22.708ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-03-01T01:12:22.708ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372025-03-01T01:12:22.708ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/zone/oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6"), full_name: "oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/zone/oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6" } file = sled-storage/src/manager.rs:1431
5382025-03-01T01:12:22.768ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-03-01T01:12:22.768ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5402025-03-01T01:12:22.768ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/debug"), full_name: "oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/debug" } file = sled-storage/src/manager.rs:1431
5412025-03-01T01:12:22.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422025-03-01T01:12:22.797ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5432025-03-01T01:12:22.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/31eb221a-8007-4b0c-915f-9fe13203b4cc/crypt/debug"), full_name: "oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc/crypt/debug" } file = sled-storage/src/manager.rs:1431
5442025-03-01T01:12:22.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-03-01T01:12:22.825ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462025-03-01T01:12:22.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/zone/oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e"), full_name: "oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/zone/oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e" } file = sled-storage/src/manager.rs:1431
5472025-03-01T01:12:22.845ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3471264f-127e-4a25-bc10-2e8249e8d70a) file = sled-agent/src/probe_manager.rs:238 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
5482025-03-01T01:12:22.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492025-03-01T01:12:22.885ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5502025-03-01T01:12:22.885ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea" } file = sled-storage/src/manager.rs:1431
5512025-03-01T01:12:22.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522025-03-01T01:12:22.943ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5532025-03-01T01:12:22.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/zone"), full_name: "oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/zone" } file = sled-storage/src/manager.rs:1431
5542025-03-01T01:12:22.972ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552025-03-01T01:12:22.972ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562025-03-01T01:12:22.972ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5572025-03-01T01:12:23.020ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582025-03-01T01:12:23.020ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5592025-03-01T01:12:23.020ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/zone/oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a"), full_name: "oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/zone/oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a" } file = sled-storage/src/manager.rs:1431
5602025-03-01T01:12:23.083ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612025-03-01T01:12:23.083ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5622025-03-01T01:12:23.083ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/zone/oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a"), full_name: "oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/zone/oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a" } file = sled-storage/src/manager.rs:1431
5632025-03-01T01:12:23.143ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642025-03-01T01:12:23.143ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652025-03-01T01:12:23.143ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/31eb221a-8007-4b0c-915f-9fe13203b4cc/crypt/zone/oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede"), full_name: "oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc/crypt/zone/oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede" } file = sled-storage/src/manager.rs:1431
5662025-03-01T01:12:23.205ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672025-03-01T01:12:23.205ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682025-03-01T01:12:23.205ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5692025-03-01T01:12:23.256ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702025-03-01T01:12:23.256ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5712025-03-01T01:12:23.256ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/275f9857-4588-4c99-8074-92222be09c5b/crypt/debug"), full_name: "oxp_275f9857-4588-4c99-8074-92222be09c5b/crypt/debug" } file = sled-storage/src/manager.rs:1431
5722025-03-01T01:12:23.286ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732025-03-01T01:12:23.286ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742025-03-01T01:12:23.286ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573" } file = sled-storage/src/manager.rs:1431
5752025-03-01T01:12:23.347ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762025-03-01T01:12:23.347ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5772025-03-01T01:12:23.347ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc/crucible" } file = sled-storage/src/manager.rs:1431
5782025-03-01T01:12:23.395ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-03-01T01:12:23.395ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802025-03-01T01:12:23.395ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878" } file = sled-storage/src/manager.rs:1431
5812025-03-01T01:12:23.455ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822025-03-01T01:12:23.455ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832025-03-01T01:12:23.455ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crucible" } file = sled-storage/src/manager.rs:1431
5842025-03-01T01:12:23.502ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852025-03-01T01:12:23.502ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862025-03-01T01:12:23.502ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5872025-03-01T01:12:23.553ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882025-03-01T01:12:23.554ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892025-03-01T01:12:23.554ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0" } file = sled-storage/src/manager.rs:1431
5902025-03-01T01:12:23.613ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912025-03-01T01:12:23.613ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5922025-03-01T01:12:23.613ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5932025-03-01T01:12:23.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-03-01T01:12:23.664ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5952025-03-01T01:12:23.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7/crucible" } file = sled-storage/src/manager.rs:1431
5962025-03-01T01:12:23.712ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-03-01T01:12:23.712ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5982025-03-01T01:12:23.712ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/debug"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/debug" } file = sled-storage/src/manager.rs:1431
5992025-03-01T01:12:23.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002025-03-01T01:12:23.741ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6012025-03-01T01:12:23.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc" } file = sled-storage/src/manager.rs:1431
6022025-03-01T01:12:23.805ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032025-03-01T01:12:23.805ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6042025-03-01T01:12:23.805ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6052025-03-01T01:12:23.848ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3471264f-127e-4a25-bc10-2e8249e8d70a) file = sled-agent/src/probe_manager.rs:238 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
6062025-03-01T01:12:23.854ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072025-03-01T01:12:23.854ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082025-03-01T01:12:23.854ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6092025-03-01T01:12:23.903ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102025-03-01T01:12:23.903ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112025-03-01T01:12:23.903ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22/crucible" } file = sled-storage/src/manager.rs:1431
6122025-03-01T01:12:23.952ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-03-01T01:12:23.952ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142025-03-01T01:12:23.952ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6152025-03-01T01:12:24.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-03-01T01:12:24.001ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6172025-03-01T01:12:24.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/zone"), full_name: "oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/zone" } file = sled-storage/src/manager.rs:1431
6182025-03-01T01:12:24.030ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-03-01T01:12:24.030ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202025-03-01T01:12:24.030ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639" } file = sled-storage/src/manager.rs:1431
6212025-03-01T01:12:24.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-03-01T01:12:24.090ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232025-03-01T01:12:24.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21" } file = sled-storage/src/manager.rs:1431
6242025-03-01T01:12:24.149ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-03-01T01:12:24.149ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262025-03-01T01:12:24.149ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173"), full_name: "oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/zone/oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173" } file = sled-storage/src/manager.rs:1431
6272025-03-01T01:12:24.209ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282025-03-01T01:12:24.209ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292025-03-01T01:12:24.209ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6302025-03-01T01:12:24.259ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-03-01T01:12:24.259ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6322025-03-01T01:12:24.259ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/31eb221a-8007-4b0c-915f-9fe13203b4cc/crypt/zone"), full_name: "oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc/crypt/zone" } file = sled-storage/src/manager.rs:1431
6332025-03-01T01:12:24.287ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342025-03-01T01:12:24.288ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352025-03-01T01:12:24.288ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0" } file = sled-storage/src/manager.rs:1431
6362025-03-01T01:12:24.346ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372025-03-01T01:12:24.346ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6382025-03-01T01:12:24.346ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c995cf87-df16-4488-b492-a0cb308dc53a/crypt/debug"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/debug" } file = sled-storage/src/manager.rs:1431
6392025-03-01T01:12:24.375ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402025-03-01T01:12:24.375ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412025-03-01T01:12:24.375ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/275f9857-4588-4c99-8074-92222be09c5b/crypt/zone/oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a"), full_name: "oxp_275f9857-4588-4c99-8074-92222be09c5b/crypt/zone/oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a" } file = sled-storage/src/manager.rs:1431
6422025-03-01T01:12:24.437ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432025-03-01T01:12:24.437ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442025-03-01T01:12:24.437ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crucible" } file = sled-storage/src/manager.rs:1431
6452025-03-01T01:12:24.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462025-03-01T01:12:24.485ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472025-03-01T01:12:24.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), full_name: "oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/zone/oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8" } file = sled-storage/src/manager.rs:1431
6482025-03-01T01:12:24.543ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6492025-03-01T01:12:24.543ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6502025-03-01T01:12:24.543ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6"), full_name: "oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crypt/zone/oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6" } file = sled-storage/src/manager.rs:1431
6512025-03-01T01:12:24.602ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-03-01T01:12:24.602ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532025-03-01T01:12:24.603ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:859 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
6542025-03-01T01:12:24.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3218544 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34515 req_id = f95d8aa4-84c1-4e93-af23-419405a3343f response_code = 200 uri = /datasets
6552025-03-01T01:12:24.634ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 3a9b8294-d9f3-4130-a669-e74c6f1f65a0 (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a4f72c78-99c6-478d-b490-f7d8793d4173 (service), filesystem_pool: Some(ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 450e8d93-9ed3-4721-9fe9-42521f60bc93 (service), filesystem_pool: Some(ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6562025-03-01T01:12:24.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61996
6572025-03-01T01:12:24.635ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582025-03-01T01:12:24.635ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592025-03-01T01:12:24.644ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-03-01T01:12:24.644ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-03-01T01:12:24.653ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-03-01T01:12:24.653ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-03-01T01:12:24.661ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6642025-03-01T01:12:24.661ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-03-01T01:12:24.661ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:188
6662025-03-01T01:12:24.661ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-03-01T01:12:24.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-03-01T01:12:24.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-03-01T01:12:24.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-03-01T01:12:24.765ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173 file = illumos-utils/src/zone.rs:325
6712025-03-01T01:12:24.769ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93 file = illumos-utils/src/zone.rs:325
6722025-03-01T01:12:24.773ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0 file = illumos-utils/src/zone.rs:325
6732025-03-01T01:12:24.785ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173 file = illumos-utils/src/zone.rs:363
6742025-03-01T01:12:24.790ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93 file = illumos-utils/src/zone.rs:363
6752025-03-01T01:12:24.794ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0 file = illumos-utils/src/zone.rs:363
6762025-03-01T01:12:24.850ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3471264f-127e-4a25-bc10-2e8249e8d70a) file = sled-agent/src/probe_manager.rs:238 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
6772025-03-01T01:12:25.851ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3471264f-127e-4a25-bc10-2e8249e8d70a) file = sled-agent/src/probe_manager.rs:238 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
6782025-03-01T01:12:26.387ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792025-03-01T01:12:26.387ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6802025-03-01T01:12:26.387ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
6812025-03-01T01:12:26.874ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822025-03-01T01:12:27.205ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4281
6832025-03-01T01:12:27.205ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4291 gateway = fd00:1122:3344:101::1
6842025-03-01T01:12:27.211ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4305 gateway = fd00:1122:3344:101::1
6852025-03-01T01:12:27.211ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4370
6862025-03-01T01:12:27.354ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4436
6872025-03-01T01:12:27.354ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4463
6882025-03-01T01:12:27.357ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6892025-03-01T01:12:27.357ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6902025-03-01T01:12:27.357ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6912025-03-01T01:12:27.367ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 44.36412ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
6922025-03-01T01:12:27.368ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
6932025-03-01T01:12:27.373ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
6942025-03-01T01:12:27.398ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4476
6952025-03-01T01:12:27.398ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4322
6962025-03-01T01:12:27.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 85.704522ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
6972025-03-01T01:12:27.453ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4364
6982025-03-01T01:12:27.453ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4443 rack_subnet = fd00:1122:3344::
6992025-03-01T01:12:27.475ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4454
7002025-03-01T01:12:27.475ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4496
7012025-03-01T01:12:27.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93") failed: Property not found. retry in 25.911228ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7022025-03-01T01:12:27.512ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0") failed: Property not found. retry in 61.748494ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
7032025-03-01T01:12:27.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 199.840052ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
7042025-03-01T01:12:27.539ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93") failed: Property not found. retry in 105.130112ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7052025-03-01T01:12:27.552ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4528
7062025-03-01T01:12:27.552ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4534
7072025-03-01T01:12:27.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0") failed: Property not found. retry in 130.734789ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
7082025-03-01T01:12:27.727ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93") failed: Property not found. retry in 219.860613ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7092025-03-01T01:12:27.740ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8513714243243461071 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
7102025-03-01T01:12:27.741ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1915435068527970641 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
7112025-03-01T01:12:27.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 393.401552ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
7122025-03-01T01:12:27.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0") failed: Property not found. retry in 153.796803ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
7132025-03-01T01:12:27.912ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4575
7142025-03-01T01:12:27.912ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7152025-03-01T01:12:27.958ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93") failed: Property not found. retry in 473.430783ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7162025-03-01T01:12:27.978ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7172025-03-01T01:12:28.021ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0") failed: Property not found. retry in 520.96111ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
7182025-03-01T01:12:28.033ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7192025-03-01T01:12:28.033ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7202025-03-01T01:12:28.034ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7212025-03-01T01:12:28.034ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7222025-03-01T01:12:28.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
7232025-03-01T01:12:28.156ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7242025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7252025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7262025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7272025-03-01T01:12:28.156ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 405.109732ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
7282025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7302025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7322025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7342025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7362025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7382025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7402025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7422025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7442025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7462025-03-01T01:12:28.156ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472025-03-01T01:12:28.227ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2737746046214527941 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
7482025-03-01T01:12:28.227ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5116615490741304288 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
7492025-03-01T01:12:28.441ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93") failed: Property not found. retry in 412.818063ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7502025-03-01T01:12:28.553ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0") failed: Property not found. retry in 1.198645724s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
7512025-03-01T01:12:28.572ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 707.888357ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
7522025-03-01T01:12:28.864ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93") failed: Property not found. retry in 1.118242908s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7532025-03-01T01:12:29.291ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 533.606713ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
7542025-03-01T01:12:29.762ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0") failed: Property not found. retry in 1.432375725s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
7552025-03-01T01:12:29.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 1.375488747s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
7562025-03-01T01:12:29.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93") failed: Property not found. retry in 686.636863ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7572025-03-01T01:12:30.686ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93") failed: Property not found. retry in 1.086569391s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7582025-03-01T01:12:31.202ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0") failed: Property not found. retry in 998.418602ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
7592025-03-01T01:12:31.217ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 808.498674ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
7602025-03-01T01:12:31.782ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93") failed: Property not found. retry in 1.268865617s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7612025-03-01T01:12:32.036ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173") failed: Property not found. retry in 1.43965254s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
7622025-03-01T01:12:32.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0") failed: Property not found. retry in 994.844018ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
7632025-03-01T01:12:33.494ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_internal_dns_a4f72c78-99c6-478d-b490-f7d8793d4173
7642025-03-01T01:12:33.494ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_internal_dns_450e8d93-9ed3-4721-9fe9-42521f60bc93
7652025-03-01T01:12:33.494ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_internal_dns_3a9b8294-d9f3-4130-a669-e74c6f1f65a0
7662025-03-01T01:12:33.494ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672025-03-01T01:12:33.495ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682025-03-01T01:12:33.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8860603 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61996 req_id = 42b72748-c20c-4b8a-a233-f6f953977807 response_code = 204 uri = /omicron-zones
7692025-03-01T01:12:33.497ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702025-03-01T01:12:33.543ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712025-03-01T01:12:33.596ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722025-03-01T01:12:33.643ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7732025-03-01T01:12:33.643ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7742025-03-01T01:12:33.675ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7752025-03-01T01:12:33.676ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7762025-03-01T01:12:33.676ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7772025-03-01T01:12:33.705ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 3a9b8294-d9f3-4130-a669-e74c6f1f65a0 (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a4f72c78-99c6-478d-b490-f7d8793d4173 (service), filesystem_pool: Some(ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 450e8d93-9ed3-4721-9fe9-42521f60bc93 (service), filesystem_pool: Some(ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 1d4941d0-3370-481a-b631-4dde0044876e (service), filesystem_pool: Some(ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 3ef0f340-dee9-40c7-9f12-85e1c7c6053c, kind: Service { id: 1d4941d0-3370-481a-b631-4dde0044876e }, name: Name("ntp-1d4941d0-3370-481a-b631-4dde0044876e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 196])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7782025-03-01T01:12:33.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44306
7792025-03-01T01:12:33.705ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802025-03-01T01:12:33.705ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812025-03-01T01:12:33.716ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7822025-03-01T01:12:33.716ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832025-03-01T01:12:33.726ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7842025-03-01T01:12:33.726ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, responder: ... }
7852025-03-01T01:12:33.735ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7862025-03-01T01:12:33.735ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
7872025-03-01T01:12:33.735ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
7882025-03-01T01:12:33.736ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7892025-03-01T01:12:33.747ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7902025-03-01T01:12:33.779ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7912025-03-01T01:12:33.781ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7922025-03-01T01:12:33.781ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7932025-03-01T01:12:33.812ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 164, 196]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7942025-03-01T01:12:33.812ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = boundary_ntp
7952025-03-01T01:12:33.812ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7962025-03-01T01:12:33.812ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7972025-03-01T01:12:33.813ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7982025-03-01T01:12:33.814ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7992025-03-01T01:12:33.839ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e file = illumos-utils/src/zone.rs:325
8002025-03-01T01:12:33.859ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e file = illumos-utils/src/zone.rs:363
8012025-03-01T01:12:34.477ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8022025-03-01T01:12:34.477ZINFOSledAgent (ServiceManager): Booting oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8032025-03-01T01:12:34.607ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e") failed: Property not found. retry in 46.737515ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8042025-03-01T01:12:34.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e") failed: Property not found. retry in 59.892679ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8052025-03-01T01:12:34.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e") failed: Property not found. retry in 213.042221ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8062025-03-01T01:12:34.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e") failed: Property not found. retry in 352.381801ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8072025-03-01T01:12:35.317ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e") failed: Property not found. retry in 973.649386ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8082025-03-01T01:12:36.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e") failed: Property not found. retry in 926.859623ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8092025-03-01T01:12:37.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e") failed: Property not found. retry in 938.560633ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8102025-03-01T01:12:37.743ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8513714243243461071 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8112025-03-01T01:12:37.744ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1915435068527970641 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8122025-03-01T01:12:38.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e") failed: Property not found. retry in 1.401684527s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8132025-03-01T01:12:38.229ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2737746046214527941 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8142025-03-01T01:12:38.229ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5116615490741304288 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8152025-03-01T01:12:39.608ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e
8162025-03-01T01:12:39.608ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8172025-03-01T01:12:39.609ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182025-03-01T01:12:39.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5903904 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44306 req_id = 09943bee-c6ec-4c61-922e-d355245e6b9f response_code = 204 uri = /omicron-zones
8192025-03-01T01:12:39.611ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8202025-03-01T01:12:39.640ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8212025-03-01T01:12:39.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54473
8222025-03-01T01:12:39.649ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3889
8232025-03-01T01:12:39.649ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8677 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54473 req_id = 857473ca-e453-455d-91b6-e9855e39c010 response_code = 500 uri = /timesync
8242025-03-01T01:12:39.652ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8252025-03-01T01:12:39.800ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8262025-03-01T01:12:39.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40958
8272025-03-01T01:12:43.075ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 603584135332737795 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8282025-03-01T01:12:43.225ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9106668719752446978 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8292025-03-01T01:12:43.497ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2126635703578133993 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8302025-03-01T01:12:43.810ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3889
8312025-03-01T01:12:43.810ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009459 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40958 req_id = 7ff0df71-df55-49a0-b310-8665ec05d9fb response_code = 500 uri = /timesync
8322025-03-01T01:12:43.813ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8332025-03-01T01:12:43.995ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8342025-03-01T01:12:43.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51567
8352025-03-01T01:12:44.003ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3889
8362025-03-01T01:12:44.004ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51567 req_id = 6ff9bb7a-2dfd-48f3-89d4-bb7a1cbd3fcc response_code = 500 uri = /timesync
8372025-03-01T01:12:44.005ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382025-03-01T01:12:44.223ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8392025-03-01T01:12:44.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37796
8402025-03-01T01:12:44.231ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_1d4941d0-3370-481a-b631-4dde0044876e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3889
8412025-03-01T01:12:44.232ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37796 req_id = 8b5e12d4-1c6d-463f-80fe-ad976fa2637a response_code = 500 uri = /timesync
8422025-03-01T01:12:44.233ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8432025-03-01T01:12:44.517ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8442025-03-01T01:12:44.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51567
8452025-03-01T01:12:45.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1009387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51567 req_id = 7bb0ee9c-ca30-47d7-8e0a-6545c430d4db response_code = 200 uri = /timesync
8462025-03-01T01:12:45.530ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8472025-03-01T01:12:45.530ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8482025-03-01T01:12:45.703ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492025-03-01T01:12:45.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63824
8502025-03-01T01:12:45.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63824 req_id = d4f1b76f-6a4b-46b1-aea5-f13e3a45356d response_code = 200 uri = /timesync
8512025-03-01T01:12:45.715ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8522025-03-01T01:12:45.715ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-03-01T01:12:45.914ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542025-03-01T01:12:45.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65362
8552025-03-01T01:12:45.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7903 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65362 req_id = 82f677e6-f128-4915-8489-55daab7d4b25 response_code = 200 uri = /timesync
8562025-03-01T01:12:45.926ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8572025-03-01T01:12:45.926ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-03-01T01:12:46.215ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592025-03-01T01:12:46.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33465
8602025-03-01T01:12:46.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8033 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33465 req_id = 4019cf11-848a-48b1-ad14-3c4760c47180 response_code = 200 uri = /timesync
8612025-03-01T01:12:46.227ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8622025-03-01T01:12:46.227ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632025-03-01T01:12:46.155ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642025-03-01T01:12:46.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59510
8652025-03-01T01:12:46.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8982 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59510 req_id = eb213321-07db-45f9-9ae7-18b7d29d0b1a response_code = 200 uri = /timesync
8662025-03-01T01:12:46.168ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8672025-03-01T01:12:46.168ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682025-03-01T01:12:46.839ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692025-03-01T01:12:46.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33139
8702025-03-01T01:12:46.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7883 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33139 req_id = 2d322435-776f-4539-ba7c-aedd4ffd091a response_code = 200 uri = /timesync
8712025-03-01T01:12:46.851ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.146863729 } file = sled-agent/src/rack_setup/service.rs:743
8722025-03-01T01:12:46.851ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732025-03-01T01:12:47.127ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8513714243243461071 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8742025-03-01T01:12:47.127ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1915435068527970641 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8752025-03-01T01:12:47.176ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762025-03-01T01:12:47.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56518
8772025-03-01T01:12:47.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8431 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56518 req_id = edf7dd8a-7f33-4358-85d8-dd696b03aaa1 response_code = 200 uri = /timesync
8782025-03-01T01:12:47.188ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.145948306 } file = sled-agent/src/rack_setup/service.rs:743
8792025-03-01T01:12:47.188ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802025-03-01T01:12:47.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2737746046214527941 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8812025-03-01T01:12:47.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5116615490741304288 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8822025-03-01T01:12:47.908ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8832025-03-01T01:12:47.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55962
8842025-03-01T01:12:47.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7794 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55962 req_id = 0ba660ae-ccac-4ef1-89fe-8e40e21c0a1c response_code = 200 uri = /timesync
8852025-03-01T01:12:47.920ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.143063679 } file = sled-agent/src/rack_setup/service.rs:743
8862025-03-01T01:12:47.920ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8872025-03-01T01:12:48.693ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8882025-03-01T01:12:48.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58607
8892025-03-01T01:12:48.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58607 req_id = 6317085d-8705-44c9-b5dd-6d8c046daf8c response_code = 200 uri = /timesync
8902025-03-01T01:12:48.703ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740791567.3248403, correction: -0.14090617 } file = sled-agent/src/rack_setup/service.rs:743
8912025-03-01T01:12:48.703ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922025-03-01T01:12:48.987ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2294695228923203511 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8932025-03-01T01:12:48.987ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11448677069775576556 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
8942025-03-01T01:12:49.933ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8952025-03-01T01:12:49.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39530
8962025-03-01T01:12:49.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8769 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39530 req_id = 7757e7b7-302a-483d-a96f-ce7cfb7f1bc4 response_code = 200 uri = /timesync
8972025-03-01T01:12:49.944ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740791567.3248403, correction: -0.137641549 } file = sled-agent/src/rack_setup/service.rs:743
8982025-03-01T01:12:49.944ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8992025-03-01T01:12:51.159ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9002025-03-01T01:12:51.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53339
9012025-03-01T01:12:51.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8844 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53339 req_id = 66cddf3b-ef99-4a2d-9245-080b241a3bdd response_code = 200 uri = /timesync
9022025-03-01T01:12:51.170ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740791567.3248403, correction: -0.134150237 } file = sled-agent/src/rack_setup/service.rs:743
9032025-03-01T01:12:51.170ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9042025-03-01T01:12:52.186ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9052025-03-01T01:12:52.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37677
9062025-03-01T01:12:52.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8514 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37677 req_id = 065b57e7-150a-4fba-a9f6-edad75c5fc06 response_code = 200 uri = /timesync
9072025-03-01T01:12:52.198ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791571.4254577, correction: -0.131433606 } file = sled-agent/src/rack_setup/service.rs:743
9082025-03-01T01:12:52.198ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9092025-03-01T01:12:52.443ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 603584135332737795 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9102025-03-01T01:12:52.593ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9106668719752446978 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9112025-03-01T01:12:52.863ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2126635703578133993 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9122025-03-01T01:12:54.342ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9132025-03-01T01:12:54.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56353
9142025-03-01T01:12:54.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9049 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56353 req_id = 6254a7f9-c066-4c10-a95e-d4b4777e77fb response_code = 200 uri = /timesync
9152025-03-01T01:12:54.355ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791573.1382403, correction: -0.125368804 } file = sled-agent/src/rack_setup/service.rs:743
9162025-03-01T01:12:54.355ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9172025-03-01T01:12:55.848ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9182025-03-01T01:12:55.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57577
9192025-03-01T01:12:55.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8479 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57577 req_id = 579c17fa-f69b-492e-93b0-20dd5979368b response_code = 200 uri = /timesync
9202025-03-01T01:12:55.859ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791574.9762266, correction: -0.121281758 } file = sled-agent/src/rack_setup/service.rs:743
9212025-03-01T01:12:55.859ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9222025-03-01T01:12:56.296ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 348.824152ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9232025-03-01T01:12:56.829ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35725
9242025-03-01T01:12:56.829ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35725 req_id = 9880761b-ab4f-46c4-aaf5-1a8b36429241 response_code = 200 uri = /baseboard
9252025-03-01T01:12:57.101ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8513714243243461071 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9262025-03-01T01:12:57.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1915435068527970641 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9272025-03-01T01:12:57.210ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9282025-03-01T01:12:57.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34527
9292025-03-01T01:12:57.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9074 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34527 req_id = 9fc6b6e0-71af-4cb3-95ab-9e8853f2c4c8 response_code = 200 uri = /timesync
9302025-03-01T01:12:57.222ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791575.8832078, correction: -0.117530584 } file = sled-agent/src/rack_setup/service.rs:743
9312025-03-01T01:12:57.222ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9322025-03-01T01:12:57.585ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2737746046214527941 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9332025-03-01T01:12:57.585ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5116615490741304288 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9342025-03-01T01:12:58.789ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9352025-03-01T01:12:58.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49335
9362025-03-01T01:12:58.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8732 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49335 req_id = 55555771-475a-42cd-aada-12a25b8a0c07 response_code = 200 uri = /timesync
9372025-03-01T01:12:58.800ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791578.2899992, correction: -0.113228977 } file = sled-agent/src/rack_setup/service.rs:743
9382025-03-01T01:12:58.800ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9392025-03-01T01:12:58.962ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2294695228923203511 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9402025-03-01T01:12:58.962ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11448677069775576556 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9412025-03-01T01:13:00.678ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9422025-03-01T01:13:00.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39765
9432025-03-01T01:13:00.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7960 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39765 req_id = 80100e7b-c110-4746-9854-80c6c324bce9 response_code = 200 uri = /timesync
9442025-03-01T01:13:00.690ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791579.603056, correction: -0.108069956 } file = sled-agent/src/rack_setup/service.rs:743
9452025-03-01T01:13:00.690ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9462025-03-01T01:13:02.418ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 603584135332737795 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9472025-03-01T01:13:02.566ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9106668719752446978 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9482025-03-01T01:13:02.837ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2126635703578133993 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9492025-03-01T01:13:04.845ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9502025-03-01T01:13:04.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44030
9512025-03-01T01:13:04.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8671 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44030 req_id = 62815361-21bd-40b6-9922-58c3fc4c63b1 response_code = 200 uri = /timesync
9522025-03-01T01:13:04.856ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791583.479639, correction: -0.09665928 } file = sled-agent/src/rack_setup/service.rs:743
9532025-03-01T01:13:04.856ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9542025-03-01T01:13:07.076ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8513714243243461071 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9552025-03-01T01:13:07.076ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1915435068527970641 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9562025-03-01T01:13:07.559ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2737746046214527941 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9572025-03-01T01:13:07.559ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5116615490741304288 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9582025-03-01T01:13:08.519ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9592025-03-01T01:13:08.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34703
9602025-03-01T01:13:08.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34703 req_id = 5883edd9-ab5b-42f4-a2cb-281eb204aede response_code = 200 uri = /timesync
9612025-03-01T01:13:08.530ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791587.2471578, correction: -0.086597212 } file = sled-agent/src/rack_setup/service.rs:743
9622025-03-01T01:13:08.530ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9632025-03-01T01:13:08.936ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2294695228923203511 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9642025-03-01T01:13:08.936ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11448677069775576556 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9652025-03-01T01:13:11.638ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 684.242156ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9662025-03-01T01:13:12.392ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 603584135332737795 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9672025-03-01T01:13:12.541ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9106668719752446978 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9682025-03-01T01:13:12.811ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2126635703578133993 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9692025-03-01T01:13:15.444ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9702025-03-01T01:13:15.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53363
9712025-03-01T01:13:15.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9485 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53363 req_id = c5a2df7b-b85d-418c-9eea-833b20505843 response_code = 200 uri = /timesync
9722025-03-01T01:13:15.456ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791593.73457, correction: -0.068550088 } file = sled-agent/src/rack_setup/service.rs:743
9732025-03-01T01:13:15.456ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9742025-03-01T01:13:17.052ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8513714243243461071 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9752025-03-01T01:13:17.052ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1915435068527970641 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9762025-03-01T01:13:17.534ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2737746046214527941 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9772025-03-01T01:13:17.534ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5116615490741304288 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9782025-03-01T01:13:18.911ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2294695228923203511 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9792025-03-01T01:13:18.911ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11448677069775576556 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9802025-03-01T01:13:22.368ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 603584135332737795 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
9812025-03-01T01:13:22.434ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9822025-03-01T01:13:22.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37624
9832025-03-01T01:13:22.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 20123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37624 req_id = e0c73923-34b5-4559-b17a-adb14c11e8ed response_code = 200 uri = /timesync
9842025-03-01T01:13:22.460ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1740791601.398442, correction: -0.049304117 } file = sled-agent/src/rack_setup/service.rs:743
9852025-03-01T01:13:22.460ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1383
9862025-03-01T01:13:22.491ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 3a9b8294-d9f3-4130-a669-e74c6f1f65a0 (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a4f72c78-99c6-478d-b490-f7d8793d4173 (service), filesystem_pool: Some(ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 450e8d93-9ed3-4721-9fe9-42521f60bc93 (service), filesystem_pool: Some(ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 1d4941d0-3370-481a-b631-4dde0044876e (service), filesystem_pool: Some(ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 3ef0f340-dee9-40c7-9f12-85e1c7c6053c, kind: Service { id: 1d4941d0-3370-481a-b631-4dde0044876e }, name: Name("ntp-1d4941d0-3370-481a-b631-4dde0044876e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 196])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2a0e84f3-5f56-43f6-87f5-4065314d3b70 (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4c39f411-6ddf-4d27-b8cf-2324a25e1703 (service), filesystem_pool: Some(ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External } } } }, OmicronZoneConfig { id: b3497d45-10b6-4f74-84db-87967d1ab878 (service), filesystem_pool: Some(ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External } } } }, OmicronZoneConfig { id: 9d13cad0-d7a8-46c6-866f-68d0e123cf5a (service), filesystem_pool: Some(ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3c47be44-ad63-432c-a73f-8e377d8a2101 (service), filesystem_pool: Some(ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9872025-03-01T01:13:22.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52720
9882025-03-01T01:13:22.492ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9892025-03-01T01:13:22.492ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9902025-03-01T01:13:22.502ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9912025-03-01T01:13:22.502ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9922025-03-01T01:13:22.511ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9932025-03-01T01:13:22.511ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, responder: ... }
9942025-03-01T01:13:22.522ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9952025-03-01T01:13:22.522ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9962025-03-01T01:13:22.531ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9972025-03-01T01:13:22.531ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9982025-03-01T01:13:22.541ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9992025-03-01T01:13:22.541ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10002025-03-01T01:13:22.550ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10012025-03-01T01:13:22.550ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10022025-03-01T01:13:22.559ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10032025-03-01T01:13:22.559ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10042025-03-01T01:13:22.568ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10052025-03-01T01:13:22.568ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
10062025-03-01T01:13:22.568ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
10072025-03-01T01:13:22.568ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10082025-03-01T01:13:22.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10092025-03-01T01:13:22.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10102025-03-01T01:13:22.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10112025-03-01T01:13:22.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10122025-03-01T01:13:22.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10132025-03-01T01:13:22.743ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878 file = illumos-utils/src/zone.rs:325
10142025-03-01T01:13:22.747ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 file = illumos-utils/src/zone.rs:325
10152025-03-01T01:13:22.751ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101 file = illumos-utils/src/zone.rs:325
10162025-03-01T01:13:22.755ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a file = illumos-utils/src/zone.rs:325
10172025-03-01T01:13:22.760ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703 file = illumos-utils/src/zone.rs:325
10182025-03-01T01:13:22.764ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878 file = illumos-utils/src/zone.rs:363
10192025-03-01T01:13:22.769ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 file = illumos-utils/src/zone.rs:363
10202025-03-01T01:13:22.773ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101 file = illumos-utils/src/zone.rs:363
10212025-03-01T01:13:22.778ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a file = illumos-utils/src/zone.rs:363
10222025-03-01T01:13:22.783ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703 file = illumos-utils/src/zone.rs:363
10232025-03-01T01:13:25.832ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3c47be44-ad63-432c-a73f-8e377d8a2101'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10242025-03-01T01:13:25.832ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10252025-03-01T01:13:25.892ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b3497d45-10b6-4f74-84db-87967d1ab878'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10262025-03-01T01:13:25.892ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10272025-03-01T01:13:25.943ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2a0e84f3-5f56-43f6-87f5-4065314d3b70'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10282025-03-01T01:13:25.943ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10292025-03-01T01:13:25.949ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='9d13cad0-d7a8-46c6-866f-68d0e123cf5a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10302025-03-01T01:13:25.949ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10312025-03-01T01:13:25.984ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 27.923482ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10322025-03-01T01:13:25.996ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4c39f411-6ddf-4d27-b8cf-2324a25e1703'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10332025-03-01T01:13:25.996ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10342025-03-01T01:13:26.021ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 147.408748ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10352025-03-01T01:13:26.031ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 49.515974ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10362025-03-01T01:13:26.093ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 41.749025ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10372025-03-01T01:13:26.103ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 122.308838ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10382025-03-01T01:13:26.767ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 59.311183ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10392025-03-01T01:13:26.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 264.44725ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10402025-03-01T01:13:26.935ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59131
10412025-03-01T01:13:26.936ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 521 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59131 req_id = ded71dcc-a4ce-4b25-9a62-9e51c5a86d1e response_code = 200 uri = /baseboard
10422025-03-01T01:13:26.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 104.07437ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10432025-03-01T01:13:26.966ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 229.702681ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10442025-03-01T01:13:26.982ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 43.43576ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10452025-03-01T01:13:26.997ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 30.657457ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10462025-03-01T01:13:27.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 130.636927ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10472025-03-01T01:13:27.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 134.422978ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10482025-03-01T01:13:27.100ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 372.576415ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10492025-03-01T01:13:27.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 262.442979ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10502025-03-01T01:13:27.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 578.370089ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10512025-03-01T01:13:27.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 287.66885ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10522025-03-01T01:13:27.297ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 211.394972ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10532025-03-01T01:13:27.317ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.394751074s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
10542025-03-01T01:13:27.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 527.487903ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10552025-03-01T01:13:27.484ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 731.372127ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10562025-03-01T01:13:27.525ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 200.258539ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10572025-03-01T01:13:27.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 1.093009181s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10582025-03-01T01:13:27.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 1.021199772s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10592025-03-01T01:13:27.824ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 445.057219ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10602025-03-01T01:13:28.013ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 567.719587ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10612025-03-01T01:13:28.226ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 518.655637ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10622025-03-01T01:13:28.280ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 1.050493243s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10632025-03-01T01:13:28.590ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 1.088213933s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10642025-03-01T01:13:28.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 992.679462ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10652025-03-01T01:13:28.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 1.392282654s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10662025-03-01T01:13:28.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 659.721758ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10672025-03-01T01:13:29.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 793.372884ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10682025-03-01T01:13:29.433ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 1.053059662s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10692025-03-01T01:13:29.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 688.446059ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10702025-03-01T01:13:29.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 1.100078876s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10712025-03-01T01:13:30.139ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 1.339535484s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10722025-03-01T01:13:30.150ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 1.021438632s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10732025-03-01T01:13:30.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 719.902907ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10742025-03-01T01:13:30.494ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 1.480753858s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10752025-03-01T01:13:30.797ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 881.034575ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10762025-03-01T01:13:31.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 1.035659183s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10772025-03-01T01:13:31.181ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 780.62023ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10782025-03-01T01:13:31.484ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 979.544305ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10792025-03-01T01:13:31.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 876.561496ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10802025-03-01T01:13:31.968ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 654.289282ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10812025-03-01T01:13:31.979ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 575.114882ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10822025-03-01T01:13:32.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 1.138757158s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10832025-03-01T01:13:32.470ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 526.798148ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10842025-03-01T01:13:32.561ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 873.050231ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10852025-03-01T01:13:32.569ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 940.422849ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10862025-03-01T01:13:32.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 758.754454ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10872025-03-01T01:13:33.005ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 1.436466855s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10882025-03-01T01:13:33.277ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101") failed: Property not found. retry in 1.475551761s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
10892025-03-01T01:13:33.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 1.067230838s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10902025-03-01T01:13:33.442ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703") failed: Property not found. retry in 1.133828654s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
10912025-03-01T01:13:33.516ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 984.16981ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10922025-03-01T01:13:34.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 556.776172ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10932025-03-01T01:13:34.471ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 939.982918ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10942025-03-01T01:13:34.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 672.561612ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10952025-03-01T01:13:35.012ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 1.490207528s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
10962025-03-01T01:13:35.188ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 1.246318952s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
10972025-03-01T01:13:35.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 590.020324ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10982025-03-01T01:13:36.017ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 509.893525ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
10992025-03-01T01:13:36.445ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 1.21495426s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11002025-03-01T01:13:36.512ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 760.390475ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
11012025-03-01T01:13:36.539ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 1.010642232s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
11022025-03-01T01:13:37.284ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 1.315830066s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
11032025-03-01T01:13:37.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 1.287302588s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
11042025-03-01T01:13:37.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 948.092487ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11052025-03-01T01:13:38.607ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 1.404671975s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
11062025-03-01T01:13:38.625ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 875.108834ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11072025-03-01T01:13:38.854ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 1.165569558s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
11082025-03-01T01:13:39.507ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 663.554253ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11092025-03-01T01:13:40.019ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 843.506415ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
11102025-03-01T01:13:40.027ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 1.234778982s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
11112025-03-01T01:13:40.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 614.901757ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11122025-03-01T01:13:40.800ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 1.13243437s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11132025-03-01T01:13:40.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 838.825401ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
11142025-03-01T01:13:41.269ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 699.514305ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
11152025-03-01T01:13:41.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 876.349392ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
11162025-03-01T01:13:41.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 520.681645ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11172025-03-01T01:13:41.979ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 646.041928ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
11182025-03-01T01:13:42.470ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 782.064488ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11192025-03-01T01:13:42.602ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 1.149786699s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
11202025-03-01T01:13:42.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 1.364438901s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
11212025-03-01T01:13:43.261ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a") failed: Property not found. retry in 1.202130978s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11222025-03-01T01:13:43.712ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.042738693s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
11232025-03-01T01:13:43.761ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878") failed: Property not found. retry in 600.823486ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
11242025-03-01T01:13:44.008ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70") failed: Property not found. retry in 842.821737ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
11252025-03-01T01:13:44.873ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_b3497d45-10b6-4f74-84db-87967d1ab878
11262025-03-01T01:13:44.873ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70
11272025-03-01T01:13:44.873ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_3c47be44-ad63-432c-a73f-8e377d8a2101
11282025-03-01T01:13:44.873ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_9d13cad0-d7a8-46c6-866f-68d0e123cf5a
11292025-03-01T01:13:44.873ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_4c39f411-6ddf-4d27-b8cf-2324a25e1703
11302025-03-01T01:13:44.874ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11312025-03-01T01:13:44.874ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11322025-03-01T01:13:44.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 22432221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52720 req_id = 35647e7d-0bc9-4ad3-964d-fb3f5d11927f response_code = 204 uri = /omicron-zones
11332025-03-01T01:13:44.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35015
11342025-03-01T01:13:44.935ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = b448a67c-241d-42d8-bc39-5ed5a80a75ed response_code = 500 uri = /cockroachdb
11352025-03-01T01:13:44.935ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b448a67c-241d-42d8-bc39-5ed5a80a75ed", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b448a67c-241d-42d8-bc39-5ed5a80a75ed" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 101.866756ms
11362025-03-01T01:13:45.064ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26040 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = 1880c9f2-6620-4e31-811a-544954a7e803 response_code = 500 uri = /cockroachdb
11372025-03-01T01:13:45.064ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1880c9f2-6620-4e31-811a-544954a7e803", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1880c9f2-6620-4e31-811a-544954a7e803" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 100.498759ms
11382025-03-01T01:13:45.190ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 24869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = da079c90-8450-4b9a-a84b-bfc639091091 response_code = 500 uri = /cockroachdb
11392025-03-01T01:13:45.191ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "da079c90-8450-4b9a-a84b-bfc639091091", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "da079c90-8450-4b9a-a84b-bfc639091091" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 139.61017ms
11402025-03-01T01:13:45.358ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = 4ef691a3-7925-4324-99e6-dbf4995ef27c response_code = 500 uri = /cockroachdb
11412025-03-01T01:13:45.359ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4ef691a3-7925-4324-99e6-dbf4995ef27c", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4ef691a3-7925-4324-99e6-dbf4995ef27c" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 124.400474ms
11422025-03-01T01:13:45.509ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25375 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = 8b892464-c544-4ff0-9be4-b315ca83ea5d response_code = 500 uri = /cockroachdb
11432025-03-01T01:13:45.509ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8b892464-c544-4ff0-9be4-b315ca83ea5d", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8b892464-c544-4ff0-9be4-b315ca83ea5d" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 236.029555ms
11442025-03-01T01:13:45.772ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = 932c6454-6670-485e-8b0d-7627126575e9 response_code = 500 uri = /cockroachdb
11452025-03-01T01:13:45.772ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "932c6454-6670-485e-8b0d-7627126575e9", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "932c6454-6670-485e-8b0d-7627126575e9" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 220.185958ms
11462025-03-01T01:13:46.022ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27734 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = 8716f9f1-5108-4b5a-894a-9ab6e82c1a39 response_code = 500 uri = /cockroachdb
11472025-03-01T01:13:46.022ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8716f9f1-5108-4b5a-894a-9ab6e82c1a39", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8716f9f1-5108-4b5a-894a-9ab6e82c1a39" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 160.030731ms
11482025-03-01T01:13:46.210ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26710 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = 1f45496b-b53f-42a8-981b-6bfb005d67cd response_code = 500 uri = /cockroachdb
11492025-03-01T01:13:46.211ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1f45496b-b53f-42a8-981b-6bfb005d67cd", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1f45496b-b53f-42a8-981b-6bfb005d67cd" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 446.850051ms
11502025-03-01T01:13:46.686ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27969 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = 34d105ad-2698-41dc-a4e4-c0705fa812bb response_code = 500 uri = /cockroachdb
11512025-03-01T01:13:46.686ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "34d105ad-2698-41dc-a4e4-c0705fa812bb", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "34d105ad-2698-41dc-a4e4-c0705fa812bb" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 350.07802ms
11522025-03-01T01:13:47.064ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2a0e84f3-5f56-43f6-87f5-4065314d3b70 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26901 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = 5cb1a7aa-4e29-4e30-a30d-ca0ef27bef7d response_code = 500 uri = /cockroachdb
11532025-03-01T01:13:47.064ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5cb1a7aa-4e29-4e30-a30d-ca0ef27bef7d", "content-length": "124", "date": "Sat, 01 Mar 2025 01:13:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5cb1a7aa-4e29-4e30-a30d-ca0ef27bef7d" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 667.463039ms
11542025-03-01T01:13:47.762ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3732
11552025-03-01T01:14:02.284ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3750
11562025-03-01T01:14:12.313ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3773
11572025-03-01T01:14:12.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 24579363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35015 req_id = 322196de-de04-43ed-9f79-6b2dc7006af4 response_code = 204 uri = /cockroachdb
11582025-03-01T01:14:12.317ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52971
11592025-03-01T01:14:12.327ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.132195766s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
11602025-03-01T01:14:12.360ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 3a9b8294-d9f3-4130-a669-e74c6f1f65a0 (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: a4f72c78-99c6-478d-b490-f7d8793d4173 (service), filesystem_pool: Some(ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 450e8d93-9ed3-4721-9fe9-42521f60bc93 (service), filesystem_pool: Some(ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 1d4941d0-3370-481a-b631-4dde0044876e (service), filesystem_pool: Some(ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 3ef0f340-dee9-40c7-9f12-85e1c7c6053c, kind: Service { id: 1d4941d0-3370-481a-b631-4dde0044876e }, name: Name("ntp-1d4941d0-3370-481a-b631-4dde0044876e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 196])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2a0e84f3-5f56-43f6-87f5-4065314d3b70 (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4c39f411-6ddf-4d27-b8cf-2324a25e1703 (service), filesystem_pool: Some(ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External } } } }, OmicronZoneConfig { id: b3497d45-10b6-4f74-84db-87967d1ab878 (service), filesystem_pool: Some(ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External } } } }, OmicronZoneConfig { id: 9d13cad0-d7a8-46c6-866f-68d0e123cf5a (service), filesystem_pool: Some(ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3c47be44-ad63-432c-a73f-8e377d8a2101 (service), filesystem_pool: Some(ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 (service), filesystem_pool: Some(ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc (service), filesystem_pool: Some(ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 2787d512-9167-42df-aaa9-77fdf2945e21 (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc (service), filesystem_pool: Some(ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 (service), filesystem_pool: Some(ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 75027a6b-c963-4116-bde7-9aaeb7c97573 (service), filesystem_pool: Some(ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 055d28b4-f6dd-486c-aef8-c744ef7277b1 (service), filesystem_pool: Some(ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 02506617-a4fd-448d-8692-4374cb30a0da (service), filesystem_pool: Some(ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0 (service), filesystem_pool: Some(ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8ce889bf-5a86-4519-b01a-24f68188604c (service), filesystem_pool: Some(ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 26e51894-548a-446f-bcf0-d900f3fcd639 (service), filesystem_pool: Some(ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External } } } }, OmicronZoneConfig { id: bb548ecd-2037-4817-bbac-344383435bee (service), filesystem_pool: Some(ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External } } } }, OmicronZoneConfig { id: d7434aec-e5ab-439d-8333-b62efc3f16f6 (service), filesystem_pool: Some(ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 499b3b46-f9b2-4a6a-a9ec-5873a42aeede (service), filesystem_pool: Some(ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External } } } }, OmicronZoneConfig { id: d407f42a-eb7b-48f6-bf40-196a5cf1e43a (service), filesystem_pool: Some(ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External } } } }, OmicronZoneConfig { id: 13da719e-1a04-4c86-aa55-feedd3731b5a (service), filesystem_pool: Some(ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89 (service), filesystem_pool: Some(ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11612025-03-01T01:14:12.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56339
11622025-03-01T01:14:12.362ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11632025-03-01T01:14:12.362ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11642025-03-01T01:14:12.378ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11652025-03-01T01:14:12.378ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11662025-03-01T01:14:12.388ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11672025-03-01T01:14:12.388ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: InternalDns }, responder: ... }
11682025-03-01T01:14:12.400ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11692025-03-01T01:14:12.400ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11702025-03-01T01:14:12.411ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11712025-03-01T01:14:12.411ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11722025-03-01T01:14:12.421ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11732025-03-01T01:14:12.421ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Cockroach }, responder: ... }
11742025-03-01T01:14:12.431ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11752025-03-01T01:14:12.431ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11762025-03-01T01:14:12.441ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11772025-03-01T01:14:12.441ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11782025-03-01T01:14:12.453ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11792025-03-01T01:14:12.453ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11802025-03-01T01:14:12.464ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11812025-03-01T01:14:12.464ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11822025-03-01T01:14:12.477ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11832025-03-01T01:14:12.477ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11842025-03-01T01:14:12.487ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11852025-03-01T01:14:12.488ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, kind: Crucible }, responder: ... }
11862025-03-01T01:14:12.498ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11872025-03-01T01:14:12.498ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, kind: Crucible }, responder: ... }
11882025-03-01T01:14:12.512ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11892025-03-01T01:14:12.512ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, kind: Crucible }, responder: ... }
11902025-03-01T01:14:12.524ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11912025-03-01T01:14:12.524ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, kind: Crucible }, responder: ... }
11922025-03-01T01:14:12.535ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11932025-03-01T01:14:12.535ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, kind: Crucible }, responder: ... }
11942025-03-01T01:14:12.548ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11952025-03-01T01:14:12.549ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, kind: Crucible }, responder: ... }
11962025-03-01T01:14:12.558ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11972025-03-01T01:14:12.558ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, kind: Crucible }, responder: ... }
11982025-03-01T01:14:12.569ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11992025-03-01T01:14:12.569ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, kind: Crucible }, responder: ... }
12002025-03-01T01:14:12.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12012025-03-01T01:14:12.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, kind: Crucible }, responder: ... }
12022025-03-01T01:14:12.594ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12032025-03-01T01:14:12.594ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
12042025-03-01T01:14:12.594ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
12052025-03-01T01:14:12.595ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12062025-03-01T01:14:12.722ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12072025-03-01T01:14:12.724ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12082025-03-01T01:14:12.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12092025-03-01T01:14:12.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12102025-03-01T01:14:12.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12112025-03-01T01:14:12.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12122025-03-01T01:14:12.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12132025-03-01T01:14:12.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12142025-03-01T01:14:12.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12152025-03-01T01:14:12.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12162025-03-01T01:14:12.958ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12172025-03-01T01:14:12.958ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12182025-03-01T01:14:12.994ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12192025-03-01T01:14:12.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12202025-03-01T01:14:12.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212025-03-01T01:14:12.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12222025-03-01T01:14:12.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12232025-03-01T01:14:13.021ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12242025-03-01T01:14:13.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12252025-03-01T01:14:13.022ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da file = illumos-utils/src/zone.rs:325
12262025-03-01T01:14:13.027ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573 file = illumos-utils/src/zone.rs:325
12272025-03-01T01:14:13.033ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 file = illumos-utils/src/zone.rs:325
12282025-03-01T01:14:13.039ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0 file = illumos-utils/src/zone.rs:325
12292025-03-01T01:14:13.044ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6 file = illumos-utils/src/zone.rs:325
12302025-03-01T01:14:13.050ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c file = illumos-utils/src/zone.rs:325
12312025-03-01T01:14:13.055ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639 file = illumos-utils/src/zone.rs:325
12322025-03-01T01:14:13.060ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee file = illumos-utils/src/zone.rs:325
12332025-03-01T01:14:13.187ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da file = illumos-utils/src/zone.rs:363
12342025-03-01T01:14:13.192ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573 file = illumos-utils/src/zone.rs:363
12352025-03-01T01:14:13.197ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 file = illumos-utils/src/zone.rs:363
12362025-03-01T01:14:13.202ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0 file = illumos-utils/src/zone.rs:363
12372025-03-01T01:14:13.206ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6 file = illumos-utils/src/zone.rs:363
12382025-03-01T01:14:13.211ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c file = illumos-utils/src/zone.rs:363
12392025-03-01T01:14:13.216ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639 file = illumos-utils/src/zone.rs:363
12402025-03-01T01:14:13.220ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee file = illumos-utils/src/zone.rs:363
12412025-03-01T01:14:13.225ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a file = illumos-utils/src/zone.rs:325
12422025-03-01T01:14:13.231ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea file = illumos-utils/src/zone.rs:325
12432025-03-01T01:14:13.236ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89 file = illumos-utils/src/zone.rs:325
12442025-03-01T01:14:13.241ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1 file = illumos-utils/src/zone.rs:325
12452025-03-01T01:14:13.246ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede file = illumos-utils/src/zone.rs:325
12462025-03-01T01:14:13.252ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a file = illumos-utils/src/zone.rs:325
12472025-03-01T01:14:13.259ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a file = illumos-utils/src/zone.rs:363
12482025-03-01T01:14:13.266ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea file = illumos-utils/src/zone.rs:363
12492025-03-01T01:14:13.271ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89 file = illumos-utils/src/zone.rs:363
12502025-03-01T01:14:13.279ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1 file = illumos-utils/src/zone.rs:363
12512025-03-01T01:14:13.286ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede file = illumos-utils/src/zone.rs:363
12522025-03-01T01:14:13.295ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a file = illumos-utils/src/zone.rs:363
12532025-03-01T01:14:13.378ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12542025-03-01T01:14:13.471ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12552025-03-01T01:14:13.550ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12562025-03-01T01:14:13.553ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12572025-03-01T01:14:13.553ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12582025-03-01T01:14:13.626ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 249, 39]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12592025-03-01T01:14:13.626ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = external_dns
12602025-03-01T01:14:13.702ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12612025-03-01T01:14:13.837ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12622025-03-01T01:14:13.850ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12632025-03-01T01:14:13.850ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12642025-03-01T01:14:13.915ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 240, 110]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12652025-03-01T01:14:13.915ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = nexus
12662025-03-01T01:14:13.921ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12672025-03-01T01:14:13.921ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12682025-03-01T01:14:14.006ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 202, 80]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12692025-03-01T01:14:14.007ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = nexus
12702025-03-01T01:14:14.010ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12712025-03-01T01:14:14.010ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12722025-03-01T01:14:14.069ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 180, 221]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12732025-03-01T01:14:14.069ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = nexus
12742025-03-01T01:14:14.070ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12752025-03-01T01:14:14.070ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12762025-03-01T01:14:14.135ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 253, 67]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12772025-03-01T01:14:14.135ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = external_dns
12782025-03-01T01:14:14.139ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12792025-03-01T01:14:14.139ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12802025-03-01T01:14:14.139ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12812025-03-01T01:14:14.139ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12822025-03-01T01:14:14.169ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12832025-03-01T01:14:14.172ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12842025-03-01T01:14:14.238ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12852025-03-01T01:14:14.244ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12862025-03-01T01:14:14.244ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12872025-03-01T01:14:14.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12882025-03-01T01:14:14.246ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12892025-03-01T01:14:14.246ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12902025-03-01T01:14:14.246ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12912025-03-01T01:14:14.246ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12922025-03-01T01:14:14.327ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12932025-03-01T01:14:14.334ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12942025-03-01T01:14:14.338ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12952025-03-01T01:14:14.338ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12962025-03-01T01:14:14.338ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12972025-03-01T01:14:14.342ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12982025-03-01T01:14:14.343ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158 file = illumos-utils/src/zone.rs:325
12992025-03-01T01:14:14.358ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc file = illumos-utils/src/zone.rs:325
13002025-03-01T01:14:14.493ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158 file = illumos-utils/src/zone.rs:363
13012025-03-01T01:14:14.503ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc file = illumos-utils/src/zone.rs:363
13022025-03-01T01:14:14.511ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21 file = illumos-utils/src/zone.rs:325
13032025-03-01T01:14:14.522ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc file = illumos-utils/src/zone.rs:325
13042025-03-01T01:14:14.533ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 file = illumos-utils/src/zone.rs:325
13052025-03-01T01:14:14.549ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21 file = illumos-utils/src/zone.rs:363
13062025-03-01T01:14:14.558ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc file = illumos-utils/src/zone.rs:363
13072025-03-01T01:14:14.572ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 file = illumos-utils/src/zone.rs:363
13082025-03-01T01:14:26.390ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092025-03-01T01:14:26.391ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13102025-03-01T01:14:26.391ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
13112025-03-01T01:14:26.407ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
13122025-03-01T01:14:27.087ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2692762f-0ee9-4ba9-9fef-e8bb1c774aa1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13132025-03-01T01:14:27.087ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4725b27a-cc57-49de-b1da-4dc8439486c0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13142025-03-01T01:14:27.087ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='45caedea-a7ab-42a6-9147-bace78a3c1ed'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13152025-03-01T01:14:27.087ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
13162025-03-01T01:14:27.091ZINFOSledAgent (ServiceManager): Booting oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
13172025-03-01T01:14:27.098ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='acef0c56-5efd-4cf3-b2f9-7db2c39d8339'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13182025-03-01T01:14:27.099ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='eb0a11f7-2b10-4d29-88b9-e938495b3d2b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13192025-03-01T01:14:27.099ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a4cbe29a-6e54-4977-95b1-b8d4d1bbdd23'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13202025-03-01T01:14:27.100ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='82281c27-f4c2-4f81-beea-9938e1c7e242'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212025-03-01T01:14:27.100ZINFOSledAgent (ServiceManager): Booting oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
13222025-03-01T01:14:27.212ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
13232025-03-01T01:14:27.219ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
13242025-03-01T01:14:27.226ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
13252025-03-01T01:14:27.232ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
13262025-03-01T01:14:27.271ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13272025-03-01T01:14:27.272ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
13282025-03-01T01:14:27.280ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13292025-03-01T01:14:27.281ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
13302025-03-01T01:14:29.236ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 46.337095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
13312025-03-01T01:14:29.246ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 31.260621ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
13322025-03-01T01:14:29.267ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 53.821196ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
13332025-03-01T01:14:29.282ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 58.476706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
13342025-03-01T01:14:29.290ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 54.951608ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
13352025-03-01T01:14:29.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 47.991251ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
13362025-03-01T01:14:29.310ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 25.005557ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
13372025-03-01T01:14:29.321ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 69.160158ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
13382025-03-01T01:14:29.330ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 78.597782ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
13392025-03-01T01:14:29.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 26.232959ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
13402025-03-01T01:14:29.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 63.065309ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
13412025-03-01T01:14:29.355ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 50.494797ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
13422025-03-01T01:14:29.364ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 106.202595ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
13432025-03-01T01:14:29.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 91.444749ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
13442025-03-01T01:14:29.382ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 104.065543ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
13452025-03-01T01:14:29.389ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 142.228674ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
13462025-03-01T01:14:29.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 51.6138ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
13472025-03-01T01:14:29.403ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 98.108472ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
13482025-03-01T01:14:29.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 79.75399ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
13492025-03-01T01:14:29.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 282.954859ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
13502025-03-01T01:14:29.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 54.365534ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
13512025-03-01T01:14:29.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 97.486645ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
13522025-03-01T01:14:29.443ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 74.76822ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
13532025-03-01T01:14:29.457ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 178.107776ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
13542025-03-01T01:14:29.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 240.995748ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
13552025-03-01T01:14:29.482ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 198.526089ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
13562025-03-01T01:14:29.492ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 138.820162ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
13572025-03-01T01:14:29.504ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 220.482095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
13582025-03-01T01:14:29.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 103.493552ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
13592025-03-01T01:14:29.523ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 209.277329ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
13602025-03-01T01:14:29.533ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 293.015766ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
13612025-03-01T01:14:29.542ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 247.972905ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
13622025-03-01T01:14:29.554ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 170.797761ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
13632025-03-01T01:14:29.733ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.762796769s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
13642025-03-01T01:14:29.746ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 376.837222ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
13652025-03-01T01:14:29.758ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 300.418777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
13662025-03-01T01:14:29.768ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 263.561784ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
13672025-03-01T01:14:29.778ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 558.863094ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
13682025-03-01T01:14:29.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 501.485711ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
13692025-03-01T01:14:29.797ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 463.388517ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
13702025-03-01T01:14:29.807ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 539.038067ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
13712025-03-01T01:14:29.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 425.780687ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
13722025-03-01T01:14:29.826ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 337.173271ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
13732025-03-01T01:14:29.835ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 269.404676ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
13742025-03-01T01:14:29.845ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 351.493383ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
13752025-03-01T01:14:30.045ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 508.676854ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
13762025-03-01T01:14:30.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 665.601575ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
13772025-03-01T01:14:30.117ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 921.231852ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
13782025-03-01T01:14:30.134ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 582.226207ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
13792025-03-01T01:14:30.176ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 429.024362ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
13802025-03-01T01:14:30.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 431.879487ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
13812025-03-01T01:14:30.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 932.437587ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
13822025-03-01T01:14:30.273ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 767.197808ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
13832025-03-01T01:14:30.302ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 828.199151ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
13842025-03-01T01:14:30.348ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 556.880012ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
13852025-03-01T01:14:30.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 1.037455858s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
13862025-03-01T01:14:30.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 948.908557ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
13872025-03-01T01:14:30.617ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 1.480985056s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
13882025-03-01T01:14:30.656ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 1.027655264s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
13892025-03-01T01:14:30.729ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 1.185198309s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
13902025-03-01T01:14:30.747ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 971.512611ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
13912025-03-01T01:14:30.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 1.467766055s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
13922025-03-01T01:14:31.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 1.083481676s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
13932025-03-01T01:14:31.063ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 662.893995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
13942025-03-01T01:14:31.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 1.089209682s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
13952025-03-01T01:14:31.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 1.430813618s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
13962025-03-01T01:14:31.409ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 630.429716ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
13972025-03-01T01:14:31.533ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 1.223837731s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
13982025-03-01T01:14:31.697ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 911.481228ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
13992025-03-01T01:14:31.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 939.052415ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
14002025-03-01T01:14:31.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 1.076214463s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
14012025-03-01T01:14:31.928ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 912.745826ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
14022025-03-01T01:14:31.935ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14032025-03-01T01:14:31.935ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
14042025-03-01T01:14:31.977ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14052025-03-01T01:14:31.977ZINFOSledAgent (ServiceManager): Booting oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
14062025-03-01T01:14:32.053ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 823.781348ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
14072025-03-01T01:14:32.114ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 595.201657ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
14082025-03-01T01:14:32.150ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 793.009913ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
14092025-03-01T01:14:32.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 41.983835ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
14102025-03-01T01:14:32.220ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 73.341513ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
14112025-03-01T01:14:32.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 1.109412954s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
14122025-03-01T01:14:32.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 61.276715ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
14132025-03-01T01:14:32.306ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 109.246052ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
14142025-03-01T01:14:32.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 290.623843ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
14152025-03-01T01:14:32.398ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 521.101595ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
14162025-03-01T01:14:32.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 290.271147ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
14172025-03-01T01:14:32.798ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 435.165784ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
14182025-03-01T01:14:32.853ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 1.138021524s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
14192025-03-01T01:14:32.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 1.35077038s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
14202025-03-01T01:14:32.876ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 1.30095785s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
14212025-03-01T01:14:32.887ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 1.485339964s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
14222025-03-01T01:14:32.899ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 1.223100956s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
14232025-03-01T01:14:32.912ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 463.802342ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
14242025-03-01T01:14:32.923ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 1.044808902s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
14252025-03-01T01:14:32.934ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 539.850891ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
14262025-03-01T01:14:32.944ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 1.258591276s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
14272025-03-01T01:14:32.954ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 683.958797ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
14282025-03-01T01:14:32.966ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 1.398622092s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
14292025-03-01T01:14:33.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 908.465077ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
14302025-03-01T01:14:33.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 680.095589ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
14312025-03-01T01:14:33.388ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 1.041128559s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
14322025-03-01T01:14:33.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 1.364845046s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
14332025-03-01T01:14:33.650ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 1.028490535s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
14342025-03-01T01:14:33.979ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 835.699092ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
14352025-03-01T01:14:34.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 1.326102864s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
14362025-03-01T01:14:34.059ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 841.018718ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
14372025-03-01T01:14:34.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 895.506163ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
14382025-03-01T01:14:34.166ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 750.965707ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
14392025-03-01T01:14:34.187ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 1.314820298s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
14402025-03-01T01:14:34.212ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 1.260681142s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
14412025-03-01T01:14:34.224ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 625.211473ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
14422025-03-01T01:14:34.373ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 1.445335025s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
14432025-03-01T01:14:34.381ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 1.39796811s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
14442025-03-01T01:14:34.438ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 716.510729ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
14452025-03-01T01:14:34.690ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 1.252621186s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
14462025-03-01T01:14:34.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 508.785185ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
14472025-03-01T01:14:34.899ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 1.363108922s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
14482025-03-01T01:14:34.942ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 737.38054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
14492025-03-01T01:14:34.943ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='d77aa5d6-e6f9-4845-b1d4-57f91a3621e6'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14502025-03-01T01:14:34.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 1.326500735s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
14512025-03-01T01:14:34.953ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c995cf87-df16-4488-b492-a0cb308dc53a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9da107ed-e315-496b-9636-90cd11490230'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14522025-03-01T01:14:34.953ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14532025-03-01T01:14:34.953ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_275f9857-4588-4c99-8074-92222be09c5b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1d90fc82-9883-4eac-b107-19a9adb27770'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14542025-03-01T01:14:34.982ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 741.598452ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
14552025-03-01T01:14:34.982ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
14562025-03-01T01:14:34.996ZINFOSledAgent (ServiceManager): Booting oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
14572025-03-01T01:14:35.004ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
14582025-03-01T01:14:35.010ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
14592025-03-01T01:14:35.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 1.162506106s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
14602025-03-01T01:14:35.165ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 1.051144673s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
14612025-03-01T01:14:35.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 60.700564ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
14622025-03-01T01:14:35.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 35.717479ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
14632025-03-01T01:14:35.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 58.41969ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
14642025-03-01T01:14:35.256ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 27.417953ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
14652025-03-01T01:14:35.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 142.900303ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
14662025-03-01T01:14:35.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 71.624187ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
14672025-03-01T01:14:35.285ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 114.877263ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
14682025-03-01T01:14:35.292ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 119.033744ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
14692025-03-01T01:14:35.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 1.052758734s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
14702025-03-01T01:14:35.353ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 121.269767ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
14712025-03-01T01:14:35.393ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 1.343387555s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
14722025-03-01T01:14:35.412ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 281.362348ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
14732025-03-01T01:14:35.420ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 234.867332ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
14742025-03-01T01:14:35.429ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 101.335915ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
14752025-03-01T01:14:35.482ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 897.156705ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
14762025-03-01T01:14:35.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 425.059371ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
14772025-03-01T01:14:35.512ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 877.903768ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
14782025-03-01T01:14:35.539ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 203.075294ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
14792025-03-01T01:14:35.668ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 275.878513ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
14802025-03-01T01:14:35.678ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 517.288009ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
14812025-03-01T01:14:35.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 421.131993ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
14822025-03-01T01:14:35.736ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 915.897158ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
14832025-03-01T01:14:35.757ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 470.553004ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
14842025-03-01T01:14:35.793ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 834.345419ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
14852025-03-01T01:14:35.832ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 986.662955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
14862025-03-01T01:14:35.837ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14872025-03-01T01:14:35.837ZINFOSledAgent (ServiceManager): Booting oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
14882025-03-01T01:14:35.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 492.335169ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
14892025-03-01T01:14:35.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 1.454852063s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
14902025-03-01T01:14:35.968ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 588.822384ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
14912025-03-01T01:14:36.060ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 69.45616ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
14922025-03-01T01:14:36.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 60.726263ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
14932025-03-01T01:14:36.176ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 549.254642ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
14942025-03-01T01:14:36.212ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 821.916933ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
14952025-03-01T01:14:36.227ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 249.480114ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
14962025-03-01T01:14:36.253ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 1.227580693s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
14972025-03-01T01:14:36.290ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 666.111244ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
14982025-03-01T01:14:36.301ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 776.121418ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
14992025-03-01T01:14:36.315ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 567.278885ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
15002025-03-01T01:14:36.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 821.438009ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
15012025-03-01T01:14:36.391ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 1.377521396s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
15022025-03-01T01:14:36.402ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 797.990313ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
15032025-03-01T01:14:36.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 1.234672479s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
15042025-03-01T01:14:36.438ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 848.1616ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
15052025-03-01T01:14:36.490ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 399.691337ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
15062025-03-01T01:14:36.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 684.204228ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
15072025-03-01T01:14:36.642ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 1.061476927s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
15082025-03-01T01:14:36.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 1.014593615s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
15092025-03-01T01:14:36.738ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 940.357503ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
15102025-03-01T01:14:36.750ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 1.269550463s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
15112025-03-01T01:14:36.831ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 1.459554329s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
15122025-03-01T01:14:36.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 504.258348ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
15132025-03-01T01:14:36.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 895.627242ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
15142025-03-01T01:14:36.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 1.128687581s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
15152025-03-01T01:14:37.048ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 539.466346ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
15162025-03-01T01:14:37.093ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 628.53868ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
15172025-03-01T01:14:37.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 1.115600022s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
15182025-03-01T01:14:37.215ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 1.261194754s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
15192025-03-01T01:14:37.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 612.210481ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
15202025-03-01T01:14:37.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 1.433864245s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
15212025-03-01T01:14:37.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 1.345480962s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
15222025-03-01T01:14:37.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 617.333082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
15232025-03-01T01:14:37.497ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 1.487145753s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
15242025-03-01T01:14:37.604ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 1.106496538s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
15252025-03-01T01:14:37.664ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 1.049595208s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
15262025-03-01T01:14:37.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 1.273678786s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
15272025-03-01T01:14:37.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 666.931269ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
15282025-03-01T01:14:37.728ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 989.747857ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
15292025-03-01T01:14:37.744ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 1.296392761s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
15302025-03-01T01:14:37.786ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 1.295607164s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
15312025-03-01T01:14:37.821ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 1.053245274s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
15322025-03-01T01:14:37.903ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 1.498946619s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
15332025-03-01T01:14:38.038ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 588.825245ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
15342025-03-01T01:14:38.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 1.345109365s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
15352025-03-01T01:14:38.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 915.483881ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
15362025-03-01T01:14:38.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 1.100217415s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
15372025-03-01T01:14:38.309ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 1.446376677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
15382025-03-01T01:14:38.394ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 905.562445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
15392025-03-01T01:14:38.496ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 1.26078824s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
15402025-03-01T01:14:38.639ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 977.645116ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
15412025-03-01T01:14:38.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 884.960911ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
15422025-03-01T01:14:38.737ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 1.328833158s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
15432025-03-01T01:14:38.748ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 562.839676ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
15442025-03-01T01:14:38.761ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 1.490833475s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
15452025-03-01T01:14:38.773ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 847.749962ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
15462025-03-01T01:14:38.888ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 1.145802145s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
15472025-03-01T01:14:38.981ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 722.558933ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
15482025-03-01T01:14:38.998ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 794.2782ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
15492025-03-01T01:14:39.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 1.387302073s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
15502025-03-01T01:14:39.058ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 884.378932ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
15512025-03-01T01:14:39.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 796.769608ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
15522025-03-01T01:14:39.310ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 762.751221ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
15532025-03-01T01:14:39.322ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 1.487787891s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
15542025-03-01T01:14:39.404ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 1.359805915s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
15552025-03-01T01:14:39.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 1.283815425s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
15562025-03-01T01:14:39.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 742.206069ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
15572025-03-01T01:14:39.618ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 677.602137ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
15582025-03-01T01:14:39.625ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 1.424923217s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
15592025-03-01T01:14:39.635ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 1.297902924s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
15602025-03-01T01:14:39.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 1.104684539s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
15612025-03-01T01:14:39.767ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 1.37378574s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
15622025-03-01T01:14:39.777ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 993.200847ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
15632025-03-01T01:14:39.802ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 694.394885ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
15642025-03-01T01:14:39.906ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 702.492609ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
15652025-03-01T01:14:39.955ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 648.500596ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
15662025-03-01T01:14:40.048ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 821.584965ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
15672025-03-01T01:14:40.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 1.163043683s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
15682025-03-01T01:14:40.091ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 1.171827955s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
15692025-03-01T01:14:40.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 577.887978ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
15702025-03-01T01:14:40.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 647.342627ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
15712025-03-01T01:14:40.310ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 1.337216287s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
15722025-03-01T01:14:40.311ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15732025-03-01T01:14:40.311ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
15742025-03-01T01:14:40.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 683.632794ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
15752025-03-01T01:14:40.510ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 1.191168962s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
15762025-03-01T01:14:40.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 40.760844ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
15772025-03-01T01:14:40.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 89.939114ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
15782025-03-01T01:14:40.622ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 1.245157735s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
15792025-03-01T01:14:40.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 506.214341ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
15802025-03-01T01:14:40.772ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 1.204779627s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
15812025-03-01T01:14:40.830ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 1.089266067s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
15822025-03-01T01:14:40.876ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 157.716221ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
15832025-03-01T01:14:40.953ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 541.186839ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
15842025-03-01T01:14:40.965ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 1.369461824s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
15852025-03-01T01:14:40.979ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 667.108556ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
15862025-03-01T01:14:40.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da") failed: Property not found. retry in 1.162615229s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
15872025-03-01T01:14:41.006ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 826.506275ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
15882025-03-01T01:14:41.019ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c") failed: Property not found. retry in 1.23712147s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
15892025-03-01T01:14:41.036ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 1.431614936s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
15902025-03-01T01:14:41.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 284.558693ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
15912025-03-01T01:14:41.066ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 1.141027352s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
15922025-03-01T01:14:41.147ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 1.055641568s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
15932025-03-01T01:14:41.159ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 1.207971515s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
15942025-03-01T01:14:41.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 854.517271ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
15952025-03-01T01:14:41.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 721.001982ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
15962025-03-01T01:14:41.276ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 920.992428ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
15972025-03-01T01:14:41.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 1.165942426s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
15982025-03-01T01:14:41.511ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 1.11484632s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
15992025-03-01T01:14:41.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 1.326057803s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
16002025-03-01T01:14:41.679ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573") failed: Property not found. retry in 971.095451ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
16012025-03-01T01:14:41.719ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 1.144998113s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
16022025-03-01T01:14:41.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6") failed: Property not found. retry in 1.396770424s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
16032025-03-01T01:14:41.884ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc") failed: Property not found. retry in 1.009178624s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
16042025-03-01T01:14:41.935ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a") failed: Property not found. retry in 1.225262118s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
16052025-03-01T01:14:41.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 522.693522ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
16062025-03-01T01:14:42.010ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee") failed: Property not found. retry in 919.298635ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
16072025-03-01T01:14:42.049ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33907
16082025-03-01T01:14:42.054ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2515 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33907 req_id = 30c6ebf9-bc67-41f9-be4b-11b33790b02e response_code = 200 uri = /baseboard
16092025-03-01T01:14:42.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6") failed: Property not found. retry in 1.062839714s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
16102025-03-01T01:14:42.213ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 727.834033ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
16112025-03-01T01:14:42.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 1.210198449s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
16122025-03-01T01:14:42.248ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8") failed: Property not found. retry in 722.204038ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
16132025-03-01T01:14:42.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158") failed: Property not found. retry in 1.300369281s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
16142025-03-01T01:14:42.392ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 1.023876468s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
16152025-03-01T01:14:42.490ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 689.054292ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
16162025-03-01T01:14:42.531ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 1.09387996s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
16172025-03-01T01:14:42.549ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 1.421700693s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
16182025-03-01T01:14:42.647ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89") failed: Property not found. retry in 1.397186513s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
16192025-03-01T01:14:42.887ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede") failed: Property not found. retry in 600.420378ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
16202025-03-01T01:14:42.995ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a") failed: Property not found. retry in 1.094505512s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
16212025-03-01T01:14:43.025ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc") failed: Property not found. retry in 1.043824725s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
16222025-03-01T01:14:43.249ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 1.177014042s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
16232025-03-01T01:14:43.440ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0") failed: Property not found. retry in 995.621775ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
16242025-03-01T01:14:43.467ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1") failed: Property not found. retry in 1.06821413s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
16252025-03-01T01:14:43.648ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 1.119410085s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
16262025-03-01T01:14:43.998ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 1.249833013s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
16272025-03-01T01:14:44.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 969.292354ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
16282025-03-01T01:14:44.785ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639") failed: Property not found. retry in 777.837014ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
16292025-03-01T01:14:45.268ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 804.819017ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
16302025-03-01T01:14:45.436ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21") failed: Property not found. retry in 771.22252ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
16312025-03-01T01:14:46.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 1.259698602s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
16322025-03-01T01:14:47.365ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 905.553098ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
16332025-03-01T01:14:48.282ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 957.881646ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
16342025-03-01T01:14:49.252ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea") failed: Property not found. retry in 1.121278437s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
16352025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_external_dns_5f6eb3bd-0126-40e0-98ef-ee33df084158
16362025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_nexus_67b03f4e-4cbd-4843-9cd9-647f610abcfc
16372025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_pantry_02506617-a4fd-448d-8692-4374cb30a0da
16382025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_pantry_75027a6b-c963-4116-bde7-9aaeb7c97573
16392025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_oximeter_d77aa5d6-e6f9-4845-b1d4-57f91a3621e6
16402025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_2fedc2a4-d6cb-48cc-81c1-b8a3e5596cf0
16412025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_d7434aec-e5ab-439d-8333-b62efc3f16f6
16422025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_8ce889bf-5a86-4519-b01a-24f68188604c
16432025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_26e51894-548a-446f-bcf0-d900f3fcd639
16442025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_bb548ecd-2037-4817-bbac-344383435bee
16452025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_13da719e-1a04-4c86-aa55-feedd3731b5a
16462025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_nexus_2787d512-9167-42df-aaa9-77fdf2945e21
16472025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_clickhouse_e9f5f9a5-1ba5-48ea-9fb7-da1e9196b8ea
16482025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_9ef643d3-1dcc-4c7d-8d0d-7a9cdaef0b89
16492025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_pantry_055d28b4-f6dd-486c-aef8-c744ef7277b1
16502025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_499b3b46-f9b2-4a6a-a9ec-5873a42aeede
16512025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_nexus_e72cb471-220b-4fe2-ad51-f1274aedd6cc
16522025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_d407f42a-eb7b-48f6-bf40-196a5cf1e43a
16532025-03-01T01:14:50.405ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_external_dns_2e37f4af-57dc-468e-80e3-cf2aea2ffdc8
16542025-03-01T01:14:50.406ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16552025-03-01T01:14:50.408ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16562025-03-01T01:14:50.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38051348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56339 req_id = a0cb9108-7ef7-410d-b30e-418800fa7a0d response_code = 204 uri = /omicron-zones
16572025-03-01T01:14:50.424ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1406
16582025-03-01T01:14:50.434ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16592025-03-01T01:14:50.436ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:803
16602025-03-01T01:14:50.468ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1008
16612025-03-01T01:14:50.472ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/4854cb88-dfba-4609-8f9d-72aac08cef66/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16622025-03-01T01:14:50.607ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/4854cb88-dfba-4609-8f9d-72aac08cef66/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16632025-03-01T01:14:50.786ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/4854cb88-dfba-4609-8f9d-72aac08cef66/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16642025-03-01T01:14:50.936ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/4854cb88-dfba-4609-8f9d-72aac08cef66/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16652025-03-01T01:14:51.036ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/4854cb88-dfba-4609-8f9d-72aac08cef66/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16662025-03-01T01:14:51.176ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/4854cb88-dfba-4609-8f9d-72aac08cef66/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16672025-03-01T01:14:51.547ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/4854cb88-dfba-4609-8f9d-72aac08cef66/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16682025-03-01T01:14:51.553ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 22.599512784s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
16692025-03-01T01:14:51.733ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
16702025-03-01T01:14:51.995ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/4854cb88-dfba-4609-8f9d-72aac08cef66/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16712025-03-01T01:14:52.207ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/4854cb88-dfba-4609-8f9d-72aac08cef66/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16722025-03-01T01:14:52.910ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f6f06a9c-433c-493e-a202-61ccade4d026", "content-length": "173", "date": "Sat, 01 Mar 2025 01:14:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"4854cb88-dfba-4609-8f9d-72aac08cef66\"", request_id: "f6f06a9c-433c-493e-a202-61ccade4d026" } file = sled-agent/src/rack_setup/service.rs:1070
16732025-03-01T01:14:53.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52022
16742025-03-01T01:14:53.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1019 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52022 req_id = 7ccd5299-9eb2-4d52-9f4c-7db1a5ee70bd response_code = 200 uri = /vpc-routes
16752025-03-01T01:14:53.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57524
16762025-03-01T01:14:53.355ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16772025-03-01T01:14:53.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4728 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57524 req_id = c8bb058d-4349-4925-8248-f36be29387b5 response_code = 200 uri = /artifacts
16782025-03-01T01:14:53.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44645
16792025-03-01T01:14:53.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16802025-03-01T01:14:53.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16812025-03-01T01:14:53.384ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
16822025-03-01T01:14:53.390ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
16832025-03-01T01:14:53.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
16842025-03-01T01:14:53.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3412 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52022 req_id = e20a62ce-44d5-4a57-866d-1d08b5f0cfdb response_code = 204 uri = /eip-gateways
16852025-03-01T01:14:53.412ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16862025-03-01T01:14:53.412ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22
16872025-03-01T01:14:53.451ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16882025-03-01T01:14:53.451ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7
16892025-03-01T01:14:53.490ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16902025-03-01T01:14:53.490ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_275f9857-4588-4c99-8074-92222be09c5b
16912025-03-01T01:14:53.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42627
16922025-03-01T01:14:53.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42627 req_id = 4e7a2c3d-61ee-4eaa-a8b0-059c2dbfada9 response_code = 200 uri = /vpc-routes
16932025-03-01T01:14:53.525ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16942025-03-01T01:14:53.525ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1
16952025-03-01T01:14:53.562ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16962025-03-01T01:14:53.562ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8
16972025-03-01T01:14:53.592ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16982025-03-01T01:14:53.592ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc
16992025-03-01T01:14:53.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56206
17002025-03-01T01:14:53.611ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17012025-03-01T01:14:53.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 451 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56206 req_id = 6fd5af1d-f3cc-4c97-a133-3b19982710ec response_code = 200 uri = /artifacts
17022025-03-01T01:14:53.621ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17032025-03-01T01:14:53.621ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c995cf87-df16-4488-b492-a0cb308dc53a
17042025-03-01T01:14:53.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57006
17052025-03-01T01:14:53.642ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
17062025-03-01T01:14:53.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42627 req_id = 3280aa78-d3e0-4930-a01f-63a4d9208656 response_code = 204 uri = /eip-gateways
17072025-03-01T01:14:53.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57006 req_id = f77ad8bb-c7d8-49a5-a643-c767e696c855 response_code = 200 uri = /v2p
17082025-03-01T01:14:53.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32949
17092025-03-01T01:14:53.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32949 req_id = 4a309bf0-3155-4c7e-9fb9-ad7079a09d4f response_code = 200 uri = /vpc-routes
17102025-03-01T01:14:53.651ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17112025-03-01T01:14:53.651ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7
17122025-03-01T01:14:53.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53586
17132025-03-01T01:14:53.672ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17142025-03-01T01:14:53.672ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17152025-03-01T01:14:53.672ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
17162025-03-01T01:14:53.673ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
17172025-03-01T01:14:53.679ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17182025-03-01T01:14:53.679ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9
17192025-03-01T01:14:53.695ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17202025-03-01T01:14:53.695ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22
17212025-03-01T01:14:53.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 335171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44645 req_id = a37b76b7-7081-4b38-8653-afb611d67959 response_code = 200 uri = /inventory
17222025-03-01T01:14:53.726ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17232025-03-01T01:14:53.726ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7
17242025-03-01T01:14:53.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40739
17252025-03-01T01:14:53.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17262025-03-01T01:14:53.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 609 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40739 req_id = 8d619458-e97d-4726-8bdf-471a360f6c4f response_code = 200 uri = /artifacts
17272025-03-01T01:14:53.756ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17282025-03-01T01:14:53.756ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_275f9857-4588-4c99-8074-92222be09c5b
17292025-03-01T01:14:53.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10711 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52022 req_id = ef340ab3-a30e-4e37-886c-71c0207cb03a response_code = 204 uri = /vpc-routes
17302025-03-01T01:14:53.781ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
17312025-03-01T01:14:53.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 554 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32949 req_id = cd9e75c1-c6b9-4fd7-a337-4123c773b4d0 response_code = 204 uri = /eip-gateways
17322025-03-01T01:14:53.789ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17332025-03-01T01:14:53.789ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1
17342025-03-01T01:14:53.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55514
17352025-03-01T01:14:53.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 623 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55514 req_id = 36a72a75-86f2-4574-9692-09178b7bd26d response_code = 200 uri = /v2p
17362025-03-01T01:14:53.820ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17372025-03-01T01:14:53.820ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8
17382025-03-01T01:14:53.845ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17392025-03-01T01:14:53.845ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc
17402025-03-01T01:14:53.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38202
17412025-03-01T01:14:53.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38202 req_id = efbdc68b-0e86-4151-b5e8-43e884ae692e response_code = 200 uri = /v2p
17422025-03-01T01:14:53.864ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
17432025-03-01T01:14:53.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1047 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42627 req_id = c26cd105-b13b-4ffc-a4a8-cb337a56d5c1 response_code = 204 uri = /vpc-routes
17442025-03-01T01:14:53.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33956
17452025-03-01T01:14:53.865ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17462025-03-01T01:14:53.865ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17472025-03-01T01:14:53.865ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
17482025-03-01T01:14:53.866ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
17492025-03-01T01:14:53.873ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17502025-03-01T01:14:53.873ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c995cf87-df16-4488-b492-a0cb308dc53a
17512025-03-01T01:14:53.888ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17522025-03-01T01:14:53.888ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22
17532025-03-01T01:14:53.915ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17542025-03-01T01:14:53.915ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7
17552025-03-01T01:14:53.928ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17562025-03-01T01:14:53.928ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7
17572025-03-01T01:14:53.947ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17582025-03-01T01:14:53.947ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_275f9857-4588-4c99-8074-92222be09c5b
17592025-03-01T01:14:53.965ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17602025-03-01T01:14:53.965ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9
17612025-03-01T01:14:53.985ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17622025-03-01T01:14:53.985ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1
17632025-03-01T01:14:53.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53586 req_id = a9a4fa6e-6c39-4672-8878-46f61c53c29b response_code = 200 uri = /inventory
17642025-03-01T01:14:53.990ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
17652025-03-01T01:14:53.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32949 req_id = bb9ff5f9-4b7b-4f36-80da-7ef49518eddc response_code = 204 uri = /vpc-routes
17662025-03-01T01:14:54.018ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17672025-03-01T01:14:54.018ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8
17682025-03-01T01:14:54.044ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17692025-03-01T01:14:54.044ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc
17702025-03-01T01:14:54.067ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17712025-03-01T01:14:54.068ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c995cf87-df16-4488-b492-a0cb308dc53a
17722025-03-01T01:14:54.094ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17732025-03-01T01:14:54.094ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7
17742025-03-01T01:14:54.120ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17752025-03-01T01:14:54.120ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9
17762025-03-01T01:14:54.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273602 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33956 req_id = 1a9027b2-0737-46b3-88ec-af0e83e15499 response_code = 200 uri = /inventory
17772025-03-01T01:14:54.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34353
17782025-03-01T01:14:54.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17792025-03-01T01:14:54.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17802025-03-01T01:14:54.212ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
17812025-03-01T01:14:54.213ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
17822025-03-01T01:14:54.225ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17832025-03-01T01:14:54.225ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22
17842025-03-01T01:14:54.253ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17852025-03-01T01:14:54.253ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7
17862025-03-01T01:14:54.278ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17872025-03-01T01:14:54.278ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_275f9857-4588-4c99-8074-92222be09c5b
17882025-03-01T01:14:54.302ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17892025-03-01T01:14:54.302ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1
17902025-03-01T01:14:54.332ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17912025-03-01T01:14:54.332ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8
17922025-03-01T01:14:54.357ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17932025-03-01T01:14:54.357ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc
17942025-03-01T01:14:54.380ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17952025-03-01T01:14:54.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c995cf87-df16-4488-b492-a0cb308dc53a
17962025-03-01T01:14:54.404ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17972025-03-01T01:14:54.404ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7
17982025-03-01T01:14:54.429ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17992025-03-01T01:14:54.429ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9
18002025-03-01T01:14:54.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231682 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34353 req_id = e3f6a8c3-4d56-42d1-a544-a1d473709a68 response_code = 200 uri = /inventory
18012025-03-01T01:14:55.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59232
18022025-03-01T01:14:55.052ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18032025-03-01T01:14:55.052ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18042025-03-01T01:14:55.052ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18052025-03-01T01:14:55.052ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18062025-03-01T01:14:55.052ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18072025-03-01T01:14:55.053ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18082025-03-01T01:14:55.053ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18092025-03-01T01:14:55.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59232 req_id = 468afeaf-7efb-4455-8933-e75cc4b9d2f7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18102025-03-01T01:14:55.053ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1080
18112025-03-01T01:14:55.058ZINFOSledAgent (RSS): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18122025-03-01T01:14:55.058ZINFOSledAgent (RSS): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18132025-03-01T01:14:55.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58016
18142025-03-01T01:14:55.290ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18152025-03-01T01:14:55.290ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18162025-03-01T01:14:55.290ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
18172025-03-01T01:14:55.290ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
18182025-03-01T01:14:55.301ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18192025-03-01T01:14:55.301ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22
18202025-03-01T01:14:55.323ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18212025-03-01T01:14:55.323ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7
18222025-03-01T01:14:55.343ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18232025-03-01T01:14:55.343ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_275f9857-4588-4c99-8074-92222be09c5b
18242025-03-01T01:14:55.360ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18252025-03-01T01:14:55.360ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1
18262025-03-01T01:14:55.384ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18272025-03-01T01:14:55.384ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8
18282025-03-01T01:14:55.406ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18292025-03-01T01:14:55.406ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc
18302025-03-01T01:14:55.425ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18312025-03-01T01:14:55.426ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c995cf87-df16-4488-b492-a0cb308dc53a
18322025-03-01T01:14:55.447ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18332025-03-01T01:14:55.447ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7
18342025-03-01T01:14:55.468ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18352025-03-01T01:14:55.468ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9
18362025-03-01T01:14:55.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58016 req_id = 398904c4-e336-49aa-b3b8-e64c9b23e3e4 response_code = 200 uri = /inventory
18372025-03-01T01:14:55.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35719
18382025-03-01T01:14:55.612ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18392025-03-01T01:14:55.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18402025-03-01T01:14:55.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18412025-03-01T01:14:55.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18422025-03-01T01:14:55.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18432025-03-01T01:14:55.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18442025-03-01T01:14:55.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18452025-03-01T01:14:55.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35719 req_id = 4a609950-5620-425f-959e-2549d82684f6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18462025-03-01T01:14:55.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52341
18472025-03-01T01:14:55.645ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18482025-03-01T01:14:55.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18492025-03-01T01:14:55.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18502025-03-01T01:14:55.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18512025-03-01T01:14:55.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18522025-03-01T01:14:55.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18532025-03-01T01:14:55.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18542025-03-01T01:14:55.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52341 req_id = cc63b46c-815c-40c0-8251-d9e2fa30b75b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18552025-03-01T01:14:56.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38735
18562025-03-01T01:14:56.542ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18572025-03-01T01:14:56.542ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18582025-03-01T01:14:56.542ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18592025-03-01T01:14:56.542ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18602025-03-01T01:14:56.542ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18612025-03-01T01:14:56.542ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18622025-03-01T01:14:56.542ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18632025-03-01T01:14:56.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38735 req_id = 4bb858af-ad7a-4d31-88a3-38eeca209c86 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18642025-03-01T01:15:00.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63761
18652025-03-01T01:15:00.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63761 req_id = e64df694-08a0-4d86-9f0e-80ce89cc65de response_code = 200 uri = /vpc-routes
18662025-03-01T01:15:00.973ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
18672025-03-01T01:15:00.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63761 req_id = a789f81d-bddd-4796-9d96-d7c75a9bd313 response_code = 204 uri = /eip-gateways
18682025-03-01T01:15:00.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63761 req_id = 6ae8bde0-de5c-41eb-9b06-71f7492e963c response_code = 204 uri = /vpc-routes
18692025-03-01T01:15:12.101ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34030
18702025-03-01T01:15:12.102ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34030 req_id = 5dd1863c-765c-4d96-877b-7974c0767603 response_code = 200 uri = /baseboard
18712025-03-01T01:15:23.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36956
18722025-03-01T01:15:23.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36956 req_id = c19ea5ef-d89f-4140-a9a1-99d58042d84e response_code = 200 uri = /vpc-routes
18732025-03-01T01:15:23.129ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
18742025-03-01T01:15:23.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36956 req_id = 80522a17-5aa5-4a5a-b75a-1f075c084b81 response_code = 204 uri = /eip-gateways
18752025-03-01T01:15:23.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36956 req_id = 87f25800-4f85-45ef-828d-e393826c84ed response_code = 204 uri = /vpc-routes
18762025-03-01T01:15:23.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36707
18772025-03-01T01:15:23.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36707 req_id = d511bda8-38d2-46a0-aad2-1857901d52d0 response_code = 200 uri = /v2p
18782025-03-01T01:15:23.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56546
18792025-03-01T01:15:23.437ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
18802025-03-01T01:15:23.730ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
18812025-03-01T01:15:23.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 378212 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56546 req_id = 45c90bb8-add2-41e3-a0f3-6a68a2811cb7 response_code = 204 uri = /switch-ports
18822025-03-01T01:15:23.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49651
18832025-03-01T01:15:23.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33614
18842025-03-01T01:15:23.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59187
18852025-03-01T01:15:23.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56545
18862025-03-01T01:15:23.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65260
18872025-03-01T01:15:23.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49651 req_id = 7a90dd17-add3-4f8b-acb4-efd9b1a13205 response_code = 200 uri = /vpc-routes
18882025-03-01T01:15:23.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56545 req_id = e1a6a06a-486a-4e22-8e56-46109bd82a42 response_code = 200 uri = /v2p
18892025-03-01T01:15:23.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33614 req_id = c0d3fb41-8f81-4d6f-8842-6eec8f70e5c4 response_code = 200 uri = /v2p
18902025-03-01T01:15:23.815ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
18912025-03-01T01:15:23.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 15401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56546 req_id = 7eefc32f-9694-43df-9c9d-100b2994b02b response_code = 200 uri = /network-bootstore-config
18922025-03-01T01:15:23.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4487 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59187 req_id = 0dfbba99-672e-4c68-a337-e13a0c254814 response_code = 200 uri = /vpc-routes
18932025-03-01T01:15:23.844ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
18942025-03-01T01:15:23.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 678 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49651 req_id = ba2a5aaf-be94-46df-ac6e-416654d4b3b5 response_code = 204 uri = /eip-gateways
18952025-03-01T01:15:23.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49651 req_id = e8badff0-b62f-403d-a7e0-cf3a5e07ad3e response_code = 204 uri = /vpc-routes
18962025-03-01T01:15:23.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
18972025-03-01T01:15:23.881ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
18982025-03-01T01:15:23.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59187 req_id = c67f5cd1-2880-4dc7-a65f-02d99aec2e19 response_code = 204 uri = /eip-gateways
18992025-03-01T01:15:23.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59187 req_id = ddf955d7-b5ae-41bf-8fa9-b2ad3143dfdc response_code = 204 uri = /vpc-routes
19002025-03-01T01:15:23.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161845 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65260 req_id = 8da86030-54bd-4154-85d9-4812f3047e1c response_code = 204 uri = /switch-ports
19012025-03-01T01:15:23.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65260 req_id = 8cd60fbe-30d8-4c46-8149-a0c08fc354cb response_code = 200 uri = /network-bootstore-config
19022025-03-01T01:15:24.264ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
19032025-03-01T01:15:24.264ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19042025-03-01T01:15:24.288ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19052025-03-01T01:15:24.289ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
19062025-03-01T01:15:24.289ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
19072025-03-01T01:15:24.289ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19082025-03-01T01:15:24.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30098 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56546 req_id = f3add64f-0895-4551-93ba-e145445388ae response_code = 204 uri = /network-bootstore-config
19092025-03-01T01:15:24.289ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19102025-03-01T01:15:24.289ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
19112025-03-01T01:15:24.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65260 req_id = f48e50ff-d150-45bf-8948-ef3137fe253d response_code = 204 uri = /network-bootstore-config
19122025-03-01T01:15:24.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46565
19132025-03-01T01:15:24.526ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19142025-03-01T01:15:24.565ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19152025-03-01T01:15:24.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97308 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46565 req_id = 1e2e4e70-f1de-49d3-9d96-d8fac4a43693 response_code = 204 uri = /switch-ports
19162025-03-01T01:15:24.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46565 req_id = 9fcee01a-173f-46d3-84c9-4adc1855793a response_code = 200 uri = /network-bootstore-config
19172025-03-01T01:15:42.135ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34875
19182025-03-01T01:15:42.135ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34875 req_id = 53b43f8c-56f2-4efa-b4b4-1fe7365783c2 response_code = 200 uri = /baseboard
19192025-03-01T01:15:52.415ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:60769 remote_addr = [fd00:1122:3344:101::d]:56305 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
19202025-03-01T01:15:52.451ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34232 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 40bc4c3c-0261-435c-9359-1f208f85c6c2 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
19212025-03-01T01:15:53.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39801
19222025-03-01T01:15:53.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39801 req_id = 40cb83fd-47cc-4084-8c9c-dbba9a0000b8 response_code = 200 uri = /v2p
19232025-03-01T01:15:53.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36853
19242025-03-01T01:15:53.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36853 req_id = 53fa8030-1179-4b40-82b2-e3c6f19cb2ac response_code = 200 uri = /vpc-routes
19252025-03-01T01:15:53.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47009
19262025-03-01T01:15:53.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47009 req_id = 53126579-f43f-41f7-8cd8-2e695b1f2a0f response_code = 200 uri = /vpc-routes
19272025-03-01T01:15:53.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
19282025-03-01T01:15:53.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36853 req_id = dfb9b9bc-755e-4589-9bdf-f2837adbfb3f response_code = 204 uri = /eip-gateways
19292025-03-01T01:15:53.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36853 req_id = c7b874e6-5180-4c63-ae0b-195ac453874c response_code = 204 uri = /vpc-routes
19302025-03-01T01:15:53.581ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
19312025-03-01T01:15:53.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47009 req_id = 95e171e6-34de-4e34-938c-cb95a584655d response_code = 204 uri = /eip-gateways
19322025-03-01T01:15:53.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47009 req_id = 8a04fc3c-d59e-45d0-9bdf-2bf19befc05a response_code = 204 uri = /vpc-routes
19332025-03-01T01:15:53.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35816
19342025-03-01T01:15:53.598ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19352025-03-01T01:15:53.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19362025-03-01T01:15:53.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103527 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35816 req_id = 3fbe1892-0aaa-4dd3-82bb-71556684a1a8 response_code = 204 uri = /switch-ports
19372025-03-01T01:15:53.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35816 req_id = 55b4cf22-02ed-4640-8af4-fe870a708b18 response_code = 200 uri = /network-bootstore-config
19382025-03-01T01:15:53.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43149
19392025-03-01T01:15:53.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43149 req_id = 67e2bc42-03a6-424f-a494-22ebed61a13e response_code = 200 uri = /vpc-routes
19402025-03-01T01:15:53.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63519
19412025-03-01T01:15:53.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63519 req_id = 793e4547-f555-403b-bba1-ce07a829e9f9 response_code = 200 uri = /v2p
19422025-03-01T01:15:53.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64184
19432025-03-01T01:15:53.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64184 req_id = 1149870a-716f-498f-a3d1-60f2ed041d5c response_code = 200 uri = /v2p
19442025-03-01T01:15:53.834ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
19452025-03-01T01:15:53.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43149 req_id = e5d97820-3e8a-4684-a05d-57ab8eb2438c response_code = 204 uri = /eip-gateways
19462025-03-01T01:15:53.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43149 req_id = 441b7eb1-2fb2-4eaa-aeac-31c9f6579314 response_code = 204 uri = /vpc-routes
19472025-03-01T01:15:53.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56357
19482025-03-01T01:15:53.902ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19492025-03-01T01:15:53.946ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19502025-03-01T01:15:54.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108987 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56357 req_id = 0e2bfb6c-1eb3-41b9-b74d-a2c01f514ea9 response_code = 204 uri = /switch-ports
19512025-03-01T01:15:54.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56357 req_id = 6f13db55-8a28-4606-9e29-4a9fd33cb126 response_code = 200 uri = /network-bootstore-config
19522025-03-01T01:15:54.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48817
19532025-03-01T01:15:54.048ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19542025-03-01T01:15:54.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19552025-03-01T01:15:54.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48817 req_id = e11a72c3-65b2-49da-bed4-8fa4afaadd76 response_code = 204 uri = /switch-ports
19562025-03-01T01:15:54.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48817 req_id = 6f0da201-3861-455d-8667-cd279152200d response_code = 200 uri = /network-bootstore-config
19572025-03-01T01:16:12.168ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65361
19582025-03-01T01:16:12.168ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65361 req_id = 78ee7605-7b4e-4413-a234-729723d8d8e3 response_code = 200 uri = /baseboard
19592025-03-01T01:16:22.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6548 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 0159429c-c3e4-4da3-b6a6-d9f97cd7a5da response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
19602025-03-01T01:16:23.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38388
19612025-03-01T01:16:23.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38388 req_id = d0f157c9-c29d-4df0-bfb6-caaf64857104 response_code = 200 uri = /vpc-routes
19622025-03-01T01:16:23.298ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
19632025-03-01T01:16:23.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38388 req_id = 28ce2c45-ea4d-4231-934a-eafe8d41e43a response_code = 204 uri = /eip-gateways
19642025-03-01T01:16:23.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38388 req_id = 08761be2-9e12-4c12-892c-55a7ba4f1fb5 response_code = 204 uri = /vpc-routes
19652025-03-01T01:16:23.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41809
19662025-03-01T01:16:23.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41809 req_id = 59604417-43a0-44ec-b14c-2fba9ed4106e response_code = 200 uri = /vpc-routes
19672025-03-01T01:16:23.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62602
19682025-03-01T01:16:23.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62602 req_id = fa15cd28-8442-4223-a356-5e577f1debbd response_code = 200 uri = /v2p
19692025-03-01T01:16:23.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35473
19702025-03-01T01:16:23.412ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19712025-03-01T01:16:23.456ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19722025-03-01T01:16:23.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35473 req_id = dbe07ed6-b742-4cb7-a5c1-a50831b8102f response_code = 204 uri = /switch-ports
19732025-03-01T01:16:23.519ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
19742025-03-01T01:16:23.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41809 req_id = e32c0b4e-556f-457d-bff4-64d0f8731341 response_code = 204 uri = /eip-gateways
19752025-03-01T01:16:23.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35473 req_id = 430643af-9ac2-40d5-a9b0-9732ffcbf6f8 response_code = 200 uri = /network-bootstore-config
19762025-03-01T01:16:23.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41809 req_id = ac9a5bcf-218f-4ffd-a4f5-22f5ab9c3617 response_code = 204 uri = /vpc-routes
19772025-03-01T01:16:23.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36260
19782025-03-01T01:16:23.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36260 req_id = 7fc69a29-0691-4327-a9e1-1f00afcd9a4c response_code = 200 uri = /v2p
19792025-03-01T01:16:23.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48993
19802025-03-01T01:16:23.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48993 req_id = e4dde8ce-a3dd-4a08-8a4d-5aff0ffaac75 response_code = 200 uri = /vpc-routes
19812025-03-01T01:16:23.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63762
19822025-03-01T01:16:23.616ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19832025-03-01T01:16:23.660ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19842025-03-01T01:16:23.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63762 req_id = 090dd0cb-cc14-451d-a526-73087491700b response_code = 204 uri = /switch-ports
19852025-03-01T01:16:23.721ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
19862025-03-01T01:16:23.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48993 req_id = cc271d44-d72e-417c-bb93-e12dbd7fada1 response_code = 204 uri = /eip-gateways
19872025-03-01T01:16:23.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63762 req_id = ab27432e-3c5b-4234-8afc-fd13a65b81f1 response_code = 200 uri = /network-bootstore-config
19882025-03-01T01:16:23.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48993 req_id = fa6e8683-a054-4947-8898-487629177fc1 response_code = 204 uri = /vpc-routes
19892025-03-01T01:16:23.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45719
19902025-03-01T01:16:23.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45719 req_id = d6d8beec-9bb8-4238-a62c-c8c75f378586 response_code = 200 uri = /v2p
19912025-03-01T01:16:23.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52975
19922025-03-01T01:16:23.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19932025-03-01T01:16:23.999ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19942025-03-01T01:16:24.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52975 req_id = 29cf3a7f-df6d-4d7a-8163-81a7e779de12 response_code = 204 uri = /switch-ports
19952025-03-01T01:16:24.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52975 req_id = 7e9774c4-ad50-4d03-9c8c-34689c1b10d1 response_code = 200 uri = /network-bootstore-config
19962025-03-01T01:16:42.200ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41331
19972025-03-01T01:16:42.200ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41331 req_id = 661ddd5f-0a56-4124-9a27-a1e250bee543 response_code = 200 uri = /baseboard
19982025-03-01T01:16:52.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7678 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 3c8d9ece-82cf-43c5-9a02-95dac6fc6031 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
19992025-03-01T01:16:53.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60394
20002025-03-01T01:16:53.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60394 req_id = 1f0da492-5706-4e2e-8d6b-b7983ed54df5 response_code = 200 uri = /vpc-routes
20012025-03-01T01:16:53.369ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
20022025-03-01T01:16:53.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60394 req_id = 6cb7d0ba-b3c4-4acb-9a05-3139a8cf53ab response_code = 204 uri = /eip-gateways
20032025-03-01T01:16:53.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60394 req_id = c526737f-9405-4ec7-803e-f8be9a2f593d response_code = 204 uri = /vpc-routes
20042025-03-01T01:16:53.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46869
20052025-03-01T01:16:53.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46869 req_id = 3ba3f0b0-f0d7-47a4-811c-71d621a82f23 response_code = 200 uri = /vpc-routes
20062025-03-01T01:16:53.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37088
20072025-03-01T01:16:53.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37088 req_id = e578909b-0977-4ad1-82d3-d16591b7dd1a response_code = 200 uri = /v2p
20082025-03-01T01:16:53.586ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
20092025-03-01T01:16:53.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46869 req_id = f8461343-b58d-4096-80cd-0d3976aab881 response_code = 204 uri = /eip-gateways
20102025-03-01T01:16:53.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46869 req_id = bb877cc1-ee14-476b-b2f1-1ee074f98d1f response_code = 204 uri = /vpc-routes
20112025-03-01T01:16:53.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49723
20122025-03-01T01:16:53.624ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20132025-03-01T01:16:53.666ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20142025-03-01T01:16:53.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103310 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49723 req_id = 85b175e9-f62e-483d-a0f7-93e0256220e2 response_code = 204 uri = /switch-ports
20152025-03-01T01:16:53.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49723 req_id = ca75059a-203b-44ae-b151-02d3ca387569 response_code = 200 uri = /network-bootstore-config
20162025-03-01T01:16:53.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44565
20172025-03-01T01:16:53.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44565 req_id = 1ea9d7a1-8b54-4cc5-8ee8-0c2c066404f2 response_code = 200 uri = /v2p
20182025-03-01T01:16:53.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61688
20192025-03-01T01:16:53.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61688 req_id = 3aaff7ed-ba60-4bce-87ef-25638407a581 response_code = 200 uri = /vpc-routes
20202025-03-01T01:16:53.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61213
20212025-03-01T01:16:53.837ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20222025-03-01T01:16:53.877ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20232025-03-01T01:16:53.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61213 req_id = 3b928a2d-1ac0-4ae8-8897-54e415e9dd54 response_code = 204 uri = /switch-ports
20242025-03-01T01:16:53.941ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
20252025-03-01T01:16:53.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61688 req_id = 0689018a-45ba-44d0-bf27-2f0e116c39a3 response_code = 204 uri = /eip-gateways
20262025-03-01T01:16:53.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61213 req_id = 1ca117f0-b410-4ada-8f3d-cda0217a3f64 response_code = 200 uri = /network-bootstore-config
20272025-03-01T01:16:53.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62892
20282025-03-01T01:16:53.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62892 req_id = 00d2b4ac-090d-4fd7-bd23-71b811ee82ae response_code = 200 uri = /v2p
20292025-03-01T01:16:53.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61688 req_id = 5caab87e-01c1-44f0-806f-f3c0cdbaeee5 response_code = 204 uri = /vpc-routes
20302025-03-01T01:16:53.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52795
20312025-03-01T01:16:53.992ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20322025-03-01T01:16:54.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20332025-03-01T01:16:54.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100698 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52795 req_id = 35356aee-875f-474c-afad-106462daab12 response_code = 204 uri = /switch-ports
20342025-03-01T01:16:54.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52795 req_id = aded2d3f-d61b-4cd1-b5f2-ded05cd07f46 response_code = 200 uri = /network-bootstore-config
20352025-03-01T01:17:12.234ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44779
20362025-03-01T01:17:12.234ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44779 req_id = 55c3bb54-a4c8-4ca4-95b8-9b5cac9eaaf9 response_code = 200 uri = /baseboard
20372025-03-01T01:17:20.591ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20382025-03-01T01:17:22.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6588 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = d6ec0c36-6ffd-4d75-8729-07ea4e15ff15 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
20392025-03-01T01:17:23.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41412
20402025-03-01T01:17:23.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41412 req_id = d5da27ac-1988-4fcc-ad3b-aebe2a7146fb response_code = 200 uri = /vpc-routes
20412025-03-01T01:17:23.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62459
20422025-03-01T01:17:23.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62459 req_id = 44a36995-60dc-408c-a40a-c3bef402cdd8 response_code = 200 uri = /v2p
20432025-03-01T01:17:23.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
20442025-03-01T01:17:23.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41412 req_id = 22dc622d-e103-4f5e-b2cf-daf1a0c291b4 response_code = 204 uri = /eip-gateways
20452025-03-01T01:17:23.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41412 req_id = 659886e2-f034-424c-a12d-6034552e0ebb response_code = 204 uri = /vpc-routes
20462025-03-01T01:17:23.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48455
20472025-03-01T01:17:23.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48455 req_id = 43514614-4100-4097-b809-4c31b53de2e1 response_code = 200 uri = /vpc-routes
20482025-03-01T01:17:23.491ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
20492025-03-01T01:17:23.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48455 req_id = e0c632c6-4142-4d74-bb3f-47b407c9d66e response_code = 204 uri = /eip-gateways
20502025-03-01T01:17:23.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48455 req_id = 163a5860-8804-4e5b-b3c5-cc3e5e761cea response_code = 204 uri = /vpc-routes
20512025-03-01T01:17:23.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54824
20522025-03-01T01:17:23.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54824 req_id = 5a96b8aa-4b2a-4658-a873-3459ca980bd5 response_code = 200 uri = /vpc-routes
20532025-03-01T01:17:23.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38208
20542025-03-01T01:17:23.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38208 req_id = d1060b3c-5ea4-461d-b1ec-8f49d8419b6f response_code = 200 uri = /v2p
20552025-03-01T01:17:23.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55540
20562025-03-01T01:17:23.557ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20572025-03-01T01:17:23.605ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20582025-03-01T01:17:23.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114651 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55540 req_id = c3a85654-e105-4fd0-8517-71bad4bd4b34 response_code = 204 uri = /switch-ports
20592025-03-01T01:17:23.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51639
20602025-03-01T01:17:23.672ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20612025-03-01T01:17:23.672ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
20622025-03-01T01:17:23.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54824 req_id = 0eea5c4a-c315-4173-83ef-862d6affef88 response_code = 204 uri = /eip-gateways
20632025-03-01T01:17:23.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3701 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55540 req_id = f4615c03-fb29-442d-94a7-5061a3785e62 response_code = 200 uri = /network-bootstore-config
20642025-03-01T01:17:23.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54824 req_id = 430f4325-cd56-4f8a-aef0-e8087fc64319 response_code = 204 uri = /vpc-routes
20652025-03-01T01:17:23.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63239
20662025-03-01T01:17:23.707ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20672025-03-01T01:17:23.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65181
20682025-03-01T01:17:23.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65181 req_id = 731f61ec-524e-4d7d-b758-69ade39a3dd6 response_code = 200 uri = /v2p
20692025-03-01T01:17:23.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20702025-03-01T01:17:23.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90264 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51639 req_id = 4c095c3f-4247-4ce8-b6f0-bc877b75716c response_code = 204 uri = /switch-ports
20712025-03-01T01:17:23.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51639 req_id = 7da08010-09b1-40f8-9b59-64619bce204d response_code = 200 uri = /network-bootstore-config
20722025-03-01T01:17:23.799ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20732025-03-01T01:17:23.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165183 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63239 req_id = 4287c80f-89cb-4dee-a210-e5ba75635379 response_code = 204 uri = /switch-ports
20742025-03-01T01:17:23.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63239 req_id = c4e7e828-069f-4b61-8d98-4d763bafd5e9 response_code = 200 uri = /network-bootstore-config
20752025-03-01T01:17:42.267ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51283
20762025-03-01T01:17:42.268ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51283 req_id = 91a02f76-de78-43dc-ba86-dc887a91b6ba response_code = 200 uri = /baseboard
20772025-03-01T01:17:52.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7757 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = f83e6ea3-5951-46e8-97cb-6dd12bc1809e response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
20782025-03-01T01:17:53.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55048
20792025-03-01T01:17:53.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55048 req_id = ea425c51-8cbc-4958-a1fb-53ab66570a4d response_code = 200 uri = /v2p
20802025-03-01T01:17:53.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43968
20812025-03-01T01:17:53.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43968 req_id = a9e89e84-0c28-4005-9478-efb13c58f276 response_code = 200 uri = /vpc-routes
20822025-03-01T01:17:53.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43666
20832025-03-01T01:17:53.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43666 req_id = ac901844-3572-42f1-8739-0784d0b280c6 response_code = 200 uri = /vpc-routes
20842025-03-01T01:17:53.599ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
20852025-03-01T01:17:53.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43968 req_id = 87e65c74-e4ff-4bd1-90db-46d127d900b4 response_code = 204 uri = /eip-gateways
20862025-03-01T01:17:53.630ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
20872025-03-01T01:17:53.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43666 req_id = 4dc78e0c-0478-43b4-8fe3-f521fc71c86a response_code = 204 uri = /eip-gateways
20882025-03-01T01:17:53.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41081
20892025-03-01T01:17:53.730ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20902025-03-01T01:17:53.767ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20912025-03-01T01:17:53.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101168 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41081 req_id = 4c9133b1-07b1-4972-a311-68ab6789d73c response_code = 204 uri = /switch-ports
20922025-03-01T01:17:53.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60559
20932025-03-01T01:17:53.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50318
20942025-03-01T01:17:53.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41081 req_id = c3450bf3-b282-4173-ba4f-0256729da1dc response_code = 200 uri = /network-bootstore-config
20952025-03-01T01:17:53.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43968 req_id = 5528a396-0821-4d2a-a6aa-a7678d8b09ca response_code = 204 uri = /vpc-routes
20962025-03-01T01:17:53.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34570
20972025-03-01T01:17:53.832ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20982025-03-01T01:17:53.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34570 req_id = a3dac0e1-b613-43dc-8726-7040ac857ae5 response_code = 200 uri = /vpc-routes
20992025-03-01T01:17:53.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6409 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50318 req_id = 7d880578-b79a-4358-98a1-950069942d87 response_code = 200 uri = /v2p
21002025-03-01T01:17:53.880ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21012025-03-01T01:17:53.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 406 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43666 req_id = 8e6b97f1-ca77-4a87-8be2-79631190bdc2 response_code = 204 uri = /vpc-routes
21022025-03-01T01:17:53.888ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
21032025-03-01T01:17:53.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34570 req_id = 1b945ff8-a747-4f50-a660-0cba7f9e8493 response_code = 204 uri = /eip-gateways
21042025-03-01T01:17:53.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109991 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60559 req_id = 8a8d39b9-da20-427d-bf95-3eba5d74f6fc response_code = 204 uri = /switch-ports
21052025-03-01T01:17:53.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60559 req_id = e575cd1e-b7a6-470a-b756-fa5c9efc057d response_code = 200 uri = /network-bootstore-config
21062025-03-01T01:17:54.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34570 req_id = ce3f4111-fcaa-493f-8254-473d8b7561ce response_code = 204 uri = /vpc-routes
21072025-03-01T01:17:54.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33253
21082025-03-01T01:17:54.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33253 req_id = 1cca4952-940d-4e4b-a568-dbeb0713f16d response_code = 200 uri = /v2p
21092025-03-01T01:17:54.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36512
21102025-03-01T01:17:54.157ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21112025-03-01T01:17:54.191ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21122025-03-01T01:17:54.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86315 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36512 req_id = 71365b65-d156-4ebe-914b-230bc3da9d41 response_code = 204 uri = /switch-ports
21132025-03-01T01:17:54.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36512 req_id = 6d895388-ae1d-48b4-aa5c-f1e8fcddd836 response_code = 200 uri = /network-bootstore-config
21142025-03-01T01:18:12.302ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54364
21152025-03-01T01:18:12.302ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54364 req_id = c99fd92d-1e64-4083-bc30-38f2a5f1daec response_code = 200 uri = /baseboard
21162025-03-01T01:18:22.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7074 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 234cca62-73b5-4dc3-939e-1a36db455109 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
21172025-03-01T01:18:23.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55776
21182025-03-01T01:18:23.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55776 req_id = 6259d46c-0c14-470c-9472-882d1b2f6f37 response_code = 200 uri = /vpc-routes
21192025-03-01T01:18:23.218ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
21202025-03-01T01:18:23.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55776 req_id = 99933058-59c1-4b2b-9aee-735ca0218db7 response_code = 204 uri = /eip-gateways
21212025-03-01T01:18:23.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65194
21222025-03-01T01:18:23.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65194 req_id = 77790298-1220-40f1-878e-3085ff5ff39e response_code = 200 uri = /v2p
21232025-03-01T01:18:23.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55776 req_id = dd33961f-562d-4a19-83bc-a57dc0b62366 response_code = 204 uri = /vpc-routes
21242025-03-01T01:18:23.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47481
21252025-03-01T01:18:23.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47481 req_id = 2201c946-83e7-45cf-b8c7-fe454f6d648b response_code = 200 uri = /vpc-routes
21262025-03-01T01:18:23.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43797
21272025-03-01T01:18:23.560ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21282025-03-01T01:18:23.601ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21292025-03-01T01:18:23.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43797 req_id = 7ff6b0fa-e8e4-4bd0-9a6c-84b1c22b5b16 response_code = 204 uri = /switch-ports
21302025-03-01T01:18:23.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36464
21312025-03-01T01:18:23.662ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
21322025-03-01T01:18:23.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47481 req_id = ce52315b-26e7-4cec-93ca-74a779a66a90 response_code = 204 uri = /eip-gateways
21332025-03-01T01:18:23.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41408
21342025-03-01T01:18:23.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47631
21352025-03-01T01:18:23.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43797 req_id = 7c418ca8-73e5-4f9b-a885-5201f037f44a response_code = 200 uri = /network-bootstore-config
21362025-03-01T01:18:23.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36464 req_id = 42d902a7-df8a-4f3f-990c-a2d5db6ebcf8 response_code = 200 uri = /v2p
21372025-03-01T01:18:23.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47631 req_id = 618009ba-3e98-4d14-abd6-50a50a5315b9 response_code = 200 uri = /vpc-routes
21382025-03-01T01:18:23.662ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21392025-03-01T01:18:23.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47481 req_id = 96c99362-59eb-4b1a-8eba-94c56b247b36 response_code = 204 uri = /vpc-routes
21402025-03-01T01:18:23.682ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
21412025-03-01T01:18:23.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 578 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47631 req_id = 57f07651-e0d6-4704-90fa-2110887a0c16 response_code = 204 uri = /eip-gateways
21422025-03-01T01:18:23.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 818 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47631 req_id = 1d8208c1-a778-4064-9d58-17aaa29b4cd0 response_code = 204 uri = /vpc-routes
21432025-03-01T01:18:23.702ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21442025-03-01T01:18:23.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96850 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41408 req_id = 0ba86188-157d-4cf0-b996-ed1d4c189a13 response_code = 204 uri = /switch-ports
21452025-03-01T01:18:23.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41408 req_id = 5cc5ef48-32aa-4cc6-aa27-4ba364ba412f response_code = 200 uri = /network-bootstore-config
21462025-03-01T01:18:23.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47355
21472025-03-01T01:18:23.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47355 req_id = 998fb0db-6aa7-409c-8ef3-d315753ddc77 response_code = 200 uri = /v2p
21482025-03-01T01:18:23.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33060
21492025-03-01T01:18:23.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21502025-03-01T01:18:23.864ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21512025-03-01T01:18:23.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90562 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33060 req_id = 3c4a9732-1e2c-41d4-ae46-58b0ae1986e7 response_code = 204 uri = /switch-ports
21522025-03-01T01:18:23.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33060 req_id = 79b4254b-f284-4aee-bbdf-88f609631ab8 response_code = 200 uri = /network-bootstore-config
21532025-03-01T01:18:42.336ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34056
21542025-03-01T01:18:42.337ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34056 req_id = 7955beec-71cf-4d67-a389-983981767c9e response_code = 200 uri = /baseboard
21552025-03-01T01:18:52.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7751 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = a4043354-8850-4a2f-8eab-62d7ae8d0f77 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
21562025-03-01T01:18:53.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55832
21572025-03-01T01:18:53.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55832 req_id = 31042969-080e-4b4a-93c9-b02db0da9a33 response_code = 200 uri = /vpc-routes
21582025-03-01T01:18:53.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34891
21592025-03-01T01:18:53.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34891 req_id = 4376d600-7102-4073-9749-efe2d4bee690 response_code = 200 uri = /v2p
21602025-03-01T01:18:53.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
21612025-03-01T01:18:53.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55832 req_id = e4373820-e125-4ac9-89f3-cef05114e3ac response_code = 204 uri = /eip-gateways
21622025-03-01T01:18:53.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55832 req_id = 90c4b272-d878-4d7e-89a4-18e2461c1446 response_code = 204 uri = /vpc-routes
21632025-03-01T01:18:53.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51171
21642025-03-01T01:18:53.514ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21652025-03-01T01:18:53.558ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21662025-03-01T01:18:53.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110099 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51171 req_id = 070b3b5d-4299-4ddb-83cf-93bf7de26655 response_code = 204 uri = /switch-ports
21672025-03-01T01:18:53.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45747
21682025-03-01T01:18:53.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60879
21692025-03-01T01:18:53.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60879 req_id = 1065f0d0-3052-4060-bbba-fa5f1c56688c response_code = 200 uri = /vpc-routes
21702025-03-01T01:18:53.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45747 req_id = 2cf86ee3-07ec-4437-adf5-69a9c096f91e response_code = 200 uri = /vpc-routes
21712025-03-01T01:18:53.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51171 req_id = 4c35edfe-0b22-4847-8aab-fbeeae5d22a3 response_code = 200 uri = /network-bootstore-config
21722025-03-01T01:18:53.693ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
21732025-03-01T01:18:53.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45747 req_id = 467f567b-5495-4890-933e-6b7bc6dee08d response_code = 204 uri = /eip-gateways
21742025-03-01T01:18:53.701ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
21752025-03-01T01:18:53.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60879 req_id = 9e11512e-d698-4f52-ad23-097fe69d9309 response_code = 204 uri = /eip-gateways
21762025-03-01T01:18:53.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45747 req_id = d3922eb8-87bf-4363-aa80-2277a7b11f26 response_code = 204 uri = /vpc-routes
21772025-03-01T01:18:53.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60879 req_id = b057d69f-7fa4-43a7-97a0-1d0945655549 response_code = 204 uri = /vpc-routes
21782025-03-01T01:18:53.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46791
21792025-03-01T01:18:53.745ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21802025-03-01T01:18:53.791ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21812025-03-01T01:18:53.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107194 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46791 req_id = 6764d772-c10c-4e5f-94d6-72d7f8bbb18a response_code = 204 uri = /switch-ports
21822025-03-01T01:18:53.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34062
21832025-03-01T01:18:53.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34062 req_id = 1e872770-9925-4960-9b9e-bfb280bb6945 response_code = 200 uri = /v2p
21842025-03-01T01:18:53.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46791 req_id = c681337a-f5a1-41db-b10f-ddefbf017633 response_code = 200 uri = /network-bootstore-config
21852025-03-01T01:18:53.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51427
21862025-03-01T01:18:53.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51427 req_id = 6419f98a-2c2d-4bd7-bddd-20d0971567b1 response_code = 200 uri = /v2p
21872025-03-01T01:18:53.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43191
21882025-03-01T01:18:53.944ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21892025-03-01T01:18:53.981ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21902025-03-01T01:18:54.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43191 req_id = a946ea7f-118a-4708-98ad-91c7ed39d88b response_code = 204 uri = /switch-ports
21912025-03-01T01:18:54.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43191 req_id = 6b0e4895-4747-4435-979d-96215e07b088 response_code = 200 uri = /network-bootstore-config
21922025-03-01T01:19:12.371ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38885
21932025-03-01T01:19:12.371ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38885 req_id = 28a4b0de-4619-4aad-b6d0-780b894d6b8a response_code = 200 uri = /baseboard
21942025-03-01T01:19:22.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6481 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 60073a4d-0a26-44fa-bff0-5959aa9f3a94 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
21952025-03-01T01:19:23.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63805
21962025-03-01T01:19:23.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63805 req_id = 5b54bbcf-321a-4bba-9f13-45eb97e79a5d response_code = 200 uri = /v2p
21972025-03-01T01:19:23.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45387
21982025-03-01T01:19:23.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45387 req_id = 2e73c955-d57b-4843-aeb2-40a07a93d9f6 response_code = 200 uri = /vpc-routes
21992025-03-01T01:19:23.293ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
22002025-03-01T01:19:23.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45387 req_id = b2300b85-a532-41d2-af88-00d7abdcd30a response_code = 204 uri = /eip-gateways
22012025-03-01T01:19:23.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45387 req_id = a0e0ce80-03c0-4419-9127-1a57bc9787de response_code = 204 uri = /vpc-routes
22022025-03-01T01:19:23.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53138
22032025-03-01T01:19:23.386ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22042025-03-01T01:19:23.441ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22052025-03-01T01:19:23.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121420 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53138 req_id = 54df70b1-bb63-4512-ba5b-06275d36852e response_code = 204 uri = /switch-ports
22062025-03-01T01:19:23.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54967
22072025-03-01T01:19:23.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54967 req_id = 79848ebf-98f0-4f82-bace-48a041554f33 response_code = 200 uri = /vpc-routes
22082025-03-01T01:19:23.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53138 req_id = c630aa1c-a03a-4c25-a636-7a2bf8e7a0bf response_code = 200 uri = /network-bootstore-config
22092025-03-01T01:19:23.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36884
22102025-03-01T01:19:23.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36884 req_id = 35d46e2c-a5f1-43aa-8f40-d696f8845030 response_code = 200 uri = /v2p
22112025-03-01T01:19:23.556ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
22122025-03-01T01:19:23.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54967 req_id = 49e6b2ab-8c20-4dac-bb34-85c9dffc8fde response_code = 204 uri = /eip-gateways
22132025-03-01T01:19:23.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45598
22142025-03-01T01:19:23.560ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22152025-03-01T01:19:23.602ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22162025-03-01T01:19:23.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45598 req_id = c6db9117-a43c-4d13-8d70-8e291959679a response_code = 204 uri = /switch-ports
22172025-03-01T01:19:23.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46856
22182025-03-01T01:19:23.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33819
22192025-03-01T01:19:23.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63898
22202025-03-01T01:19:23.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45598 req_id = 492f8552-64fb-4bf8-bee1-65f9ba8c68fa response_code = 200 uri = /network-bootstore-config
22212025-03-01T01:19:23.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46856 req_id = 01ead975-792f-4f5f-8573-e48907ae28c7 response_code = 200 uri = /vpc-routes
22222025-03-01T01:19:23.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63898 req_id = f1a56257-cd20-4604-8333-4002c7bc7764 response_code = 200 uri = /v2p
22232025-03-01T01:19:23.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 519 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54967 req_id = e9468ba7-7a3a-4d87-902a-5185c6e5ed13 response_code = 204 uri = /vpc-routes
22242025-03-01T01:19:23.665ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22252025-03-01T01:19:23.682ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
22262025-03-01T01:19:23.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46856 req_id = 01ceffbe-1009-458c-9c32-b5d134b07b54 response_code = 204 uri = /eip-gateways
22272025-03-01T01:19:23.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46856 req_id = 33c07695-759b-4969-ac85-a9d4e180afff response_code = 204 uri = /vpc-routes
22282025-03-01T01:19:23.703ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22292025-03-01T01:19:23.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91163 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33819 req_id = 25405841-b723-4701-92d3-9c03ce6c3051 response_code = 204 uri = /switch-ports
22302025-03-01T01:19:23.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33819 req_id = 041ca2b7-ddbd-4973-8d52-d43f25b8aca5 response_code = 200 uri = /network-bootstore-config
22312025-03-01T01:19:42.404ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64036
22322025-03-01T01:19:42.404ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64036 req_id = bf4f18e7-9fb3-440b-95bb-630676b69d2a response_code = 200 uri = /baseboard
22332025-03-01T01:19:52.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7047 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = f7b07f3a-7103-4fa9-8ea0-a5627025da4c response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
22342025-03-01T01:19:53.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42687
22352025-03-01T01:19:53.356ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22362025-03-01T01:19:53.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 483 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42687 req_id = 9cf6177e-8348-43ca-a8c3-fc4c7d4030a1 response_code = 200 uri = /artifacts
22372025-03-01T01:19:53.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62992
22382025-03-01T01:19:53.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62992 req_id = 07b2f6f8-e040-4845-a952-18bb0d632220 response_code = 200 uri = /vpc-routes
22392025-03-01T01:19:53.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38398
22402025-03-01T01:19:53.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38398 req_id = 5f0db191-cb43-4750-93cc-30a7a7af0a04 response_code = 200 uri = /vpc-routes
22412025-03-01T01:19:53.570ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
22422025-03-01T01:19:53.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62992 req_id = 0487a2fd-8b2d-4c26-b66b-a1142f4bc5e8 response_code = 204 uri = /eip-gateways
22432025-03-01T01:19:53.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49700
22442025-03-01T01:19:53.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49700 req_id = 0ef9d13a-9a4d-48d5-aaec-a1db278bcc6b response_code = 200 uri = /v2p
22452025-03-01T01:19:53.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62992 req_id = b1c3e627-efb7-4c50-b99b-1849bc71d32a response_code = 204 uri = /vpc-routes
22462025-03-01T01:19:53.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54410
22472025-03-01T01:19:53.612ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22482025-03-01T01:19:53.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22492025-03-01T01:19:53.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54410 req_id = f4d5c6a2-9299-4d36-801a-1d79e528fb13 response_code = 204 uri = /switch-ports
22502025-03-01T01:19:53.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36478
22512025-03-01T01:19:53.749ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
22522025-03-01T01:19:53.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38398 req_id = de1654cf-93c1-40c2-99db-a1aa80d906bf response_code = 204 uri = /eip-gateways
22532025-03-01T01:19:53.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54410 req_id = d89a5821-e99e-41a3-a746-d52336ccd501 response_code = 200 uri = /network-bootstore-config
22542025-03-01T01:19:53.750ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22552025-03-01T01:19:53.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 430 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36478 req_id = c740c081-17bc-418d-a573-65e18afd0421 response_code = 200 uri = /artifacts
22562025-03-01T01:19:53.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38398 req_id = e908aad8-4a9d-4fdb-9269-52b0f95e2519 response_code = 204 uri = /vpc-routes
22572025-03-01T01:19:53.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34187
22582025-03-01T01:19:53.799ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22592025-03-01T01:19:53.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22602025-03-01T01:19:53.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22612025-03-01T01:19:53.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22622025-03-01T01:19:53.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22632025-03-01T01:19:53.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22642025-03-01T01:19:53.800ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22652025-03-01T01:19:53.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34187 req_id = 23f8605c-4d0f-45d2-b2b2-d8add294ea5c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22662025-03-01T01:19:53.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35124
22672025-03-01T01:19:53.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35124 req_id = 2e2fcb57-f4f3-4f79-80f9-cae45757e6dd response_code = 200 uri = /v2p
22682025-03-01T01:19:53.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46646
22692025-03-01T01:19:53.845ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22702025-03-01T01:19:53.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22712025-03-01T01:19:53.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97223 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46646 req_id = e2fc20e1-8ed8-46d2-9445-e18b8a5effde response_code = 204 uri = /switch-ports
22722025-03-01T01:19:53.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33793
22732025-03-01T01:19:53.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55086
22742025-03-01T01:19:53.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64758
22752025-03-01T01:19:53.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40662
22762025-03-01T01:19:53.943ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22772025-03-01T01:19:53.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33793 req_id = b06d16f7-7fed-413f-8f37-2ed6882e70cb response_code = 200 uri = /vpc-routes
22782025-03-01T01:19:53.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64758 req_id = d09a6b43-7183-4e16-ab86-07b0974234ed response_code = 200 uri = /v2p
22792025-03-01T01:19:53.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 421 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46646 req_id = 704996bd-71fe-4e92-ae68-bec84c28a258 response_code = 200 uri = /network-bootstore-config
22802025-03-01T01:19:53.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40662 req_id = 550d184c-4556-44f1-ac5b-c4084aa47093 response_code = 200 uri = /artifacts
22812025-03-01T01:19:53.943ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22822025-03-01T01:19:53.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22832025-03-01T01:19:53.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22842025-03-01T01:19:53.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22852025-03-01T01:19:53.943ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22862025-03-01T01:19:53.944ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22872025-03-01T01:19:53.944ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22882025-03-01T01:19:53.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 599 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55086 req_id = a1aec6cf-b200-4bba-9ea8-7d7359eeebc3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22892025-03-01T01:19:53.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32894
22902025-03-01T01:19:53.964ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
22912025-03-01T01:19:53.964ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22922025-03-01T01:19:53.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33793 req_id = 13c456ff-e868-4f2d-a6fe-7c22ba62f733 response_code = 204 uri = /eip-gateways
22932025-03-01T01:19:53.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33793 req_id = dcee92aa-49f2-4389-8385-1cde33fd471e response_code = 204 uri = /vpc-routes
22942025-03-01T01:19:54.007ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22952025-03-01T01:19:54.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32894 req_id = a01c66bf-bcde-439c-96ff-0de33234aecf response_code = 204 uri = /switch-ports
22962025-03-01T01:19:54.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32894 req_id = d5796aa5-4092-4637-9f60-a99a35471ddb response_code = 200 uri = /network-bootstore-config
22972025-03-01T01:19:54.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36411
22982025-03-01T01:19:54.090ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22992025-03-01T01:19:54.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23002025-03-01T01:19:54.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23012025-03-01T01:19:54.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23022025-03-01T01:19:54.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23032025-03-01T01:19:54.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23042025-03-01T01:19:54.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23052025-03-01T01:19:54.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36411 req_id = 7f27313d-e497-4a74-a116-c02c3834f643 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23062025-03-01T01:20:12.437ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47618
23072025-03-01T01:20:12.437ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47618 req_id = b731c06b-a3bc-4a8c-8fa2-e68dc7165a79 response_code = 200 uri = /baseboard
23082025-03-01T01:20:22.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6407 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 9370ba2d-54d1-4750-a447-fab05d531216 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
23092025-03-01T01:20:23.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40260
23102025-03-01T01:20:23.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40260 req_id = 848a70ba-870d-467c-a1aa-9d06bd6b5eb6 response_code = 200 uri = /vpc-routes
23112025-03-01T01:20:23.273ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
23122025-03-01T01:20:23.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40260 req_id = 73cd9514-794a-4a2a-be3b-63d9778dc592 response_code = 204 uri = /eip-gateways
23132025-03-01T01:20:23.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40260 req_id = 8263a5c0-2a7b-44ca-b7d9-9e546f5026ef response_code = 204 uri = /vpc-routes
23142025-03-01T01:20:23.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41050
23152025-03-01T01:20:23.327ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23162025-03-01T01:20:23.373ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23172025-03-01T01:20:23.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41050 req_id = 4a196c6c-1e3d-4b01-a190-5663238c6cf6 response_code = 204 uri = /switch-ports
23182025-03-01T01:20:23.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33288
23192025-03-01T01:20:23.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33288 req_id = 1f9fb875-bb58-41cf-a94a-b05b89ba2844 response_code = 200 uri = /vpc-routes
23202025-03-01T01:20:23.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41050 req_id = 2f3f5c20-dc34-43a2-adfb-104882ba22e2 response_code = 200 uri = /network-bootstore-config
23212025-03-01T01:20:23.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36127
23222025-03-01T01:20:23.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36127 req_id = 8d672a40-e3e6-4866-a264-ba9b4799e22b response_code = 200 uri = /v2p
23232025-03-01T01:20:23.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
23242025-03-01T01:20:23.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33288 req_id = 99161905-a9f0-4d36-9074-2668754294ba response_code = 204 uri = /eip-gateways
23252025-03-01T01:20:23.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33288 req_id = 42048e6c-269a-4086-9dc5-1133859e1e06 response_code = 204 uri = /vpc-routes
23262025-03-01T01:20:23.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51821
23272025-03-01T01:20:23.533ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23282025-03-01T01:20:23.575ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23292025-03-01T01:20:23.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51821 req_id = 21701e31-eb2c-44b7-8928-75f453eacb84 response_code = 204 uri = /switch-ports
23302025-03-01T01:20:23.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52993
23312025-03-01T01:20:23.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46044
23322025-03-01T01:20:23.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46044 req_id = cf6f182a-ea51-46c7-9660-d1d26bc54c45 response_code = 200 uri = /v2p
23332025-03-01T01:20:23.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51821 req_id = b7502c45-a2b4-4bbc-a949-8030fda33e34 response_code = 200 uri = /network-bootstore-config
23342025-03-01T01:20:23.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52993 req_id = d5d6e30d-26ac-476a-8f6f-9285b7e69447 response_code = 200 uri = /vpc-routes
23352025-03-01T01:20:23.679ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
23362025-03-01T01:20:23.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52993 req_id = 5285be1d-1d89-4737-91bb-3c54bbf5ac25 response_code = 204 uri = /eip-gateways
23372025-03-01T01:20:23.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34254
23382025-03-01T01:20:23.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34254 req_id = 29f00da4-54a7-485c-9082-ec2a178d3379 response_code = 200 uri = /v2p
23392025-03-01T01:20:23.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52993 req_id = b74a8e08-d901-4aa1-9af4-45636e357e87 response_code = 204 uri = /vpc-routes
23402025-03-01T01:20:23.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52691
23412025-03-01T01:20:23.735ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23422025-03-01T01:20:23.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23432025-03-01T01:20:23.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94313 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52691 req_id = c03625a7-3e7d-4f97-8626-0cb84ca3040e response_code = 204 uri = /switch-ports
23442025-03-01T01:20:23.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52691 req_id = edbd8c0c-6404-406f-aade-fcc565b66b1c response_code = 200 uri = /network-bootstore-config
23452025-03-01T01:20:42.469ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62538
23462025-03-01T01:20:42.469ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62538 req_id = 4a671db1-46d8-462b-b053-035d9be8894f response_code = 200 uri = /baseboard
23472025-03-01T01:20:52.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7860 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 04b343c5-97cb-4bac-93bd-d08dd750345d response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
23482025-03-01T01:20:53.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54707
23492025-03-01T01:20:53.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54707 req_id = 55dd3068-e862-4950-8338-46e564c49fbc response_code = 200 uri = /vpc-routes
23502025-03-01T01:20:53.539ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
23512025-03-01T01:20:53.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54707 req_id = f7bc6615-3e8d-4e5b-94c4-7966d634e16e response_code = 204 uri = /eip-gateways
23522025-03-01T01:20:53.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54707 req_id = 1bbc1318-611e-469b-8b79-9e26924866f2 response_code = 204 uri = /vpc-routes
23532025-03-01T01:20:53.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53671
23542025-03-01T01:20:53.572ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23552025-03-01T01:20:53.623ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23562025-03-01T01:20:53.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53671 req_id = 8d7f4ad8-fb94-4966-b695-1da755a50345 response_code = 204 uri = /switch-ports
23572025-03-01T01:20:53.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41887
23582025-03-01T01:20:53.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43438
23592025-03-01T01:20:53.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44014
23602025-03-01T01:20:53.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44014 req_id = 7ad0b571-6d21-4522-b9dc-3363c474a9b2 response_code = 200 uri = /vpc-routes
23612025-03-01T01:20:53.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53671 req_id = d87ce64c-7097-4e35-93d5-fd37f00ab386 response_code = 200 uri = /network-bootstore-config
23622025-03-01T01:20:53.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41887 req_id = bf9cb328-bb1a-441b-ac3a-ebee8c0285e3 response_code = 200 uri = /vpc-routes
23632025-03-01T01:20:53.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5615 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43438 req_id = 9280f526-2538-481e-a5e7-131e4c736ba9 response_code = 200 uri = /v2p
23642025-03-01T01:20:53.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46002
23652025-03-01T01:20:53.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46002 req_id = 1cd7dea1-adb9-4fb7-b245-3d024f2dc58d response_code = 200 uri = /v2p
23662025-03-01T01:20:53.769ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
23672025-03-01T01:20:53.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44014 req_id = dbeb159f-f421-4462-816a-a175b83172b1 response_code = 204 uri = /eip-gateways
23682025-03-01T01:20:53.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44014 req_id = 732923d6-cb8e-4496-8a95-6ce6031b7b58 response_code = 204 uri = /vpc-routes
23692025-03-01T01:20:53.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33813
23702025-03-01T01:20:53.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33813 req_id = 80fe476c-8f88-4cb5-b7fb-23f0bddfa321 response_code = 200 uri = /v2p
23712025-03-01T01:20:53.839ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
23722025-03-01T01:20:53.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41887 req_id = 8d44f15b-a15b-4f0d-a2aa-43ab24d88607 response_code = 204 uri = /eip-gateways
23732025-03-01T01:20:53.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41887 req_id = 5256b882-6e93-459f-95ad-30a96f780c44 response_code = 204 uri = /vpc-routes
23742025-03-01T01:20:53.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62426
23752025-03-01T01:20:53.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23762025-03-01T01:20:53.892ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23772025-03-01T01:20:53.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91224 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62426 req_id = 88faed9b-08bf-43c0-9a65-fe9f9727276e response_code = 204 uri = /switch-ports
23782025-03-01T01:20:53.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43052
23792025-03-01T01:20:53.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23802025-03-01T01:20:53.981ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23812025-03-01T01:20:54.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43052 req_id = 27c0eb71-c50d-4bd5-8389-4333025c513c response_code = 204 uri = /switch-ports
23822025-03-01T01:20:54.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62426 req_id = e1104cc0-b6e9-498d-9d13-3bd151f8711b response_code = 200 uri = /network-bootstore-config
23832025-03-01T01:20:54.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43052 req_id = bcdec0ec-2482-42fc-93c1-99dc3badbcd7 response_code = 200 uri = /network-bootstore-config
23842025-03-01T01:21:12.502ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59826
23852025-03-01T01:21:12.503ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59826 req_id = 3ffccfec-3d37-4624-82df-7cab0fda10f5 response_code = 200 uri = /baseboard
23862025-03-01T01:21:22.421ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6445 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 4114543f-9ae5-4f2c-8afe-4f15807a91b5 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
23872025-03-01T01:21:23.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41353
23882025-03-01T01:21:23.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41353 req_id = 3e602a59-9eae-4c84-af39-0ac754f6d455 response_code = 200 uri = /vpc-routes
23892025-03-01T01:21:23.222ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
23902025-03-01T01:21:23.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41353 req_id = 9d1feb2e-9861-4518-929e-0f67df2d8669 response_code = 204 uri = /eip-gateways
23912025-03-01T01:21:23.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51394
23922025-03-01T01:21:23.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51394 req_id = c6cacde1-ab2a-4b8e-bf3f-f41f2dc1244b response_code = 200 uri = /v2p
23932025-03-01T01:21:23.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41353 req_id = 3edddbe2-079d-4d80-8e4b-f105f4f9b6fe response_code = 204 uri = /vpc-routes
23942025-03-01T01:21:23.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54079
23952025-03-01T01:21:23.261ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23962025-03-01T01:21:23.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23972025-03-01T01:21:23.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125834 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54079 req_id = 9cd04d13-0938-416b-a063-cc5990dde2ad response_code = 204 uri = /switch-ports
23982025-03-01T01:21:23.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54079 req_id = d8254df9-e0c0-422d-ac55-38d804cfb276 response_code = 200 uri = /network-bootstore-config
23992025-03-01T01:21:23.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64951
24002025-03-01T01:21:23.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64951 req_id = 217d4b9d-a696-47c2-af23-ecc2811fb61c response_code = 200 uri = /vpc-routes
24012025-03-01T01:21:23.429ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
24022025-03-01T01:21:23.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64951 req_id = d68f97d6-f878-4850-848b-931caa6364f3 response_code = 204 uri = /eip-gateways
24032025-03-01T01:21:23.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64951 req_id = 62f48fb9-c55e-4973-82e0-a5ff49e6da37 response_code = 204 uri = /vpc-routes
24042025-03-01T01:21:23.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50937
24052025-03-01T01:21:23.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50937 req_id = 959f9cc0-b2fa-472a-93c5-69c2b0e9877e response_code = 200 uri = /v2p
24062025-03-01T01:21:23.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46703
24072025-03-01T01:21:23.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46703 req_id = cf3ceb6c-3752-40a8-9611-dd2218cf93f9 response_code = 200 uri = /vpc-routes
24082025-03-01T01:21:23.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34150
24092025-03-01T01:21:23.542ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24102025-03-01T01:21:23.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24112025-03-01T01:21:23.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105285 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34150 req_id = cde2b9c8-9375-421c-8f7c-0f1feccbd509 response_code = 204 uri = /switch-ports
24122025-03-01T01:21:23.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41331
24132025-03-01T01:21:23.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
24142025-03-01T01:21:23.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46703 req_id = b4c9c48d-5882-40c9-ae53-cb11ef45a79b response_code = 204 uri = /eip-gateways
24152025-03-01T01:21:23.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34150 req_id = c3141eac-6c8a-43c6-9b0a-094c450b99e2 response_code = 200 uri = /network-bootstore-config
24162025-03-01T01:21:23.648ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24172025-03-01T01:21:23.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46703 req_id = f9beaf71-8b2c-4cef-a9b7-66f115cef84b response_code = 204 uri = /vpc-routes
24182025-03-01T01:21:23.685ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24192025-03-01T01:21:23.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60577
24202025-03-01T01:21:23.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60577 req_id = a1cbece8-365c-4a79-b6f5-3f3d656b8057 response_code = 200 uri = /v2p
24212025-03-01T01:21:23.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41331 req_id = cb72904c-018c-46a5-b9de-7a0208b59438 response_code = 204 uri = /switch-ports
24222025-03-01T01:21:23.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41331 req_id = 3ea68233-92c5-43af-82d8-4e1ce9b2b8c5 response_code = 200 uri = /network-bootstore-config
24232025-03-01T01:21:42.536ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58863
24242025-03-01T01:21:42.536ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58863 req_id = e0e41edd-4f19-4b12-bbf5-35b26b59dd8a response_code = 200 uri = /baseboard
24252025-03-01T01:21:52.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7736 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = b797c0df-b5c4-42c7-b990-ca1d113ad575 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
24262025-03-01T01:21:53.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61520
24272025-03-01T01:21:53.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61520 req_id = 956ee320-fc3e-4d45-b51d-0f3871a18e73 response_code = 200 uri = /vpc-routes
24282025-03-01T01:21:53.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
24292025-03-01T01:21:53.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61520 req_id = f91b1016-5c1c-4a1b-a478-1c9952b3a6c9 response_code = 204 uri = /eip-gateways
24302025-03-01T01:21:53.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61520 req_id = acf2fbb3-1c59-4945-ad1e-a88c4cf6cffe response_code = 204 uri = /vpc-routes
24312025-03-01T01:21:53.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36826
24322025-03-01T01:21:53.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36826 req_id = d05df328-0fee-41eb-b2da-603c86c43274 response_code = 200 uri = /v2p
24332025-03-01T01:21:53.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37590
24342025-03-01T01:21:53.579ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24352025-03-01T01:21:53.621ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24362025-03-01T01:21:53.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98407 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37590 req_id = 30aec346-2dbb-4625-8bc8-ae09c20bc11c response_code = 204 uri = /switch-ports
24372025-03-01T01:21:53.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37590 req_id = 673272e8-446e-47fe-8654-1d7f3c84f621 response_code = 200 uri = /network-bootstore-config
24382025-03-01T01:21:53.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36895
24392025-03-01T01:21:53.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36895 req_id = 875625fc-19e5-4f9c-8689-95371aeadf80 response_code = 200 uri = /vpc-routes
24402025-03-01T01:21:53.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57251
24412025-03-01T01:21:53.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57251 req_id = e8d2d831-6c56-430f-a007-229602ece2b2 response_code = 200 uri = /vpc-routes
24422025-03-01T01:21:53.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42155
24432025-03-01T01:21:53.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42155 req_id = e72df4bb-009a-48b5-970e-81e33db80f2d response_code = 200 uri = /v2p
24442025-03-01T01:21:53.742ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
24452025-03-01T01:21:53.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36895 req_id = d6c590c5-6762-48fb-8125-ca7905c2edcb response_code = 204 uri = /eip-gateways
24462025-03-01T01:21:53.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36895 req_id = 0204ca02-34b8-4376-b971-37e588b02b78 response_code = 204 uri = /vpc-routes
24472025-03-01T01:21:53.761ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
24482025-03-01T01:21:53.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57251 req_id = 1c2baf4c-563c-42fa-b887-ec86e7be9c46 response_code = 204 uri = /eip-gateways
24492025-03-01T01:21:53.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57251 req_id = 45ccc4dd-cf47-40da-80f1-97a9fff33b26 response_code = 204 uri = /vpc-routes
24502025-03-01T01:21:53.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57353
24512025-03-01T01:21:53.863ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24522025-03-01T01:21:53.901ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24532025-03-01T01:21:53.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57353 req_id = 67cfaab1-30b4-495e-be64-20e5e0854922 response_code = 204 uri = /switch-ports
24542025-03-01T01:21:53.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34555
24552025-03-01T01:21:53.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37901
24562025-03-01T01:21:53.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57353 req_id = acf4481b-e714-44d5-bba8-00fb2275bd8f response_code = 200 uri = /network-bootstore-config
24572025-03-01T01:21:53.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34555 req_id = 71f77e82-ae5e-47d7-9746-c169589005dc response_code = 200 uri = /v2p
24582025-03-01T01:21:53.962ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24592025-03-01T01:21:54.001ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24602025-03-01T01:21:54.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95759 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37901 req_id = 1ea6c7eb-885e-4740-937b-e13e49852b26 response_code = 204 uri = /switch-ports
24612025-03-01T01:21:54.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37901 req_id = f583c0dd-1ada-4744-9323-8e9ee80fdcbc response_code = 200 uri = /network-bootstore-config
24622025-03-01T01:22:06.267ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24632025-03-01T01:22:06.268ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24642025-03-01T01:22:06.302ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1936, tv_nsec: 990070122 } time_to_next_cleanup = 599.99999823s
24652025-03-01T01:22:12.567ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48724
24662025-03-01T01:22:12.567ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48724 req_id = 4b4509b8-45a0-4938-888f-fe7b6ae8e69c response_code = 200 uri = /baseboard
24672025-03-01T01:22:20.592ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24682025-03-01T01:22:22.422ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7166 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 226165d8-0986-4c04-b419-1bee32216079 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
24692025-03-01T01:22:23.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62360
24702025-03-01T01:22:23.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62360 req_id = d5dad630-71eb-486c-951b-6bda7c77fd13 response_code = 200 uri = /vpc-routes
24712025-03-01T01:22:23.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
24722025-03-01T01:22:23.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62360 req_id = e7b52721-efc0-4e1a-aabd-dc77e3011910 response_code = 204 uri = /eip-gateways
24732025-03-01T01:22:23.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62360 req_id = dcfbecbc-45a0-4ab9-bb0d-9cbeb96f6aaf response_code = 204 uri = /vpc-routes
24742025-03-01T01:22:23.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59522
24752025-03-01T01:22:23.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59522 req_id = 6eb8707a-4ccb-42df-8b8a-051a199a1b1e response_code = 200 uri = /v2p
24762025-03-01T01:22:23.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62496
24772025-03-01T01:22:23.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24782025-03-01T01:22:23.241ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24792025-03-01T01:22:23.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116465 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62496 req_id = 6733cd53-3ed2-48b9-aad3-9e7a33a4a862 response_code = 204 uri = /switch-ports
24802025-03-01T01:22:23.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62496 req_id = 278a459b-8cb4-4c73-9271-f7f04b26c650 response_code = 200 uri = /network-bootstore-config
24812025-03-01T01:22:23.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37539
24822025-03-01T01:22:23.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37539 req_id = 565e4ff0-e768-4288-9d87-a01488dd21e1 response_code = 200 uri = /vpc-routes
24832025-03-01T01:22:23.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
24842025-03-01T01:22:23.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37539 req_id = 65319c7e-d6a8-4e43-969a-d573e7208a91 response_code = 204 uri = /eip-gateways
24852025-03-01T01:22:23.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37539 req_id = aed07dc2-4fc7-4d03-ae14-9cd021305728 response_code = 204 uri = /vpc-routes
24862025-03-01T01:22:23.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59444
24872025-03-01T01:22:23.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59444 req_id = 197e1a4d-89ad-4c40-a3b6-64f4e23a5774 response_code = 200 uri = /v2p
24882025-03-01T01:22:23.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37681
24892025-03-01T01:22:23.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37681 req_id = cf5519a2-aedd-4a0d-8bb9-1e431ad23e99 response_code = 200 uri = /v2p
24902025-03-01T01:22:23.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42121
24912025-03-01T01:22:23.572ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24922025-03-01T01:22:23.613ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24932025-03-01T01:22:23.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42121 req_id = b5b01949-b59d-4dbc-a940-5b32b0a2c3f3 response_code = 204 uri = /switch-ports
24942025-03-01T01:22:23.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50397
24952025-03-01T01:22:23.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50397 req_id = 432b2662-7bae-48be-a4f9-3434db4aa42e response_code = 200 uri = /vpc-routes
24962025-03-01T01:22:23.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42121 req_id = 7e3003e0-bd93-48c5-9742-4f7f319afefe response_code = 200 uri = /network-bootstore-config
24972025-03-01T01:22:23.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38192
24982025-03-01T01:22:23.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24992025-03-01T01:22:23.735ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25002025-03-01T01:22:23.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95437 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38192 req_id = ef529e9a-ac85-4bc0-b141-0a65e9f69e40 response_code = 204 uri = /switch-ports
25012025-03-01T01:22:23.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
25022025-03-01T01:22:23.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50397 req_id = 716c930a-29d7-42b6-a7cb-e85f81dfe57f response_code = 204 uri = /eip-gateways
25032025-03-01T01:22:23.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38192 req_id = 37c30e16-f98d-4f61-bfda-8d41322e550c response_code = 200 uri = /network-bootstore-config
25042025-03-01T01:22:23.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50397 req_id = 56f93da5-d393-4453-a0c3-89277508eefa response_code = 204 uri = /vpc-routes
25052025-03-01T01:22:42.601ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43665
25062025-03-01T01:22:42.601ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43665 req_id = ce98b88e-53e5-4019-a1f2-c209013aa334 response_code = 200 uri = /baseboard
25072025-03-01T01:22:52.425ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7263 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = c0d967a7-3d1b-468c-b247-c384ba3f741e response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
25082025-03-01T01:22:53.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47303
25092025-03-01T01:22:53.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47303 req_id = c2772ccd-966c-4a8f-b01b-9907afe1302a response_code = 200 uri = /v2p
25102025-03-01T01:22:53.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65219
25112025-03-01T01:22:53.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65219 req_id = 446815c9-1235-4c08-869f-7edc3628ed3c response_code = 200 uri = /vpc-routes
25122025-03-01T01:22:53.489ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
25132025-03-01T01:22:53.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65219 req_id = 01be114c-907c-4b46-8136-6191829e1485 response_code = 204 uri = /eip-gateways
25142025-03-01T01:22:53.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65219 req_id = cf8c2671-1bf1-49c3-9cd5-e8846d0c701d response_code = 204 uri = /vpc-routes
25152025-03-01T01:22:53.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38064
25162025-03-01T01:22:53.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38064 req_id = 082d2e40-2e71-4ac3-b7a0-d66b38dd50b1 response_code = 200 uri = /vpc-routes
25172025-03-01T01:22:53.592ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
25182025-03-01T01:22:53.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38064 req_id = fec5e1ae-036c-4544-b604-6647b9600419 response_code = 204 uri = /eip-gateways
25192025-03-01T01:22:53.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38064 req_id = 7c5199e4-71a1-47bc-9171-cb564f3cd9c3 response_code = 204 uri = /vpc-routes
25202025-03-01T01:22:53.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39491
25212025-03-01T01:22:53.626ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25222025-03-01T01:22:53.668ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25232025-03-01T01:22:53.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39491 req_id = 36b4914e-267d-4eab-9617-e6ac3a13f31f response_code = 204 uri = /switch-ports
25242025-03-01T01:22:53.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41014
25252025-03-01T01:22:53.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65223
25262025-03-01T01:22:53.733ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25272025-03-01T01:22:53.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41014 req_id = 9c17e8e0-5b1a-42c2-809a-d901c7d82d47 response_code = 200 uri = /vpc-routes
25282025-03-01T01:22:53.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4450 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39491 req_id = 03fda32b-689a-4cd1-b4e3-7cef2c5168d7 response_code = 200 uri = /network-bootstore-config
25292025-03-01T01:22:53.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25302025-03-01T01:22:53.787ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
25312025-03-01T01:22:53.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41014 req_id = 32f5d8de-55e1-4ed6-94f4-1fbb468f1cdf response_code = 204 uri = /eip-gateways
25322025-03-01T01:22:53.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42154
25332025-03-01T01:22:53.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42154 req_id = 0e6bb529-bf74-4dea-968a-5b798ce0af3e response_code = 200 uri = /v2p
25342025-03-01T01:22:53.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102182 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65223 req_id = d815f1bb-dbdc-434b-954b-65067cfabc2c response_code = 204 uri = /switch-ports
25352025-03-01T01:22:53.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65223 req_id = 186cc526-0ef7-42d5-b056-0bf1b6c61e5e response_code = 200 uri = /network-bootstore-config
25362025-03-01T01:22:53.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35803
25372025-03-01T01:22:53.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35803 req_id = 1c685975-5a62-4586-bdeb-d304d32e6d0d response_code = 200 uri = /v2p
25382025-03-01T01:22:53.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41014 req_id = ad0df69e-6cfd-4601-8c38-da79b05c0159 response_code = 204 uri = /vpc-routes
25392025-03-01T01:22:53.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34009
25402025-03-01T01:22:53.930ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25412025-03-01T01:22:53.968ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25422025-03-01T01:22:54.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34009 req_id = 5726436d-21dc-4685-9cd0-6cfa5d5d9b08 response_code = 204 uri = /switch-ports
25432025-03-01T01:22:54.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34009 req_id = 0e862998-045f-4c8f-8937-52194098c829 response_code = 200 uri = /network-bootstore-config
25442025-03-01T01:23:12.634ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49767
25452025-03-01T01:23:12.634ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49767 req_id = 09e41b61-9757-4cd4-a48e-f2d102a48702 response_code = 200 uri = /baseboard
25462025-03-01T01:23:22.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7354 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = c166e4be-5e1b-4bf7-be8c-34cb772a81ee response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
25472025-03-01T01:23:23.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34320
25482025-03-01T01:23:23.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34320 req_id = e074a484-3d34-43fc-bbd5-a17fc42677fd response_code = 200 uri = /v2p
25492025-03-01T01:23:23.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45693
25502025-03-01T01:23:23.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45693 req_id = 91dcb301-9443-467b-b2e2-39e3c84b1ecb response_code = 200 uri = /vpc-routes
25512025-03-01T01:23:23.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
25522025-03-01T01:23:23.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45693 req_id = 4e41e807-102b-4a1a-8e7e-7ad89951289b response_code = 204 uri = /eip-gateways
25532025-03-01T01:23:23.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45693 req_id = 39e03e88-8131-49e7-acc3-e76f308b881b response_code = 204 uri = /vpc-routes
25542025-03-01T01:23:23.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49876
25552025-03-01T01:23:23.393ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25562025-03-01T01:23:23.446ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25572025-03-01T01:23:23.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49876 req_id = 6e3f5790-05ea-42b8-a5cb-f496ff8f2e71 response_code = 204 uri = /switch-ports
25582025-03-01T01:23:23.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54500
25592025-03-01T01:23:23.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52040
25602025-03-01T01:23:23.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49876 req_id = 6b3604fb-c0ea-490b-b4f1-b5e0f37b40a5 response_code = 200 uri = /network-bootstore-config
25612025-03-01T01:23:23.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54500 req_id = 5aec896c-be69-488d-8a8c-1d4ce03b19e0 response_code = 200 uri = /vpc-routes
25622025-03-01T01:23:23.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52040 req_id = 59194b29-4f27-4890-91b0-8f2b467e1a56 response_code = 200 uri = /v2p
25632025-03-01T01:23:23.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59787
25642025-03-01T01:23:23.530ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25652025-03-01T01:23:23.568ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25662025-03-01T01:23:23.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59787 req_id = f443c2fa-935e-49f2-9fc1-e2cd888935f5 response_code = 204 uri = /switch-ports
25672025-03-01T01:23:23.624ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
25682025-03-01T01:23:23.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54500 req_id = 657b9d34-6327-492e-8ca4-e3fd669a6ee4 response_code = 204 uri = /eip-gateways
25692025-03-01T01:23:23.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59787 req_id = 8674676f-33d3-47e7-91f5-8a661472c485 response_code = 200 uri = /network-bootstore-config
25702025-03-01T01:23:23.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43106
25712025-03-01T01:23:23.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43106 req_id = 3e55f8f5-f798-4b69-9804-91f7edff6827 response_code = 200 uri = /vpc-routes
25722025-03-01T01:23:23.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54500 req_id = 3440cb63-8d1e-4f6d-947e-b586cceb4aa0 response_code = 204 uri = /vpc-routes
25732025-03-01T01:23:23.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45467
25742025-03-01T01:23:23.681ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25752025-03-01T01:23:23.719ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25762025-03-01T01:23:23.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45467 req_id = be5f6772-08fe-412d-be31-c777683bba99 response_code = 204 uri = /switch-ports
25772025-03-01T01:23:23.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42999
25782025-03-01T01:23:23.779ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
25792025-03-01T01:23:23.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43106 req_id = caa9b593-3e37-4019-8353-73176de42ffc response_code = 204 uri = /eip-gateways
25802025-03-01T01:23:23.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45467 req_id = f29e59c3-220c-4dae-ba7c-28a0d5f7f76f response_code = 200 uri = /network-bootstore-config
25812025-03-01T01:23:23.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42999 req_id = 39f3ccbf-4ee6-4f83-9451-e93cc6205631 response_code = 200 uri = /v2p
25822025-03-01T01:23:23.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43106 req_id = 947434eb-1fb8-425e-8b73-6598eb91b5bb response_code = 204 uri = /vpc-routes
25832025-03-01T01:23:42.668ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59507
25842025-03-01T01:23:42.668ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59507 req_id = 8ffb8c61-d18c-4353-9758-e6aaca449d07 response_code = 200 uri = /baseboard
25852025-03-01T01:23:52.424ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8467 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = cc66bbc0-bd63-4306-b94b-dc7e20c52222 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
25862025-03-01T01:23:53.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52664
25872025-03-01T01:23:53.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52664 req_id = 6773c6ee-2198-4446-ac96-b3fb0614f12c response_code = 200 uri = /vpc-routes
25882025-03-01T01:23:53.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
25892025-03-01T01:23:53.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52664 req_id = 0922840a-82dd-48de-90df-c93dd0e6fdff response_code = 204 uri = /eip-gateways
25902025-03-01T01:23:53.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52664 req_id = 2ed5108d-8662-4a8a-a65f-fc22ba10ddc2 response_code = 204 uri = /vpc-routes
25912025-03-01T01:23:53.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47094
25922025-03-01T01:23:53.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47094 req_id = b6bdce5e-e161-4f4c-b556-cd85200af454 response_code = 200 uri = /v2p
25932025-03-01T01:23:53.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50105
25942025-03-01T01:23:53.526ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25952025-03-01T01:23:53.565ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25962025-03-01T01:23:53.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50105 req_id = 035b295e-64da-4bd5-bd69-53f24bcc96e7 response_code = 204 uri = /switch-ports
25972025-03-01T01:23:53.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36011
25982025-03-01T01:23:53.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48586
25992025-03-01T01:23:53.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37950
26002025-03-01T01:23:53.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50105 req_id = a466b8cc-81b3-4cfc-bad2-2617566fd5b9 response_code = 200 uri = /network-bootstore-config
26012025-03-01T01:23:53.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37950 req_id = 328cb65f-db71-44e4-873d-919059460c9f response_code = 200 uri = /vpc-routes
26022025-03-01T01:23:53.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36011 req_id = f61113ca-0e28-47bb-b2b5-30e22ef17a07 response_code = 200 uri = /vpc-routes
26032025-03-01T01:23:53.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48586 req_id = 3e04f2d0-9503-48ba-8262-86600ef795c5 response_code = 200 uri = /v2p
26042025-03-01T01:23:53.694ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
26052025-03-01T01:23:53.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37950 req_id = de5f70fd-265c-4b9f-a0e5-72e09381d42d response_code = 204 uri = /eip-gateways
26062025-03-01T01:23:53.696ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
26072025-03-01T01:23:53.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36011 req_id = 7fa8dd69-a200-453e-a082-6f5babc1cdfe response_code = 204 uri = /eip-gateways
26082025-03-01T01:23:53.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37950 req_id = fe41c905-a118-4dca-bd2d-8a76b421e916 response_code = 204 uri = /vpc-routes
26092025-03-01T01:23:53.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36011 req_id = 0e728ed0-2ee3-4917-a097-19fa769de246 response_code = 204 uri = /vpc-routes
26102025-03-01T01:23:53.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55741
26112025-03-01T01:23:53.721ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26122025-03-01T01:23:53.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26132025-03-01T01:23:53.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96315 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55741 req_id = d777e1ad-3208-4a80-9d1d-44b238bafc9a response_code = 204 uri = /switch-ports
26142025-03-01T01:23:53.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55741 req_id = 0f9d7877-2fe2-44de-af34-080c2c3d358e response_code = 200 uri = /network-bootstore-config
26152025-03-01T01:23:53.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56060
26162025-03-01T01:23:53.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56060 req_id = a9a4e485-029f-4167-99a9-ea6055220d65 response_code = 200 uri = /v2p
26172025-03-01T01:23:53.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54887
26182025-03-01T01:23:53.885ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26192025-03-01T01:23:53.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26202025-03-01T01:23:53.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81202 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54887 req_id = 40f1df3a-3ca2-43ac-a726-00179b0b7ed8 response_code = 204 uri = /switch-ports
26212025-03-01T01:23:53.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54887 req_id = 985f03f2-5bb1-45ad-8815-87321fadd29a response_code = 200 uri = /network-bootstore-config
26222025-03-01T01:24:12.700ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44945
26232025-03-01T01:24:12.700ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44945 req_id = 499c9cc0-01dc-4f10-8ff3-284e917332e2 response_code = 200 uri = /baseboard
26242025-03-01T01:24:22.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8824 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 5070415d-6bcc-48bb-b4c4-b5ba7aa93262 response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
26252025-03-01T01:24:23.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56426
26262025-03-01T01:24:23.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56426 req_id = 12ef8c4e-30bb-43c3-9466-0937c35dec52 response_code = 200 uri = /v2p
26272025-03-01T01:24:23.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63276
26282025-03-01T01:24:23.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63276 req_id = d751ee5a-6fbd-40e3-84b0-d5aa8ec36018 response_code = 200 uri = /vpc-routes
26292025-03-01T01:24:23.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
26302025-03-01T01:24:23.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63276 req_id = 3956cdbe-1fb1-4d8f-89f8-4dce9f55bb6a response_code = 204 uri = /eip-gateways
26312025-03-01T01:24:23.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63276 req_id = 29d1aee9-40c8-466b-961a-cb3072fa10e7 response_code = 204 uri = /vpc-routes
26322025-03-01T01:24:23.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58425
26332025-03-01T01:24:23.363ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26342025-03-01T01:24:23.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26352025-03-01T01:24:23.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149451 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58425 req_id = 140c2945-9dfd-4ef7-b9dc-3ffe9683501c response_code = 204 uri = /switch-ports
26362025-03-01T01:24:23.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52718
26372025-03-01T01:24:23.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52718 req_id = 8e75f074-d9ec-4525-acc0-69945913814a response_code = 200 uri = /vpc-routes
26382025-03-01T01:24:23.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58425 req_id = ca162778-de66-473b-867b-927a1a5cd01d response_code = 200 uri = /network-bootstore-config
26392025-03-01T01:24:23.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36266
26402025-03-01T01:24:23.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36266 req_id = b727682f-89f1-46eb-80b4-d2e342bbe6ce response_code = 200 uri = /vpc-routes
26412025-03-01T01:24:23.581ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
26422025-03-01T01:24:23.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52718 req_id = d7e7bed4-9993-433d-8cc4-581732b65d1f response_code = 204 uri = /eip-gateways
26432025-03-01T01:24:23.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52718 req_id = 0e62acd7-71cc-4887-98a1-ff5e28794e26 response_code = 204 uri = /vpc-routes
26442025-03-01T01:24:23.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38016
26452025-03-01T01:24:23.600ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26462025-03-01T01:24:23.653ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26472025-03-01T01:24:23.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38016 req_id = bfb355a9-f992-4177-8ad7-b5d306dd75a6 response_code = 204 uri = /switch-ports
26482025-03-01T01:24:23.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64004
26492025-03-01T01:24:23.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47442
26502025-03-01T01:24:23.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
26512025-03-01T01:24:23.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32862
26522025-03-01T01:24:23.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36266 req_id = 730cb9c3-76ad-4202-a53f-58f1f155890e response_code = 204 uri = /eip-gateways
26532025-03-01T01:24:23.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38016 req_id = 01a8a291-ad2f-41e4-b391-3e85a138d035 response_code = 200 uri = /network-bootstore-config
26542025-03-01T01:24:23.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32862 req_id = 717c6225-61fe-4789-ad69-8f74d8cddd95 response_code = 200 uri = /v2p
26552025-03-01T01:24:23.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26562025-03-01T01:24:23.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64004 req_id = b923e844-f640-46cc-8d27-4a22b43278a8 response_code = 200 uri = /v2p
26572025-03-01T01:24:23.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36266 req_id = ec7d3977-7691-4753-a661-e9fde4016c63 response_code = 204 uri = /vpc-routes
26582025-03-01T01:24:23.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26592025-03-01T01:24:23.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47442 req_id = 194d07db-36d7-4d62-a888-3414dec4b0c2 response_code = 204 uri = /switch-ports
26602025-03-01T01:24:23.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47442 req_id = 9a384734-c04c-4704-95e3-cebf4e126422 response_code = 200 uri = /network-bootstore-config
26612025-03-01T01:24:42.733ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38356
26622025-03-01T01:24:42.733ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38356 req_id = 6bd75198-8e48-4512-8aae-90292b02bc1a response_code = 200 uri = /baseboard
26632025-03-01T01:24:52.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8361 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 3f7d0a0c-b83b-4c05-8551-103537962c8f response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
26642025-03-01T01:24:53.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37287
26652025-03-01T01:24:53.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37287 req_id = 43351e48-b772-494f-9648-eb484dfbfe2c response_code = 200 uri = /vpc-routes
26662025-03-01T01:24:53.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33738
26672025-03-01T01:24:53.525ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26682025-03-01T01:24:53.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33738 req_id = 93132e00-b1b7-4d78-96a9-4a1895789361 response_code = 200 uri = /artifacts
26692025-03-01T01:24:53.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
26702025-03-01T01:24:53.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37287 req_id = 1bb9e894-01ae-4b4f-b00d-e2089015a156 response_code = 204 uri = /eip-gateways
26712025-03-01T01:24:53.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61260
26722025-03-01T01:24:53.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61260 req_id = 08d84721-6f7c-458c-925a-bc00cddbdd79 response_code = 200 uri = /v2p
26732025-03-01T01:24:53.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37287 req_id = 9568a2bd-508a-463e-8908-ff93859a2cbe response_code = 204 uri = /vpc-routes
26742025-03-01T01:24:53.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62457
26752025-03-01T01:24:53.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26762025-03-01T01:24:53.654ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26772025-03-01T01:24:53.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160920 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62457 req_id = edfd0108-0e64-45df-bf25-93287d5ff270 response_code = 204 uri = /switch-ports
26782025-03-01T01:24:53.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58674
26792025-03-01T01:24:53.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37456
26802025-03-01T01:24:53.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58243
26812025-03-01T01:24:53.762ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26822025-03-01T01:24:53.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58674 req_id = 86e86331-c6a3-43dc-bd28-45cd7e60351a response_code = 200 uri = /vpc-routes
26832025-03-01T01:24:53.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62457 req_id = 2bbef186-f574-4714-a023-af7f8bd6d4a2 response_code = 200 uri = /network-bootstore-config
26842025-03-01T01:24:53.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37456 req_id = 14aaf47e-ea19-439c-85f5-4b9b42037d7b response_code = 200 uri = /vpc-routes
26852025-03-01T01:24:53.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 658 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58243 req_id = 7137871c-cb94-43a2-908b-7524ec442b44 response_code = 200 uri = /artifacts
26862025-03-01T01:24:53.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52235
26872025-03-01T01:24:53.799ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26882025-03-01T01:24:53.847ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26892025-03-01T01:24:53.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121468 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52235 req_id = 44d01482-172e-4d26-97f8-aa9ae100411c response_code = 204 uri = /switch-ports
26902025-03-01T01:24:53.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38727
26912025-03-01T01:24:53.921ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
26922025-03-01T01:24:53.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37456 req_id = 04c0712e-a640-44e7-8750-69409593bf32 response_code = 204 uri = /eip-gateways
26932025-03-01T01:24:53.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60566
26942025-03-01T01:24:53.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41388
26952025-03-01T01:24:53.922ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
26962025-03-01T01:24:53.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58674 req_id = b7c7528e-4bc0-47af-b9d9-eb8e3b8a2290 response_code = 204 uri = /eip-gateways
26972025-03-01T01:24:53.922ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26982025-03-01T01:24:53.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52235 req_id = 8d64b0ed-e53e-4751-8b90-9d71d6284ea8 response_code = 200 uri = /network-bootstore-config
26992025-03-01T01:24:53.922ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27002025-03-01T01:24:53.922ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27012025-03-01T01:24:53.922ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27022025-03-01T01:24:53.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27032025-03-01T01:24:53.922ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
27042025-03-01T01:24:53.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27052025-03-01T01:24:53.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27062025-03-01T01:24:53.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27072025-03-01T01:24:53.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27082025-03-01T01:24:53.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27092025-03-01T01:24:53.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 683 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38727 req_id = da25d589-7424-4237-a9a4-1be0c2ec445f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27102025-03-01T01:24:53.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60566 req_id = 1e797560-8697-4f06-859a-31a79e94dbb5 response_code = 200 uri = /artifacts
27112025-03-01T01:24:53.923ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
27122025-03-01T01:24:53.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34821
27132025-03-01T01:24:53.931ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
27142025-03-01T01:24:53.939ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27152025-03-01T01:24:53.939ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22
27162025-03-01T01:24:53.965ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27172025-03-01T01:24:53.965ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7
27182025-03-01T01:24:53.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
27192025-03-01T01:24:53.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49148
27202025-03-01T01:24:53.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58674 req_id = 3b492f9d-99c6-4d6e-adf6-58f8ecb7bc6f response_code = 204 uri = /vpc-routes
27212025-03-01T01:24:53.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49148 req_id = d53230fd-461c-4998-95e0-190047120f19 response_code = 200 uri = /v2p
27222025-03-01T01:24:53.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1434 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37456 req_id = a5459030-8d37-46b9-af7c-cf957fb9d4fb response_code = 204 uri = /vpc-routes
27232025-03-01T01:24:53.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44330
27242025-03-01T01:24:53.984ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27252025-03-01T01:24:53.984ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27262025-03-01T01:24:53.984ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27272025-03-01T01:24:53.984ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27282025-03-01T01:24:53.984ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27292025-03-01T01:24:53.984ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27302025-03-01T01:24:53.984ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27312025-03-01T01:24:53.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44330 req_id = ec787537-874e-4e87-ab4b-4807c6a39d16 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27322025-03-01T01:24:53.989ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27332025-03-01T01:24:53.989ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_275f9857-4588-4c99-8074-92222be09c5b
27342025-03-01T01:24:53.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46125
27352025-03-01T01:24:53.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50654
27362025-03-01T01:24:53.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50654 req_id = b2cb8569-19b1-414a-893f-5eb307e8f410 response_code = 200 uri = /v2p
27372025-03-01T01:24:54.003ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27382025-03-01T01:24:54.003ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27392025-03-01T01:24:54.003ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
27402025-03-01T01:24:54.009ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
27412025-03-01T01:24:54.018ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27422025-03-01T01:24:54.018ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1
27432025-03-01T01:24:54.034ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27442025-03-01T01:24:54.034ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22
27452025-03-01T01:24:54.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108917 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34821 req_id = 86b953e9-a8a5-4a60-8c8f-052cc58d87bf response_code = 204 uri = /switch-ports
27462025-03-01T01:24:54.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34821 req_id = 6b26ee1c-cdc5-4070-9e38-91f4da2c54fd response_code = 200 uri = /network-bootstore-config
27472025-03-01T01:24:54.067ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27482025-03-01T01:24:54.067ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7
27492025-03-01T01:24:54.080ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27502025-03-01T01:24:54.080ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8
27512025-03-01T01:24:54.096ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27522025-03-01T01:24:54.097ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_275f9857-4588-4c99-8074-92222be09c5b
27532025-03-01T01:24:54.111ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27542025-03-01T01:24:54.111ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc
27552025-03-01T01:24:54.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27562025-03-01T01:24:54.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c995cf87-df16-4488-b492-a0cb308dc53a
27572025-03-01T01:24:54.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47558
27582025-03-01T01:24:54.138ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27592025-03-01T01:24:54.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27602025-03-01T01:24:54.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27612025-03-01T01:24:54.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27622025-03-01T01:24:54.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27632025-03-01T01:24:54.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27642025-03-01T01:24:54.138ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27652025-03-01T01:24:54.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 725 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47558 req_id = 4f577167-110b-4eac-a0bd-e7148f03281e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27662025-03-01T01:24:54.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54385
27672025-03-01T01:24:54.147ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27682025-03-01T01:24:54.147ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1
27692025-03-01T01:24:54.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27702025-03-01T01:24:54.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27712025-03-01T01:24:54.162ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27722025-03-01T01:24:54.162ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7
27732025-03-01T01:24:54.163ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/config/omicron-zones.json file = common/src/ledger.rs:177
27742025-03-01T01:24:54.171ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9cd28a53-09cc-4801-86f8-a44529822435/config/omicron-zones.json file = common/src/ledger.rs:177
27752025-03-01T01:24:54.179ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27762025-03-01T01:24:54.179ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8
27772025-03-01T01:24:54.193ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 386fde7a-80e2-4083-964f-77e1ad7a7b22 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27782025-03-01T01:24:54.193ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_386fde7a-80e2-4083-964f-77e1ad7a7b22
27792025-03-01T01:24:54.206ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27802025-03-01T01:24:54.206ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9
27812025-03-01T01:24:54.220ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27822025-03-01T01:24:54.220ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc
27832025-03-01T01:24:54.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 302612 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41388 req_id = 2edb2f6c-7e25-4501-b67b-c1bb8e4d5180 response_code = 200 uri = /inventory
27842025-03-01T01:24:54.231ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba0b7b38-287e-44aa-9b14-bccc913e56b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27852025-03-01T01:24:54.231ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba0b7b38-287e-44aa-9b14-bccc913e56b7
27862025-03-01T01:24:54.246ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27872025-03-01T01:24:54.246ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c995cf87-df16-4488-b492-a0cb308dc53a
27882025-03-01T01:24:54.260ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 275f9857-4588-4c99-8074-92222be09c5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27892025-03-01T01:24:54.260ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_275f9857-4588-4c99-8074-92222be09c5b
27902025-03-01T01:24:54.282ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a33ccf31-7539-4f3b-84ef-1483f9fb73b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27912025-03-01T01:24:54.283ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a33ccf31-7539-4f3b-84ef-1483f9fb73b1
27922025-03-01T01:24:54.296ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27932025-03-01T01:24:54.296ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7
27942025-03-01T01:24:54.314ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 25fc83e8-5dc7-4682-b844-3c2fc11ac7f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27952025-03-01T01:24:54.314ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_25fc83e8-5dc7-4682-b844-3c2fc11ac7f8
27962025-03-01T01:24:54.333ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27972025-03-01T01:24:54.333ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9
27982025-03-01T01:24:54.349ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 31eb221a-8007-4b0c-915f-9fe13203b4cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27992025-03-01T01:24:54.349ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_31eb221a-8007-4b0c-915f-9fe13203b4cc
28002025-03-01T01:24:54.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 373224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46125 req_id = 5edcc55f-3b3f-4db9-91c4-dd2c11f6de76 response_code = 200 uri = /inventory
28012025-03-01T01:24:54.373ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c995cf87-df16-4488-b492-a0cb308dc53a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28022025-03-01T01:24:54.373ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c995cf87-df16-4488-b492-a0cb308dc53a
28032025-03-01T01:24:54.400ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8dcb792c-61bd-48c8-9a78-2287c589d2d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28042025-03-01T01:24:54.400ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8dcb792c-61bd-48c8-9a78-2287c589d2d7
28052025-03-01T01:24:54.424ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2d8762a3-1957-44b3-80d3-8e2206b3bba9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28062025-03-01T01:24:54.424ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2d8762a3-1957-44b3-80d3-8e2206b3bba9
28072025-03-01T01:24:54.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 294560 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54385 req_id = e676356b-7db8-4945-a0ae-6283f32064cd response_code = 200 uri = /inventory
28082025-03-01T01:25:12.765ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47498
28092025-03-01T01:25:12.765ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47498 req_id = 38fc6bb5-1a36-499c-8fb3-ba9edc985a27 response_code = 200 uri = /baseboard
28102025-03-01T01:25:22.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8335 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = e9fcadb6-bac1-4dfa-b1f6-40a98b9abbaa response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
28112025-03-01T01:25:23.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42209
28122025-03-01T01:25:23.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42209 req_id = 38e7af60-5bb2-41a6-ba8f-e4701c8c3126 response_code = 200 uri = /vpc-routes
28132025-03-01T01:25:23.129ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
28142025-03-01T01:25:23.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42209 req_id = 8949e1a4-f1c4-4775-83a3-ef14b7c43d9a response_code = 204 uri = /eip-gateways
28152025-03-01T01:25:23.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54813
28162025-03-01T01:25:23.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54813 req_id = c398b9fe-8300-4ae8-bcb9-bc4e663df8a6 response_code = 200 uri = /v2p
28172025-03-01T01:25:23.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42209 req_id = 40f660ac-9bf7-433d-9446-bb83bec6d241 response_code = 204 uri = /vpc-routes
28182025-03-01T01:25:23.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48684
28192025-03-01T01:25:23.264ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
28202025-03-01T01:25:23.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
28212025-03-01T01:25:23.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48684 req_id = edd7e676-2076-4680-9c70-7c8c264d9bd5 response_code = 204 uri = /switch-ports
28222025-03-01T01:25:23.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48684 req_id = 1c854e1b-1c20-4e49-bfdb-c752f63ee295 response_code = 200 uri = /network-bootstore-config
28232025-03-01T01:25:23.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33822
28242025-03-01T01:25:23.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33822 req_id = 95e65260-23ce-42b9-a258-2c48d860b8ac response_code = 200 uri = /vpc-routes
28252025-03-01T01:25:23.532ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
28262025-03-01T01:25:23.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33822 req_id = 76785bf3-05be-4e4d-94a9-30f6045636a4 response_code = 204 uri = /eip-gateways
28272025-03-01T01:25:23.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33822 req_id = c15f9119-f448-405f-9566-c2b3e97878f0 response_code = 204 uri = /vpc-routes
28282025-03-01T01:25:23.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57569
28292025-03-01T01:25:23.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57569 req_id = c77bf3a1-4626-4438-8561-c2bdc120c1e4 response_code = 200 uri = /vpc-routes
28302025-03-01T01:25:23.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64176
28312025-03-01T01:25:23.598ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
28322025-03-01T01:25:23.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
28332025-03-01T01:25:23.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99602 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64176 req_id = a5a559df-acf3-4d8b-a3bc-150c91e15a62 response_code = 204 uri = /switch-ports
28342025-03-01T01:25:23.698ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
28352025-03-01T01:25:23.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57569 req_id = 97fcee29-65d2-4143-8685-0fcecc442aba response_code = 204 uri = /eip-gateways
28362025-03-01T01:25:23.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64176 req_id = 3ff0d9c3-327e-4926-bca0-9adb3117c900 response_code = 200 uri = /network-bootstore-config
28372025-03-01T01:25:23.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57569 req_id = c91f2a16-fbb6-4b40-b5d3-77f2834474d7 response_code = 204 uri = /vpc-routes
28382025-03-01T01:25:23.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55995
28392025-03-01T01:25:23.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55995 req_id = 8e843a7d-0e16-4d84-849a-188d8e98ee14 response_code = 200 uri = /v2p
28402025-03-01T01:25:23.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55476
28412025-03-01T01:25:23.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55476 req_id = d59ff75f-5df6-43c2-ac0e-5b840f9763d1 response_code = 200 uri = /v2p
28422025-03-01T01:25:23.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46334
28432025-03-01T01:25:23.791ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
28442025-03-01T01:25:23.830ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
28452025-03-01T01:25:23.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46334 req_id = 92dcef0c-d514-4df3-8c4b-aaff2bcd97fb response_code = 204 uri = /switch-ports
28462025-03-01T01:25:23.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46334 req_id = 412ffc6c-7f35-4d53-9f1d-b603ac5a1e69 response_code = 200 uri = /network-bootstore-config
28472025-03-01T01:25:40.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43441
28482025-03-01T01:25:40.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43441 req_id = aa37ae32-b9d9-4ad1-bda8-940dbea2b26f response_code = 200 uri = /v2p
28492025-03-01T01:25:40.186ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(1136230) }
28502025-03-01T01:25:40.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43441 req_id = 70da68b7-da2a-49ab-a34a-fabb0554b8fd response_code = 204 uri = /v2p
28512025-03-01T01:25:40.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35151
28522025-03-01T01:25:40.361ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 744f1975-fb15-4ab9-ae36-db6df43c1b80, kind: Instance { id: 569a637e-763e-4e53-a4b5-dc11743374ed }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1136230), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 744f1975-fb15-4ab9-ae36-db6df43c1b80, kind: Instance { id: 569a637e-763e-4e53-a4b5-dc11743374ed }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1136230), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 744f1975-fb15-4ab9-ae36-db6df43c1b80, kind: Instance { id: 569a637e-763e-4e53-a4b5-dc11743374ed }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1136230), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1136230))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 744f1975-fb15-4ab9-ae36-db6df43c1b80, kind: Instance { id: 569a637e-763e-4e53-a4b5-dc11743374ed }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1136230), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 63005ad4-3360-425b-8e37-c2166bdd1aaf, slot: 0, read_only: false, vcr_json: .., name: "disk-81fed249282" }], boot_settings: Some(InstanceBootSettings { order: [63005ad4-3360-425b-8e37-c2166bdd1aaf] }), cloud_init_bytes: Some(..) } instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed metadata = InstanceMetadata { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, project_id: bddca329-6d2c-43a5-8d39-c2dade19860c } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-01T01:25:40.352376864Z }
28532025-03-01T01:25:40.361ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed migration_id = None propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28542025-03-01T01:25:40.362ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1564 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed migration_id = None propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 744f1975-fb15-4ab9-ae36-db6df43c1b80, kind: Instance { id: 569a637e-763e-4e53-a4b5-dc11743374ed }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1136230), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 744f1975-fb15-4ab9-ae36-db6df43c1b80, kind: Instance { id: 569a637e-763e-4e53-a4b5-dc11743374ed }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1136230), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 744f1975-fb15-4ab9-ae36-db6df43c1b80, kind: Instance { id: 569a637e-763e-4e53-a4b5-dc11743374ed }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1136230), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1136230))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 744f1975-fb15-4ab9-ae36-db6df43c1b80, kind: Instance { id: 569a637e-763e-4e53-a4b5-dc11743374ed }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1136230), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 63005ad4-3360-425b-8e37-c2166bdd1aaf, slot: 0, read_only: false, vcr_json: .., name: "disk-81fed249282" }], boot_settings: Some(InstanceBootSettings { order: [63005ad4-3360-425b-8e37-c2166bdd1aaf] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-01T01:25:40.352376864Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28552025-03-01T01:25:40.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 12436 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35151 req_id = 37d0f5fe-7a11-47b6-89d9-615543f56085 response_code = 200 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28562025-03-01T01:25:40.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56790
28572025-03-01T01:25:40.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56790 req_id = 8dda3be9-520a-40ea-b40d-23aa4bf7b48b response_code = 200 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5/state
28582025-03-01T01:25:40.444ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 1136230 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28592025-03-01T01:25:40.444ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28602025-03-01T01:25:40.486ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5 file = illumos-utils/src/zone.rs:325 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28612025-03-01T01:25:40.509ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5 file = illumos-utils/src/zone.rs:363 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28622025-03-01T01:25:40.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56433
28632025-03-01T01:25:40.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56433 req_id = 7a0861d2-6f98-4be3-8da4-14ad95e5e81c response_code = 200 uri = /vpc-routes
28642025-03-01T01:25:40.564ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {744f1975-fb15-4ab9-ae36-db6df43c1b80: {10.151.2.176: {dd673e83-bb28-43b4-80dc-cd65cf150392}, 10.151.2.175: {dd673e83-bb28-43b4-80dc-cd65cf150392}}} }
28652025-03-01T01:25:42.155ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28662025-03-01T01:25:42.155ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28672025-03-01T01:25:42.331ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 47.721325ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28682025-03-01T01:25:42.388ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 125.525009ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28692025-03-01T01:25:42.534ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 274.15382ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28702025-03-01T01:25:42.826ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 229.048261ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28712025-03-01T01:25:42.826ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54164
28722025-03-01T01:25:42.826ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54164 req_id = d9ad2f59-34b3-4ad2-a531-41337d118a43 response_code = 200 uri = /baseboard
28732025-03-01T01:25:43.072ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 817.085338ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28742025-03-01T01:25:43.901ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 1.204561752s file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28752025-03-01T01:25:45.118ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 591.547217ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28762025-03-01T01:25:45.721ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 720.715739ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28772025-03-01T01:25:46.452ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 1.062213849s file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 zone = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28782025-03-01T01:25:47.543ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5 file = sled-agent/src/instance.rs:2072 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28792025-03-01T01:25:47.552ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 56.86792ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28802025-03-01T01:25:47.619ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 81.179711ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28812025-03-01T01:25:47.710ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 126.659347ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28822025-03-01T01:25:47.846ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5") failed: Property not found. retry in 253.31986ms file = illumos-utils/src/svc.rs:42 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28832025-03-01T01:25:48.111ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2081 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28842025-03-01T01:25:48.150ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2105 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28852025-03-01T01:25:48.225ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1215 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28862025-03-01T01:25:48.226ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
28872025-03-01T01:25:48.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7662084 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56433 req_id = b509c4d2-a1ac-444e-9442-eb3789260c75 response_code = 204 uri = /eip-gateways
28882025-03-01T01:25:48.226ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-03-01T01:25:48.226141752Z } file = sled-agent/src/instance.rs:782 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28892025-03-01T01:25:48.226ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-01T01:25:48.226141752Z } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28902025-03-01T01:25:48.226ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-01T01:25:48.226141752Z }, migration_in: None, migration_out: None }
28912025-03-01T01:25:48.296ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-03-01T01:25:48.296408454Z } file = sled-agent/src/instance.rs:782 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28922025-03-01T01:25:48.296ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-01T01:25:48.296408454Z } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
28932025-03-01T01:25:48.296ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-01T01:25:48.296408454Z }, migration_in: None, migration_out: None }
28942025-03-01T01:25:48.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56433 req_id = daa2a604-1d9c-4573-9b4e-06f03dcd62c6 response_code = 204 uri = /vpc-routes
28952025-03-01T01:25:52.423ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8453 local_addr = [fd00:1122:3344:101::1]:60769 method = GET remote_addr = [fd00:1122:3344:101::d]:56305 req_id = 5ddb64dc-642f-4d99-bc84-9d25df6eabee response_code = 200 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a uri = /3471264f-127e-4a25-bc10-2e8249e8d70a
28962025-03-01T01:25:53.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54162
28972025-03-01T01:25:53.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54162 req_id = b1908368-261e-4b77-a607-b4682f2eeb7c response_code = 200 uri = /vpc-routes
28982025-03-01T01:25:53.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48932
28992025-03-01T01:25:53.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48932 req_id = 9618ec4b-1960-42fc-bd60-d4e6d4f0e96b response_code = 200 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5/state
29002025-03-01T01:25:53.467ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {744f1975-fb15-4ab9-ae36-db6df43c1b80: {10.151.2.176: {dd673e83-bb28-43b4-80dc-cd65cf150392}, 10.151.2.175: {dd673e83-bb28-43b4-80dc-cd65cf150392}}} }
29012025-03-01T01:25:53.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54162 req_id = dd1fa277-e441-4b0b-8f92-7c7adc598b40 response_code = 204 uri = /eip-gateways
29022025-03-01T01:25:53.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54162 req_id = b1a9311e-bc92-432b-a7a8-f2a279bdf4dd response_code = 204 uri = /vpc-routes
29032025-03-01T01:25:53.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39718
29042025-03-01T01:25:53.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39718 req_id = a9047163-e6e9-4cdc-b56b-1227384799b7 response_code = 200 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5/state
29052025-03-01T01:25:53.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36626
29062025-03-01T01:25:53.628ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
29072025-03-01T01:25:53.673ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
29082025-03-01T01:25:53.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36626 req_id = 784b4721-9e6a-40b5-bab3-9692f1791e23 response_code = 204 uri = /switch-ports
29092025-03-01T01:25:53.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42418
29102025-03-01T01:25:53.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62776
29112025-03-01T01:25:53.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37226
29122025-03-01T01:25:53.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42418 req_id = 9dfebc7f-575c-44e8-a405-168d80a0acf3 response_code = 200 uri = /vpc-routes
29132025-03-01T01:25:53.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36626 req_id = cfefbced-c36b-448b-ae8d-be5a1d38621d response_code = 200 uri = /network-bootstore-config
29142025-03-01T01:25:53.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37226 req_id = 541aff05-cd2f-43a6-9902-6622427cb821 response_code = 200 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5/state
29152025-03-01T01:25:53.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62776 req_id = 28dda510-7c94-4e5e-9861-4891599cc07b response_code = 200 uri = /v2p
29162025-03-01T01:25:53.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47366
29172025-03-01T01:25:53.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47366 req_id = d5b59357-e71c-4ef1-bf45-cb68ab81c415 response_code = 200 uri = /v2p
29182025-03-01T01:25:53.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32937
29192025-03-01T01:25:53.785ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
29202025-03-01T01:25:53.828ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
29212025-03-01T01:25:53.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116494 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32937 req_id = f9e7655b-09ec-4a36-bbb4-f1de47317cd8 response_code = 204 uri = /switch-ports
29222025-03-01T01:25:53.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35387
29232025-03-01T01:25:53.902ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {744f1975-fb15-4ab9-ae36-db6df43c1b80: {10.151.2.176: {dd673e83-bb28-43b4-80dc-cd65cf150392}, 10.151.2.175: {dd673e83-bb28-43b4-80dc-cd65cf150392}}} }
29242025-03-01T01:25:53.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42418 req_id = 4996c0b2-4285-47d7-b08e-13086d71b054 response_code = 204 uri = /eip-gateways
29252025-03-01T01:25:53.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32937 req_id = 5c2c998c-35d6-47cc-b53a-72819613b0ea response_code = 200 uri = /network-bootstore-config
29262025-03-01T01:25:53.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35387 req_id = 9380480a-992c-401d-81e6-5bc3ad0089b1 response_code = 200 uri = /vpc-routes
29272025-03-01T01:25:53.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42418 req_id = 3e31bd3c-5ac6-45b2-9b08-b0cd6933f2e0 response_code = 204 uri = /vpc-routes
29282025-03-01T01:25:53.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37830
29292025-03-01T01:25:53.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37830 req_id = 028344d6-9a2c-4d9f-9f00-5c437503bf80 response_code = 200 uri = /v2p
29302025-03-01T01:25:54.013ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {744f1975-fb15-4ab9-ae36-db6df43c1b80: {10.151.2.176: {dd673e83-bb28-43b4-80dc-cd65cf150392}, 10.151.2.175: {dd673e83-bb28-43b4-80dc-cd65cf150392}}} }
29312025-03-01T01:25:54.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35387 req_id = aaa9b182-aba9-4367-be56-43e65642c827 response_code = 204 uri = /eip-gateways
29322025-03-01T01:25:54.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35387 req_id = 28f30de0-c6aa-4cb5-8035-478913c7ff60 response_code = 204 uri = /vpc-routes
29332025-03-01T01:25:54.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48058
29342025-03-01T01:25:54.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
29352025-03-01T01:25:54.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
29362025-03-01T01:25:54.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98352 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48058 req_id = 442f1d8f-514a-4b53-b2e8-c736649345c2 response_code = 204 uri = /switch-ports
29372025-03-01T01:25:54.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48058 req_id = 87c89865-be34-45bc-b999-5e474c51b823 response_code = 200 uri = /network-bootstore-config
29382025-03-01T01:25:58.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40398
29392025-03-01T01:25:58.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 558 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40398 req_id = 43245ee7-c5dd-4392-9838-d98d8a38e9bf response_code = 200 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5/state
29402025-03-01T01:25:58.012ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-03-01T01:25:58.012335718Z } file = sled-agent/src/instance.rs:782 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
29412025-03-01T01:25:58.012ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-01T01:25:58.012335718Z } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
29422025-03-01T01:25:58.012ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-01T01:25:58.012335718Z }, migration_in: None, migration_out: None }
29432025-03-01T01:25:58.051ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-03-01T01:25:58.051588168Z } file = sled-agent/src/instance.rs:782 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
29442025-03-01T01:25:58.051ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-03-01T01:25:58.051588168Z } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
29452025-03-01T01:25:58.051ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:818 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
29462025-03-01T01:25:58.051ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29472025-03-01T01:25:58.051ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29482025-03-01T01:25:58.052ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/9cd28a53-09cc-4801-86f8-a44529822435/debug/bundle/zone", "/pool/int/c0d37cb7-67d2-4b18-a0da-eaee3f7f4ea7/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/386fde7a-80e2-4083-964f-77e1ad7a7b22/crypt/debug", "/pool/ext/ba0b7b38-287e-44aa-9b14-bccc913e56b7/crypt/debug", "/pool/ext/275f9857-4588-4c99-8074-92222be09c5b/crypt/debug", "/pool/ext/a33ccf31-7539-4f3b-84ef-1483f9fb73b1/crypt/debug", "/pool/ext/25fc83e8-5dc7-4682-b844-3c2fc11ac7f8/crypt/debug", "/pool/ext/31eb221a-8007-4b0c-915f-9fe13203b4cc/crypt/debug", "/pool/ext/c995cf87-df16-4488-b492-a0cb308dc53a/crypt/debug", "/pool/ext/8dcb792c-61bd-48c8-9a78-2287c589d2d7/crypt/debug", "/pool/ext/2d8762a3-1957-44b3-80d3-8e2206b3bba9/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5
29492025-03-01T01:25:58.678ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5", bundle_id: 0bd18cfd-9196-43b4-86bc-0796c0ce99c5 }, time_created: 2025-03-01T01:25:58.053556117Z, version: 0, cause: TerminatedInstance }
29502025-03-01T01:25:58.678ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_aca99a49-7c59-4a59-af58-b9aed0dbfdb5 file = sled-agent/src/instance.rs:1315 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
29512025-03-01T01:26:00.463ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
29522025-03-01T01:26:00.480ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(1136230), kind: System }
29532025-03-01T01:26:00.480ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(1136230), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29542025-03-01T01:26:00.480ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-01T01:26:00.480923353Z }, migration_in: None, migration_out: None }
29552025-03-01T01:26:00.549ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-01T01:26:00.480923353Z }, migration_in: None, migration_out: None }
29562025-03-01T01:26:00.553ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1252 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
29572025-03-01T01:26:01.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56311
29582025-03-01T01:26:01.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56311 req_id = d05642d0-a17c-40c4-a77a-9cd2d32474c5 response_code = 200 uri = /vpc-routes
29592025-03-01T01:26:01.060ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {744f1975-fb15-4ab9-ae36-db6df43c1b80: {10.151.2.176: {dd673e83-bb28-43b4-80dc-cd65cf150392}, 10.151.2.175: {dd673e83-bb28-43b4-80dc-cd65cf150392}}} }
29602025-03-01T01:26:01.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56311 req_id = 345b92c9-eb54-4d96-9b7f-7c53c18cfd5a response_code = 204 uri = /eip-gateways
29612025-03-01T01:26:01.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56311 req_id = d2b9f47b-730d-48e1-b5ae-6a6ff1a12cc6 response_code = 204 uri = /vpc-routes
29622025-03-01T01:26:01.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63260
29632025-03-01T01:26:01.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63260 req_id = e00fd4dd-d507-4d56-89f5-af7871f269db response_code = 200 uri = /v2p
29642025-03-01T01:26:02.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40077
29652025-03-01T01:26:02.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40077 req_id = d0dfbfb3-57ab-48cd-9c2f-e896f7681346 response_code = 200 uri = /v2p
29662025-03-01T01:26:02.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62742
29672025-03-01T01:26:02.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62742 req_id = aef9d387-344a-45db-bb50-cf7d23052b67 response_code = 200 uri = /vpc-routes
29682025-03-01T01:26:02.643ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
29692025-03-01T01:26:02.643ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a
29702025-03-01T01:26:02.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62742 req_id = ddb017ab-7b56-4894-a502-7e427812de93 response_code = 204 uri = /eip-gateways
29712025-03-01T01:26:02.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62742 req_id = 377260ec-0fb2-427d-b183-24e062cdd376 response_code = 204 uri = /vpc-routes
29722025-03-01T01:26:03.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38343
29732025-03-01T01:26:03.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38343 req_id = d5816f2d-bf73-42b3-91c4-83877d2fc643 response_code = 200 uri = /vpc-routes
29742025-03-01T01:26:03.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a values = ExternalIpGatewayMap { mappings: {} }
29752025-03-01T01:26:03.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38343 req_id = c94ec748-9008-4e42-9f0d-8a2c99c47157 response_code = 204 uri = /eip-gateways
29762025-03-01T01:26:03.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38343 req_id = b6ba7781-1631-4a60-89cb-c48e187fa69b response_code = 204 uri = /vpc-routes