Max level shown:
1 [ Jan 15 00:39:36 Enabled. ]
2 [ Jan 15 00:39:36 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 15 00:39:36 Method "start" exited with status 0. ]
4 [ Jan 15 00:39:36 Rereading configuration. ]
5 [ Jan 15 00:39:36 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-15T00:39:36.255ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-15T00:39:36.255ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-15T00:39:36.309ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-15T00:39:36.309ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-15T00:39:36.424ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-15T00:39:36.434ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-15T00:39:36.441ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-15T00:39:37.044ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-15T00:39:37.183ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-15T00:39:37.183ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-15T00:39:37.183ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-15T00:39:37.183ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
192025-01-15T00:39:37.183ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202025-01-15T00:39:37.183ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-15T00:39:37.187ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-15T00:39:37.187ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-15T00:39:37.187ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-15T00:39:37.187ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-15T00:39:37.187ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-15T00:39:37.187ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-15T00:39:37.187ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-15T00:39:37.187ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-15T00:39:37.187ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-15T00:39:37.199ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-15T00:39:37.199ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool)
322025-01-15T00:39:37.295ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal }
332025-01-15T00:39:37.651ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-15T00:39:37.651ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-15T00:39:37.651ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-15T00:39:37.651ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-15T00:39:37.651ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-15T00:39:37.653ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-15T00:39:37.653ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-15T00:39:37.660ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-15T00:39:37.660ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool)
422025-01-15T00:39:37.746ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal }
432025-01-15T00:39:38.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-15T00:39:38.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
502025-01-15T00:39:38.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
512025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-15T00:39:38.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-15T00:39:38.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-15T00:39:38.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-15T00:39:38.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632025-01-15T00:39:38.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-01-15T00:39:38.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
662025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
672025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
682025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
692025-01-15T00:39:38.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732025-01-15T00:39:38.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-15T00:39:38.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-15T00:39:38.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-15T00:39:38.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-15T00:39:38.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-15T00:39:38.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-15T00:39:38.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
902025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-15T00:39:38.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-15T00:39:38.111ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
962025-01-15T00:39:38.111ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
972025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
982025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
992025-01-15T00:39:38.111ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002025-01-15T00:39:38.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-01-15T00:39:38.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-01-15T00:39:38.111ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-15T00:39:38.111ZINFOSledAgent (bootstore): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-15T00:39:38.111ZINFOSledAgent (bootstore): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-15T00:39:38.111ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-15T00:39:38.111ZINFOSledAgent (bootstore): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-15T00:39:38.111ZINFOSledAgent (bootstore): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-15T00:39:38.111ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-15T00:39:38.111ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-15T00:39:38.112ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-15T00:39:38.123ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:748
1132025-01-15T00:39:38.123ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1198, tv_nsec: 607262108 } time_to_next_cleanup = 599.999919898s
1142025-01-15T00:39:38.123ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
1152025-01-15T00:39:38.123ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-15T00:39:38.123ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-15T00:39:38.126ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-15T00:39:38.126ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-15T00:39:38.128ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-15T00:39:38.128ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-15T00:39:38.128ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-15T00:39:38.128ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-15T00:39:38.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-15T00:39:38.129ZINFOSledAgent (RSS): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-15T00:39:38.129ZINFOSledAgent (RSS): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-15T00:39:38.129ZINFOSledAgent (RSS): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-15T00:39:38.129ZINFOSledAgent (RSS): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-15T00:39:38.129ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-15T00:39:38.129ZINFOSledAgent (RSS): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-15T00:39:38.129ZINFOSledAgent (RSS): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-15T00:39:38.129ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-15T00:39:38.129ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-15T00:39:38.129ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-15T00:39:38.129ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-15T00:39:38.129ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-15T00:39:38.129ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-15T00:39:38.129ZINFOSledAgent (bootstore): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-15T00:39:38.129ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-15T00:39:38.129ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 (sled), rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-15T00:39:38.130ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4270
1412025-01-15T00:39:38.130ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4664
1422025-01-15T00:39:38.134ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-15T00:39:38.140ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-15T00:39:38.140ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-15T00:39:38.144ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-15T00:39:38.144ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-15T00:39:38.144ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:64632
1482025-01-15T00:39:38.145ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 (sled), rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-15T00:39:38.145ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-15T00:39:38.145ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-15T00:39:38.145ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-15T00:39:38.145ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-15T00:39:38.145ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-15T00:39:38.145ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-15T00:39:38.145ZINFOSledAgent (StorageManager): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-15T00:39:38.145ZINFOSledAgent (StorageManager): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-15T00:39:38.145ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-15T00:39:38.145ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-15T00:39:38.145ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-15T00:39:38.145ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-15T00:39:38.145ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-15T00:39:38.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-15T00:39:38.181ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-15T00:39:38.198ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-15T00:39:38.225ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
1662025-01-15T00:39:38.225ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-15T00:39:38.225ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1682025-01-15T00:39:38.225ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
1692025-01-15T00:39:38.228ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 74.875798ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "763f5a0e-3383-453e-a280-7f69772638be", "content-length": "124", "date": "Wed, 15 Jan 2025 00:39:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "763f5a0e-3383-453e-a280-7f69772638be" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-15T00:39:38.238ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-15T00:39:38.261ZINFOSledAgent: successfully created encrypted zvol: name="oxi_e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-15T00:39:38.261ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-15T00:39:38.267ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
1742025-01-15T00:39:38.267ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-15T00:39:38.267ZINFOSledAgent (BackingFs): Ensuring dataset oxi_e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-15T00:39:38.304ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-15T00:39:38.305ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 90.772451ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "41a8326f-8dc8-4387-bdef-77e17fdb0d34", "content-length": "124", "date": "Wed, 15 Jan 2025 00:39:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "41a8326f-8dc8-4387-bdef-77e17fdb0d34" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-15T00:39:38.334ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-15T00:39:38.397ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-15T00:39:38.398ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 93.04818ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f4bfea29-80c8-4541-974f-344b92f9961b", "content-length": "124", "date": "Wed, 15 Jan 2025 00:39:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f4bfea29-80c8-4541-974f-344b92f9961b" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-15T00:39:38.492ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822025-01-15T00:39:38.492ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 139.903151ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e071e2f7-406a-4a58-b8ed-3b40b5024052", "content-length": "124", "date": "Wed, 15 Jan 2025 00:39:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e071e2f7-406a-4a58-b8ed-3b40b5024052" } file = clients/ddm-admin-client/src/lib.rs:177
1832025-01-15T00:39:38.552ZINFOSledAgent (BackingFs): Mounting oxi_e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842025-01-15T00:39:38.565ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852025-01-15T00:39:38.565ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862025-01-15T00:39:38.565ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872025-01-15T00:39:38.565ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882025-01-15T00:39:38.633ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-15T00:39:38.633ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 266.347203ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1fbb03ef-c92a-4a43-b929-8bfbecb8a96e", "content-length": "124", "date": "Wed, 15 Jan 2025 00:39:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1fbb03ef-c92a-4a43-b929-8bfbecb8a96e" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-15T00:39:38.901ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-15T00:39:38.902ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 353.842327ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0b007672-7d2f-43fc-916b-1f0e385cc271", "content-length": "124", "date": "Wed, 15 Jan 2025 00:39:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0b007672-7d2f-43fc-916b-1f0e385cc271" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-15T00:39:39.257ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-15T00:39:39.294ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
1942025-01-15T00:39:39.298ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:51877 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
1952025-01-15T00:39:39.299ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
1962025-01-15T00:39:39.299ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:51877 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
1972025-01-15T00:39:39.300ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 216.718582ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
1982025-01-15T00:39:39.301ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
1992025-01-15T00:39:39.301ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2002025-01-15T00:39:39.301ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:932 underlay_address = fd00:1122:3344:101::1
2012025-01-15T00:39:39.301ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022025-01-15T00:39:39.517ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 459.511337ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2032025-01-15T00:39:39.979ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.291825157s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2042025-01-15T00:39:41.273ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.825298079s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2052025-01-15T00:39:41.967ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2694
2062025-01-15T00:39:41.967ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2939
2072025-01-15T00:39:41.967ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2564
2082025-01-15T00:39:41.967ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2611
2092025-01-15T00:39:41.967ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3020
2102025-01-15T00:39:41.967ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3065
2112025-01-15T00:39:41.969ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2864
2122025-01-15T00:39:41.970ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2605
2132025-01-15T00:39:41.970ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='f8080e5a-fc3a-46fa-b5a2-d58e1ae241ac'/> <propval type="astring" name="rack_id" value='c52fc7fb-8746-40c6-805b-707ae8abbd97'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe36:8d57'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='c52fc7fb-8746-40c6-805b-707ae8abbd97'/> <propval type="astring" name="sled_id" value='71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9'/> <propval type="astring" name="rack_uuid" value='c52fc7fb-8746-40c6-805b-707ae8abbd97'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9'/> <propval type="astring" name="rack_uuid" value='c52fc7fb-8746-40c6-805b-707ae8abbd97'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-01-15T00:39:41.970ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152025-01-15T00:39:42.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 29.402511ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162025-01-15T00:39:42.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 100.141583ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172025-01-15T00:39:42.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 120.172566ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182025-01-15T00:39:42.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 320.769772ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192025-01-15T00:39:43.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 955.086088ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-15T00:39:44.100ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.414819846s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2212025-01-15T00:39:44.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.077493724s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222025-01-15T00:39:45.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.24905289s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232025-01-15T00:39:46.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 806.256027ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-15T00:39:48.110ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) file = sled-agent/src/nexus.rs:527 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2252025-01-15T00:39:48.140ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2262025-01-15T00:39:48.141ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2272025-01-15T00:39:48.142ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2282025-01-15T00:39:48.142ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2292025-01-15T00:39:48.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302025-01-15T00:39:48.142ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2312025-01-15T00:39:48.142ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-01-15T00:39:48.143ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2332025-01-15T00:39:48.143ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2342025-01-15T00:39:48.143ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
2352025-01-15T00:39:48.143ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:64632
2362025-01-15T00:39:48.347ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2372025-01-15T00:39:48.347ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2382025-01-15T00:39:48.353ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4294 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2392025-01-15T00:39:48.613ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.927086485s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2402025-01-15T00:39:49.306ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) file = sled-agent/src/probe_manager.rs:231 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2412025-01-15T00:39:49.307ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2422025-01-15T00:39:49.307ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2432025-01-15T00:39:49.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64465
2442025-01-15T00:39:49.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-01-15T00:39:49.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-01-15T00:39:49.308ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-01-15T00:39:49.308ZINFOSledAgent (ServiceManager): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-01-15T00:39:49.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64465 req_id = 83898c5e-7372-4d0c-8fa4-23b212c84e06 response_code = 200 uri = /inventory
2492025-01-15T00:39:49.535ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2502025-01-15T00:39:49.543ZINFOSledAgent (ServiceManager): refreshed zone-network-setup service with new configuration file = sled-agent/src/services.rs:4343
2512025-01-15T00:39:49.543ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4401
2522025-01-15T00:39:49.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47954
2532025-01-15T00:39:49.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47954 req_id = c0700af2-e4b6-4a0b-a272-98ef9ab7aec3 response_code = 200 uri = /sled-role
2542025-01-15T00:39:49.620ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 138d04e2-b09c-462e-ad19-ef10a5106ce0 (physical_disk), pool_id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8db1ccde-6b28-4887-98a6-c1f00a049ad6 (physical_disk), pool_id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 31060af7-b2c6-4936-b4d3-d18fa2ff1816 (physical_disk), pool_id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 1c03bccc-fe17-4c6e-863d-16f82675ae16 (physical_disk), pool_id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 369d267d-6a87-4928-87bc-7d0052163a6b (physical_disk), pool_id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a290a441-b0ff-4eff-9719-1347109e75ee (physical_disk), pool_id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 4a6689af-b4d7-474b-8f87-ae093d7dd912 (physical_disk), pool_id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 8b720850-43e3-41c7-a3cf-80ce84318e9a (physical_disk), pool_id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 52107f5a-dca8-49a9-a2e0-0b575da4f20e (physical_disk), pool_id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2552025-01-15T00:39:49.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60862
2562025-01-15T00:39:49.621ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
2572025-01-15T00:39:49.621ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 138d04e2-b09c-462e-ad19-ef10a5106ce0 (physical_disk), pool_id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8db1ccde-6b28-4887-98a6-c1f00a049ad6 (physical_disk), pool_id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 31060af7-b2c6-4936-b4d3-d18fa2ff1816 (physical_disk), pool_id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 1c03bccc-fe17-4c6e-863d-16f82675ae16 (physical_disk), pool_id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 369d267d-6a87-4928-87bc-7d0052163a6b (physical_disk), pool_id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a290a441-b0ff-4eff-9719-1347109e75ee (physical_disk), pool_id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 4a6689af-b4d7-474b-8f87-ae093d7dd912 (physical_disk), pool_id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 8b720850-43e3-41c7-a3cf-80ce84318e9a (physical_disk), pool_id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 52107f5a-dca8-49a9-a2e0-0b575da4f20e (physical_disk), pool_id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2582025-01-15T00:39:49.621ZINFOSledAgent (StorageManager): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592025-01-15T00:39:49.621ZINFOSledAgent (StorageManager): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602025-01-15T00:39:49.621ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2612025-01-15T00:39:49.621ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2622025-01-15T00:39:49.621ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2632025-01-15T00:39:49.621ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2642025-01-15T00:39:49.621ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2652025-01-15T00:39:49.632ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2662025-01-15T00:39:49.632ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool)
2672025-01-15T00:39:49.685ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4467
2682025-01-15T00:39:49.685ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4494
2692025-01-15T00:39:49.726ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4507
2702025-01-15T00:39:49.726ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4353
2712025-01-15T00:39:49.734ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }
2722025-01-15T00:39:49.744ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2732025-01-15T00:39:49.744ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2742025-01-15T00:39:49.744ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2752025-01-15T00:39:49.744ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2762025-01-15T00:39:49.744ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772025-01-15T00:39:49.744ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2782025-01-15T00:39:49.744ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2792025-01-15T00:39:49.782ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2802025-01-15T00:39:49.791ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone file = sled-storage/src/dataset.rs:302
2812025-01-15T00:39:49.931ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0 file = sled-storage/src/dataset.rs:388
2822025-01-15T00:39:49.939ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2832025-01-15T00:39:49.939ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2842025-01-15T00:39:49.939ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2852025-01-15T00:39:49.939ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2862025-01-15T00:39:49.939ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2872025-01-15T00:39:49.948ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2882025-01-15T00:39:49.948ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool)
2892025-01-15T00:39:50.041ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }
2902025-01-15T00:39:50.048ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2912025-01-15T00:39:50.048ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2922025-01-15T00:39:50.048ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2932025-01-15T00:39:50.048ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2942025-01-15T00:39:50.048ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952025-01-15T00:39:50.048ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2962025-01-15T00:39:50.048ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2972025-01-15T00:39:50.083ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2982025-01-15T00:39:50.091ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone file = sled-storage/src/dataset.rs:302
2992025-01-15T00:39:50.235ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ba26a070-5665-4b80-b702-e0bfb62227f6 file = sled-storage/src/dataset.rs:388
3002025-01-15T00:39:50.243ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3012025-01-15T00:39:50.243ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3022025-01-15T00:39:50.243ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3032025-01-15T00:39:50.243ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3042025-01-15T00:39:50.243ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3052025-01-15T00:39:50.252ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3062025-01-15T00:39:50.253ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a6ee976a-8413-4b79-86fd-0416e935e722 (zpool)
3072025-01-15T00:39:50.349ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }
3082025-01-15T00:39:50.357ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3092025-01-15T00:39:50.357ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3102025-01-15T00:39:50.357ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3112025-01-15T00:39:50.357ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3122025-01-15T00:39:50.357ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132025-01-15T00:39:50.357ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3142025-01-15T00:39:50.357ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3152025-01-15T00:39:50.361ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) file = sled-agent/src/probe_manager.rs:231 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3162025-01-15T00:39:50.394ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3172025-01-15T00:39:50.403ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone file = sled-storage/src/dataset.rs:302
3182025-01-15T00:39:50.542ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a6ee976a-8413-4b79-86fd-0416e935e722 file = sled-storage/src/dataset.rs:388
3192025-01-15T00:39:50.550ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3202025-01-15T00:39:50.550ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3212025-01-15T00:39:50.550ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3222025-01-15T00:39:50.550ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3232025-01-15T00:39:50.550ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3242025-01-15T00:39:50.560ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3252025-01-15T00:39:50.560ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e927d854-d6fd-4606-baca-3874882eccd4 (zpool)
3262025-01-15T00:39:50.657ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }
3272025-01-15T00:39:50.665ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3282025-01-15T00:39:50.665ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3292025-01-15T00:39:50.665ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3302025-01-15T00:39:50.665ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3312025-01-15T00:39:50.665ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322025-01-15T00:39:50.666ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3332025-01-15T00:39:50.666ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3342025-01-15T00:39:50.701ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3352025-01-15T00:39:50.709ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e927d854-d6fd-4606-baca-3874882eccd4/crypt/zone file = sled-storage/src/dataset.rs:302
3362025-01-15T00:39:50.850ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e927d854-d6fd-4606-baca-3874882eccd4 file = sled-storage/src/dataset.rs:388
3372025-01-15T00:39:50.858ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3382025-01-15T00:39:50.858ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3392025-01-15T00:39:50.858ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3402025-01-15T00:39:50.858ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3412025-01-15T00:39:50.858ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3422025-01-15T00:39:50.868ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3432025-01-15T00:39:50.868ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool)
3442025-01-15T00:39:50.964ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }
3452025-01-15T00:39:50.973ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3462025-01-15T00:39:50.973ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3472025-01-15T00:39:50.973ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3482025-01-15T00:39:50.973ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3492025-01-15T00:39:50.973ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502025-01-15T00:39:50.973ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3512025-01-15T00:39:50.973ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3522025-01-15T00:39:51.011ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3532025-01-15T00:39:51.019ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/zone file = sled-storage/src/dataset.rs:302
3542025-01-15T00:39:51.158ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c file = sled-storage/src/dataset.rs:388
3552025-01-15T00:39:51.166ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3562025-01-15T00:39:51.166ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3572025-01-15T00:39:51.166ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3582025-01-15T00:39:51.166ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3592025-01-15T00:39:51.166ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3602025-01-15T00:39:51.176ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3612025-01-15T00:39:51.176ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool)
3622025-01-15T00:39:51.269ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }
3632025-01-15T00:39:51.278ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3642025-01-15T00:39:51.278ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3652025-01-15T00:39:51.278ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3662025-01-15T00:39:51.278ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3672025-01-15T00:39:51.278ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682025-01-15T00:39:51.278ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3692025-01-15T00:39:51.278ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3702025-01-15T00:39:51.314ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3712025-01-15T00:39:51.322ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/zone file = sled-storage/src/dataset.rs:302
3722025-01-15T00:39:51.366ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) file = sled-agent/src/probe_manager.rs:231 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3732025-01-15T00:39:51.463ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4 file = sled-storage/src/dataset.rs:388
3742025-01-15T00:39:51.471ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3752025-01-15T00:39:51.471ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3762025-01-15T00:39:51.471ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3772025-01-15T00:39:51.471ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3782025-01-15T00:39:51.471ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3792025-01-15T00:39:51.481ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3802025-01-15T00:39:51.481ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool)
3812025-01-15T00:39:51.579ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }
3822025-01-15T00:39:51.587ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3832025-01-15T00:39:51.587ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3842025-01-15T00:39:51.587ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3852025-01-15T00:39:51.587ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3862025-01-15T00:39:51.587ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872025-01-15T00:39:51.587ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3882025-01-15T00:39:51.587ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3892025-01-15T00:39:51.622ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3902025-01-15T00:39:51.630ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crypt/zone file = sled-storage/src/dataset.rs:302
3912025-01-15T00:39:51.772ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 file = sled-storage/src/dataset.rs:388
3922025-01-15T00:39:51.779ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4395
3932025-01-15T00:39:51.779ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4474 rack_subnet = fd00:1122:3344::
3942025-01-15T00:39:51.782ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3952025-01-15T00:39:51.782ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3962025-01-15T00:39:51.782ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3972025-01-15T00:39:51.782ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3982025-01-15T00:39:51.782ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3992025-01-15T00:39:51.796ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4002025-01-15T00:39:51.797ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool)
4012025-01-15T00:39:51.890ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }
4022025-01-15T00:39:51.899ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4032025-01-15T00:39:51.899ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4042025-01-15T00:39:51.899ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4052025-01-15T00:39:51.899ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4062025-01-15T00:39:51.899ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4072025-01-15T00:39:51.899ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4082025-01-15T00:39:51.899ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4092025-01-15T00:39:51.936ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4102025-01-15T00:39:51.944ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/zone file = sled-storage/src/dataset.rs:302
4112025-01-15T00:39:52.087ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc file = sled-storage/src/dataset.rs:388
4122025-01-15T00:39:52.095ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4132025-01-15T00:39:52.095ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4142025-01-15T00:39:52.095ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4152025-01-15T00:39:52.095ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4162025-01-15T00:39:52.095ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4172025-01-15T00:39:52.105ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4182025-01-15T00:39:52.105ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool)
4192025-01-15T00:39:52.208ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }
4202025-01-15T00:39:52.216ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4212025-01-15T00:39:52.216ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4222025-01-15T00:39:52.216ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4232025-01-15T00:39:52.216ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4242025-01-15T00:39:52.216ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4252025-01-15T00:39:52.216ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4262025-01-15T00:39:52.216ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4272025-01-15T00:39:52.256ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4282025-01-15T00:39:52.266ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549/crypt/zone file = sled-storage/src/dataset.rs:302
4292025-01-15T00:39:52.368ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) file = sled-agent/src/probe_manager.rs:231 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4302025-01-15T00:39:52.413ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549 file = sled-storage/src/dataset.rs:388
4312025-01-15T00:39:52.421ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4322025-01-15T00:39:52.421ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4332025-01-15T00:39:52.421ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342025-01-15T00:39:52.421ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97ac97c-c7f2-4735-a8b9-e1e9d269dbca (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 994257a3-b79a-47bc-af52-5bd8fbba6493 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4352025-01-15T00:39:52.421ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4362025-01-15T00:39:52.421ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4372025-01-15T00:39:52.421ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4382025-01-15T00:39:52.422ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4392025-01-15T00:39:52.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4402025-01-15T00:39:52.422ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4412025-01-15T00:39:52.422ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4422025-01-15T00:39:52.422ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4432025-01-15T00:39:52.422ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4442025-01-15T00:39:52.422ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4452025-01-15T00:39:52.422ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4462025-01-15T00:39:52.422ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4472025-01-15T00:39:52.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2801029 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60862 req_id = 9b1f932a-bfc5-477a-8959-ec5ce0d9a7eb response_code = 200 uri = /omicron-physical-disks
4482025-01-15T00:39:52.454ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {04505f81-31ec-444d-8137-9240df5f84c3 (dataset): DatasetConfig { id: 04505f81-31ec-444d-8137-9240df5f84c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0867d914-9894-4785-b1f4-bfbcc18f147c (dataset): DatasetConfig { id: 0867d914-9894-4785-b1f4-bfbcc18f147c (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 096e786a-2db8-4fa1-8068-221c6ff2dd69 (dataset): DatasetConfig { id: 096e786a-2db8-4fa1-8068-221c6ff2dd69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c96a935-2cd3-4761-881b-4d79bc0cb07e (dataset): DatasetConfig { id: 0c96a935-2cd3-4761-881b-4d79bc0cb07e (dataset), name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a4a518b-bcda-4d84-9b30-7b51778028e5 (dataset): DatasetConfig { id: 1a4a518b-bcda-4d84-9b30-7b51778028e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1cde95c9-ab0c-4e55-b990-b42c1f1b59c1 (dataset): DatasetConfig { id: 1cde95c9-ab0c-4e55-b990-b42c1f1b59c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f24d8e4-b4c6-4453-952c-1c54e913188b (dataset): DatasetConfig { id: 2f24d8e4-b4c6-4453-952c-1c54e913188b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 373d7883-7364-4637-ab08-161aeb592ab8 (dataset): DatasetConfig { id: 373d7883-7364-4637-ab08-161aeb592ab8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 384a90b7-4158-46b1-9bda-9081c50c207c (dataset): DatasetConfig { id: 384a90b7-4158-46b1-9bda-9081c50c207c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3afb570e-71e1-44b6-b482-d1e2e9bf3239 (dataset): DatasetConfig { id: 3afb570e-71e1-44b6-b482-d1e2e9bf3239 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44ca7fad-d4f0-4d56-a61b-1f3ee609ce4e (dataset): DatasetConfig { id: 44ca7fad-d4f0-4d56-a61b-1f3ee609ce4e (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47c0c8c5-6780-44a0-8b5d-a89aa558a3f6 (dataset): DatasetConfig { id: 47c0c8c5-6780-44a0-8b5d-a89aa558a3f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a2d17b8-490e-4975-b316-5a9dcb33a36f (dataset): DatasetConfig { id: 4a2d17b8-490e-4975-b316-5a9dcb33a36f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f216e57-0310-4550-828e-cff0bb26530b (dataset): DatasetConfig { id: 4f216e57-0310-4550-828e-cff0bb26530b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 504416e3-58be-40b3-aed3-799def8573ad (dataset): DatasetConfig { id: 504416e3-58be-40b3-aed3-799def8573ad (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 505999fe-0821-48b2-9622-8a0ca351cf9a (dataset): DatasetConfig { id: 505999fe-0821-48b2-9622-8a0ca351cf9a (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51926fd9-b5b2-4e13-b1a1-f8f201cbe83e (dataset): DatasetConfig { id: 51926fd9-b5b2-4e13-b1a1-f8f201cbe83e (dataset), name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 526832ec-a37d-42d8-ac37-4f09f6f910c5 (dataset): DatasetConfig { id: 526832ec-a37d-42d8-ac37-4f09f6f910c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 567d2611-0639-4822-b13b-b908a18d3de7 (dataset): DatasetConfig { id: 567d2611-0639-4822-b13b-b908a18d3de7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 578d431b-8ec1-4d19-a229-01efcb5411cc (dataset): DatasetConfig { id: 578d431b-8ec1-4d19-a229-01efcb5411cc (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bb2f4d7-bfd8-465a-a42c-3f4892f99e1d (dataset): DatasetConfig { id: 5bb2f4d7-bfd8-465a-a42c-3f4892f99e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c848d40-3f85-4c2b-81fc-697b028fe21d (dataset): DatasetConfig { id: 5c848d40-3f85-4c2b-81fc-697b028fe21d (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c973d48-65e7-4f97-86c8-8db2af737db5 (dataset): DatasetConfig { id: 5c973d48-65e7-4f97-86c8-8db2af737db5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 620c1b18-6d2b-4410-998b-f23ff01bef67 (dataset): DatasetConfig { id: 620c1b18-6d2b-4410-998b-f23ff01bef67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 673bc95c-39f5-40b4-9770-cf2179b3c48c (dataset): DatasetConfig { id: 673bc95c-39f5-40b4-9770-cf2179b3c48c (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 691ef3b2-03f8-4156-a9fe-fe16ec315a5b (dataset): DatasetConfig { id: 691ef3b2-03f8-4156-a9fe-fe16ec315a5b (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b8efc49-ffbb-4dcf-9238-ed031657138f (dataset): DatasetConfig { id: 6b8efc49-ffbb-4dcf-9238-ed031657138f (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6db19660-6ca1-4076-85dd-e3ad425e342a (dataset): DatasetConfig { id: 6db19660-6ca1-4076-85dd-e3ad425e342a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f07f69f-4e4d-4283-b80a-59e3581cd00f (dataset): DatasetConfig { id: 6f07f69f-4e4d-4283-b80a-59e3581cd00f (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7234f433-55d2-42b5-8155-c8319cdc1bbd (dataset): DatasetConfig { id: 7234f433-55d2-42b5-8155-c8319cdc1bbd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b70926a-ef92-46ca-b6ff-91ff1ed4b9f3 (dataset): DatasetConfig { id: 7b70926a-ef92-46ca-b6ff-91ff1ed4b9f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7d171961-4dbd-43ea-a964-364445d6956c (dataset): DatasetConfig { id: 7d171961-4dbd-43ea-a964-364445d6956c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e263b90-2a23-4d32-b37f-16666f5eca46 (dataset): DatasetConfig { id: 7e263b90-2a23-4d32-b37f-16666f5eca46 (dataset), name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f06b7cb-bb01-4ffc-9914-925693a0ae08 (dataset): DatasetConfig { id: 7f06b7cb-bb01-4ffc-9914-925693a0ae08 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81dde534-82b2-412a-8ff6-b3780aeccf58 (dataset): DatasetConfig { id: 81dde534-82b2-412a-8ff6-b3780aeccf58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 851e91b9-2952-4c03-b742-7ae48ede8410 (dataset): DatasetConfig { id: 851e91b9-2952-4c03-b742-7ae48ede8410 (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e5a8a3e-92a5-460b-9753-5bcb24df8f38 (dataset): DatasetConfig { id: 8e5a8a3e-92a5-460b-9753-5bcb24df8f38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91bed264-59af-433f-953d-438ce3d1b615 (dataset): DatasetConfig { id: 91bed264-59af-433f-953d-438ce3d1b615 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 941ca0c7-a8d5-4332-8835-322d996c20c4 (dataset): DatasetConfig { id: 941ca0c7-a8d5-4332-8835-322d996c20c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 962fbb36-405c-4a68-b9c6-c9a659f8da2e (dataset): DatasetConfig { id: 962fbb36-405c-4a68-b9c6-c9a659f8da2e (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98d30871-5a23-4fe6-b0cd-418885868481 (dataset): DatasetConfig { id: 98d30871-5a23-4fe6-b0cd-418885868481 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9922d103-0629-4df1-b80f-36910a85f7ae (dataset): DatasetConfig { id: 9922d103-0629-4df1-b80f-36910a85f7ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c56f4c3-158f-429d-941d-e0754d8ad011 (dataset): DatasetConfig { id: 9c56f4c3-158f-429d-941d-e0754d8ad011 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c9a084c-e91a-430a-bb7d-9b7219b0d0a5 (dataset): DatasetConfig { id: 9c9a084c-e91a-430a-bb7d-9b7219b0d0a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e5594e7-998b-40cd-ad97-5ddaff8f5455 (dataset): DatasetConfig { id: 9e5594e7-998b-40cd-ad97-5ddaff8f5455 (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0953258-c0b4-44ab-94a1-b2bfd35be799 (dataset): DatasetConfig { id: a0953258-c0b4-44ab-94a1-b2bfd35be799 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a72d3290-a4d3-4c50-b65c-5fe8d9360a54 (dataset): DatasetConfig { id: a72d3290-a4d3-4c50-b65c-5fe8d9360a54 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa2e9bd3-3199-40f8-89e1-b0582f627d4d (dataset): DatasetConfig { id: aa2e9bd3-3199-40f8-89e1-b0582f627d4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ade6445a-0875-4a1a-9745-832f1b22cce3 (dataset): DatasetConfig { id: ade6445a-0875-4a1a-9745-832f1b22cce3 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d44d3e-60e4-476c-8d24-cb0760319b22 (dataset): DatasetConfig { id: b6d44d3e-60e4-476c-8d24-cb0760319b22 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb230730-d1fe-40ed-b2ee-3bee9ed5d9d8 (dataset): DatasetConfig { id: bb230730-d1fe-40ed-b2ee-3bee9ed5d9d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c59f37bf-c51e-41ae-9f60-542d0104dca9 (dataset): DatasetConfig { id: c59f37bf-c51e-41ae-9f60-542d0104dca9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5d6a367-088e-4ff9-b1dd-e94f3f31550b (dataset): DatasetConfig { id: c5d6a367-088e-4ff9-b1dd-e94f3f31550b (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c615aabc-658f-4731-9ed9-4b2ca335b967 (dataset): DatasetConfig { id: c615aabc-658f-4731-9ed9-4b2ca335b967 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce55feb7-8827-4137-8a89-400676613d32 (dataset): DatasetConfig { id: ce55feb7-8827-4137-8a89-400676613d32 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d0152965-f6ac-425b-a29a-40a27a7c948e (dataset): DatasetConfig { id: d0152965-f6ac-425b-a29a-40a27a7c948e (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1775ce6-bca6-4e1f-b10c-b66255e7f889 (dataset): DatasetConfig { id: d1775ce6-bca6-4e1f-b10c-b66255e7f889 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d364546f-5056-46ad-b242-192b571840e6 (dataset): DatasetConfig { id: d364546f-5056-46ad-b242-192b571840e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d671d751-cd42-4378-bf2d-c9483e817f0b (dataset): DatasetConfig { id: d671d751-cd42-4378-bf2d-c9483e817f0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2daa0fc-1314-424d-99b2-2c24c18582ab (dataset): DatasetConfig { id: e2daa0fc-1314-424d-99b2-2c24c18582ab (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4142d32-4e64-4dc9-b09f-8752a62fb9ef (dataset): DatasetConfig { id: e4142d32-4e64-4dc9-b09f-8752a62fb9ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb6fd08b-533c-471d-9454-96e77a5604bf (dataset): DatasetConfig { id: eb6fd08b-533c-471d-9454-96e77a5604bf (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed142877-5ea8-4f14-a92d-db0f079789c2 (dataset): DatasetConfig { id: ed142877-5ea8-4f14-a92d-db0f079789c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ed31628c-b2a9-42f0-a093-6d17d3f96182 (dataset): DatasetConfig { id: ed31628c-b2a9-42f0-a093-6d17d3f96182 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffc87cdb-d75e-4d62-b1f2-6c6bd9783198 (dataset): DatasetConfig { id: ffc87cdb-d75e-4d62-b1f2-6c6bd9783198 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffe52f05-83cd-4de3-b064-dcb847b0bdd1 (dataset): DatasetConfig { id: ffe52f05-83cd-4de3-b064-dcb847b0bdd1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4492025-01-15T00:39:52.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38814
4502025-01-15T00:39:52.454ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4512025-01-15T00:39:52.454ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {04505f81-31ec-444d-8137-9240df5f84c3 (dataset): DatasetConfig { id: 04505f81-31ec-444d-8137-9240df5f84c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0867d914-9894-4785-b1f4-bfbcc18f147c (dataset): DatasetConfig { id: 0867d914-9894-4785-b1f4-bfbcc18f147c (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 096e786a-2db8-4fa1-8068-221c6ff2dd69 (dataset): DatasetConfig { id: 096e786a-2db8-4fa1-8068-221c6ff2dd69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c96a935-2cd3-4761-881b-4d79bc0cb07e (dataset): DatasetConfig { id: 0c96a935-2cd3-4761-881b-4d79bc0cb07e (dataset), name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a4a518b-bcda-4d84-9b30-7b51778028e5 (dataset): DatasetConfig { id: 1a4a518b-bcda-4d84-9b30-7b51778028e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1cde95c9-ab0c-4e55-b990-b42c1f1b59c1 (dataset): DatasetConfig { id: 1cde95c9-ab0c-4e55-b990-b42c1f1b59c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f24d8e4-b4c6-4453-952c-1c54e913188b (dataset): DatasetConfig { id: 2f24d8e4-b4c6-4453-952c-1c54e913188b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 373d7883-7364-4637-ab08-161aeb592ab8 (dataset): DatasetConfig { id: 373d7883-7364-4637-ab08-161aeb592ab8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 384a90b7-4158-46b1-9bda-9081c50c207c (dataset): DatasetConfig { id: 384a90b7-4158-46b1-9bda-9081c50c207c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3afb570e-71e1-44b6-b482-d1e2e9bf3239 (dataset): DatasetConfig { id: 3afb570e-71e1-44b6-b482-d1e2e9bf3239 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44ca7fad-d4f0-4d56-a61b-1f3ee609ce4e (dataset): DatasetConfig { id: 44ca7fad-d4f0-4d56-a61b-1f3ee609ce4e (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47c0c8c5-6780-44a0-8b5d-a89aa558a3f6 (dataset): DatasetConfig { id: 47c0c8c5-6780-44a0-8b5d-a89aa558a3f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a2d17b8-490e-4975-b316-5a9dcb33a36f (dataset): DatasetConfig { id: 4a2d17b8-490e-4975-b316-5a9dcb33a36f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f216e57-0310-4550-828e-cff0bb26530b (dataset): DatasetConfig { id: 4f216e57-0310-4550-828e-cff0bb26530b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 504416e3-58be-40b3-aed3-799def8573ad (dataset): DatasetConfig { id: 504416e3-58be-40b3-aed3-799def8573ad (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 505999fe-0821-48b2-9622-8a0ca351cf9a (dataset): DatasetConfig { id: 505999fe-0821-48b2-9622-8a0ca351cf9a (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51926fd9-b5b2-4e13-b1a1-f8f201cbe83e (dataset): DatasetConfig { id: 51926fd9-b5b2-4e13-b1a1-f8f201cbe83e (dataset), name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 526832ec-a37d-42d8-ac37-4f09f6f910c5 (dataset): DatasetConfig { id: 526832ec-a37d-42d8-ac37-4f09f6f910c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 567d2611-0639-4822-b13b-b908a18d3de7 (dataset): DatasetConfig { id: 567d2611-0639-4822-b13b-b908a18d3de7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 578d431b-8ec1-4d19-a229-01efcb5411cc (dataset): DatasetConfig { id: 578d431b-8ec1-4d19-a229-01efcb5411cc (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bb2f4d7-bfd8-465a-a42c-3f4892f99e1d (dataset): DatasetConfig { id: 5bb2f4d7-bfd8-465a-a42c-3f4892f99e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c848d40-3f85-4c2b-81fc-697b028fe21d (dataset): DatasetConfig { id: 5c848d40-3f85-4c2b-81fc-697b028fe21d (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c973d48-65e7-4f97-86c8-8db2af737db5 (dataset): DatasetConfig { id: 5c973d48-65e7-4f97-86c8-8db2af737db5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 620c1b18-6d2b-4410-998b-f23ff01bef67 (dataset): DatasetConfig { id: 620c1b18-6d2b-4410-998b-f23ff01bef67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 673bc95c-39f5-40b4-9770-cf2179b3c48c (dataset): DatasetConfig { id: 673bc95c-39f5-40b4-9770-cf2179b3c48c (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 691ef3b2-03f8-4156-a9fe-fe16ec315a5b (dataset): DatasetConfig { id: 691ef3b2-03f8-4156-a9fe-fe16ec315a5b (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b8efc49-ffbb-4dcf-9238-ed031657138f (dataset): DatasetConfig { id: 6b8efc49-ffbb-4dcf-9238-ed031657138f (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6db19660-6ca1-4076-85dd-e3ad425e342a (dataset): DatasetConfig { id: 6db19660-6ca1-4076-85dd-e3ad425e342a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f07f69f-4e4d-4283-b80a-59e3581cd00f (dataset): DatasetConfig { id: 6f07f69f-4e4d-4283-b80a-59e3581cd00f (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7234f433-55d2-42b5-8155-c8319cdc1bbd (dataset): DatasetConfig { id: 7234f433-55d2-42b5-8155-c8319cdc1bbd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b70926a-ef92-46ca-b6ff-91ff1ed4b9f3 (dataset): DatasetConfig { id: 7b70926a-ef92-46ca-b6ff-91ff1ed4b9f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7d171961-4dbd-43ea-a964-364445d6956c (dataset): DatasetConfig { id: 7d171961-4dbd-43ea-a964-364445d6956c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e263b90-2a23-4d32-b37f-16666f5eca46 (dataset): DatasetConfig { id: 7e263b90-2a23-4d32-b37f-16666f5eca46 (dataset), name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7f06b7cb-bb01-4ffc-9914-925693a0ae08 (dataset): DatasetConfig { id: 7f06b7cb-bb01-4ffc-9914-925693a0ae08 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81dde534-82b2-412a-8ff6-b3780aeccf58 (dataset): DatasetConfig { id: 81dde534-82b2-412a-8ff6-b3780aeccf58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 851e91b9-2952-4c03-b742-7ae48ede8410 (dataset): DatasetConfig { id: 851e91b9-2952-4c03-b742-7ae48ede8410 (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e5a8a3e-92a5-460b-9753-5bcb24df8f38 (dataset): DatasetConfig { id: 8e5a8a3e-92a5-460b-9753-5bcb24df8f38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91bed264-59af-433f-953d-438ce3d1b615 (dataset): DatasetConfig { id: 91bed264-59af-433f-953d-438ce3d1b615 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 941ca0c7-a8d5-4332-8835-322d996c20c4 (dataset): DatasetConfig { id: 941ca0c7-a8d5-4332-8835-322d996c20c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 962fbb36-405c-4a68-b9c6-c9a659f8da2e (dataset): DatasetConfig { id: 962fbb36-405c-4a68-b9c6-c9a659f8da2e (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98d30871-5a23-4fe6-b0cd-418885868481 (dataset): DatasetConfig { id: 98d30871-5a23-4fe6-b0cd-418885868481 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9922d103-0629-4df1-b80f-36910a85f7ae (dataset): DatasetConfig { id: 9922d103-0629-4df1-b80f-36910a85f7ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c56f4c3-158f-429d-941d-e0754d8ad011 (dataset): DatasetConfig { id: 9c56f4c3-158f-429d-941d-e0754d8ad011 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c9a084c-e91a-430a-bb7d-9b7219b0d0a5 (dataset): DatasetConfig { id: 9c9a084c-e91a-430a-bb7d-9b7219b0d0a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e5594e7-998b-40cd-ad97-5ddaff8f5455 (dataset): DatasetConfig { id: 9e5594e7-998b-40cd-ad97-5ddaff8f5455 (dataset), name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0953258-c0b4-44ab-94a1-b2bfd35be799 (dataset): DatasetConfig { id: a0953258-c0b4-44ab-94a1-b2bfd35be799 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a72d3290-a4d3-4c50-b65c-5fe8d9360a54 (dataset): DatasetConfig { id: a72d3290-a4d3-4c50-b65c-5fe8d9360a54 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa2e9bd3-3199-40f8-89e1-b0582f627d4d (dataset): DatasetConfig { id: aa2e9bd3-3199-40f8-89e1-b0582f627d4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ade6445a-0875-4a1a-9745-832f1b22cce3 (dataset): DatasetConfig { id: ade6445a-0875-4a1a-9745-832f1b22cce3 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d44d3e-60e4-476c-8d24-cb0760319b22 (dataset): DatasetConfig { id: b6d44d3e-60e4-476c-8d24-cb0760319b22 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb230730-d1fe-40ed-b2ee-3bee9ed5d9d8 (dataset): DatasetConfig { id: bb230730-d1fe-40ed-b2ee-3bee9ed5d9d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c59f37bf-c51e-41ae-9f60-542d0104dca9 (dataset): DatasetConfig { id: c59f37bf-c51e-41ae-9f60-542d0104dca9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5d6a367-088e-4ff9-b1dd-e94f3f31550b (dataset): DatasetConfig { id: c5d6a367-088e-4ff9-b1dd-e94f3f31550b (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c615aabc-658f-4731-9ed9-4b2ca335b967 (dataset): DatasetConfig { id: c615aabc-658f-4731-9ed9-4b2ca335b967 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce55feb7-8827-4137-8a89-400676613d32 (dataset): DatasetConfig { id: ce55feb7-8827-4137-8a89-400676613d32 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d0152965-f6ac-425b-a29a-40a27a7c948e (dataset): DatasetConfig { id: d0152965-f6ac-425b-a29a-40a27a7c948e (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1775ce6-bca6-4e1f-b10c-b66255e7f889 (dataset): DatasetConfig { id: d1775ce6-bca6-4e1f-b10c-b66255e7f889 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d364546f-5056-46ad-b242-192b571840e6 (dataset): DatasetConfig { id: d364546f-5056-46ad-b242-192b571840e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d671d751-cd42-4378-bf2d-c9483e817f0b (dataset): DatasetConfig { id: d671d751-cd42-4378-bf2d-c9483e817f0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2daa0fc-1314-424d-99b2-2c24c18582ab (dataset): DatasetConfig { id: e2daa0fc-1314-424d-99b2-2c24c18582ab (dataset), name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4142d32-4e64-4dc9-b09f-8752a62fb9ef (dataset): DatasetConfig { id: e4142d32-4e64-4dc9-b09f-8752a62fb9ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb6fd08b-533c-471d-9454-96e77a5604bf (dataset): DatasetConfig { id: eb6fd08b-533c-471d-9454-96e77a5604bf (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed142877-5ea8-4f14-a92d-db0f079789c2 (dataset): DatasetConfig { id: ed142877-5ea8-4f14-a92d-db0f079789c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ed31628c-b2a9-42f0-a093-6d17d3f96182 (dataset): DatasetConfig { id: ed31628c-b2a9-42f0-a093-6d17d3f96182 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffc87cdb-d75e-4d62-b1f2-6c6bd9783198 (dataset): DatasetConfig { id: ffc87cdb-d75e-4d62-b1f2-6c6bd9783198 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffe52f05-83cd-4de3-b064-dcb847b0bdd1 (dataset): DatasetConfig { id: ffe52f05-83cd-4de3-b064-dcb847b0bdd1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4522025-01-15T00:39:52.454ZINFOSledAgent (StorageManager): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4532025-01-15T00:39:52.454ZINFOSledAgent (StorageManager): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4542025-01-15T00:39:52.454ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4552025-01-15T00:39:52.470ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-01-15T00:39:52.470ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4572025-01-15T00:39:52.470ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549/crucible" } file = sled-storage/src/manager.rs:1431
4582025-01-15T00:39:52.518ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-01-15T00:39:52.518ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602025-01-15T00:39:52.518ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4612025-01-15T00:39:52.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-15T00:39:52.569ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-01-15T00:39:52.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/zone/oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5"), full_name: "oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/zone/oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5" } file = sled-storage/src/manager.rs:1431
4642025-01-15T00:39:52.629ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-01-15T00:39:52.629ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-01-15T00:39:52.629ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crypt/zone/oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49"), full_name: "oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crypt/zone/oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49" } file = sled-storage/src/manager.rs:1431
4672025-01-15T00:39:52.688ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-15T00:39:52.688ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-01-15T00:39:52.688ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3131655f-f0d6-4fd3-bf28-70e12f0bf549/crypt/zone/oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929"), full_name: "oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549/crypt/zone/oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929" } file = sled-storage/src/manager.rs:1431
4702025-01-15T00:39:52.747ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-15T00:39:52.747ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722025-01-15T00:39:52.747ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone/oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746"), full_name: "oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone/oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746" } file = sled-storage/src/manager.rs:1431
4732025-01-15T00:39:52.802ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-15T00:39:52.802ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752025-01-15T00:39:52.802ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/zone/oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), full_name: "oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/zone/oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85" } file = sled-storage/src/manager.rs:1431
4762025-01-15T00:39:52.858ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-15T00:39:52.858ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-01-15T00:39:52.858ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crucible" } file = sled-storage/src/manager.rs:1431
4792025-01-15T00:39:52.906ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-01-15T00:39:52.906ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-01-15T00:39:52.906ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4/crucible" } file = sled-storage/src/manager.rs:1431
4822025-01-15T00:39:52.952ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-01-15T00:39:52.952ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842025-01-15T00:39:52.952ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4852025-01-15T00:39:53.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-01-15T00:39:53.001ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872025-01-15T00:39:53.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e927d854-d6fd-4606-baca-3874882eccd4/crypt/zone/oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1"), full_name: "oxp_e927d854-d6fd-4606-baca-3874882eccd4/crypt/zone/oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1" } file = sled-storage/src/manager.rs:1431
4882025-01-15T00:39:53.060ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-01-15T00:39:53.061ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902025-01-15T00:39:53.061ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5" } file = sled-storage/src/manager.rs:1431
4912025-01-15T00:39:53.121ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-01-15T00:39:53.121ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4932025-01-15T00:39:53.121ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/debug"), full_name: "oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/debug" } file = sled-storage/src/manager.rs:1431
4942025-01-15T00:39:53.149ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-01-15T00:39:53.149ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-01-15T00:39:53.149ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/zone/oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56"), full_name: "oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/zone/oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56" } file = sled-storage/src/manager.rs:1431
4972025-01-15T00:39:53.210ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-01-15T00:39:53.210ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992025-01-15T00:39:53.210ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e927d854-d6fd-4606-baca-3874882eccd4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5002025-01-15T00:39:53.258ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-01-15T00:39:53.258ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5022025-01-15T00:39:53.258ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/zone"), full_name: "oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/zone" } file = sled-storage/src/manager.rs:1431
5032025-01-15T00:39:53.288ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-01-15T00:39:53.288ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5052025-01-15T00:39:53.288ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crypt/zone"), full_name: "oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crypt/zone" } file = sled-storage/src/manager.rs:1431
5062025-01-15T00:39:53.316ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-01-15T00:39:53.316ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-01-15T00:39:53.316ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crucible" } file = sled-storage/src/manager.rs:1431
5092025-01-15T00:39:53.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-01-15T00:39:53.363ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5112025-01-15T00:39:53.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone" } file = sled-storage/src/manager.rs:1431
5122025-01-15T00:39:53.370ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) file = sled-agent/src/probe_manager.rs:231 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
5132025-01-15T00:39:53.391ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-01-15T00:39:53.391ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152025-01-15T00:39:53.391ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e927d854-d6fd-4606-baca-3874882eccd4/crucible" } file = sled-storage/src/manager.rs:1431
5162025-01-15T00:39:53.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-01-15T00:39:53.438ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5182025-01-15T00:39:53.438ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c" } file = sled-storage/src/manager.rs:1431
5192025-01-15T00:39:53.499ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-01-15T00:39:53.499ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5212025-01-15T00:39:53.499ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5222025-01-15T00:39:53.548ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-15T00:39:53.548ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-01-15T00:39:53.548ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/zone/oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678"), full_name: "oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/zone/oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678" } file = sled-storage/src/manager.rs:1431
5252025-01-15T00:39:53.605ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-01-15T00:39:53.605ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5272025-01-15T00:39:53.605ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c" } file = sled-storage/src/manager.rs:1431
5282025-01-15T00:39:53.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-01-15T00:39:53.664ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5302025-01-15T00:39:53.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/debug"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/debug" } file = sled-storage/src/manager.rs:1431
5312025-01-15T00:39:53.692ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-01-15T00:39:53.692ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5332025-01-15T00:39:53.692ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e927d854-d6fd-4606-baca-3874882eccd4/crypt/zone"), full_name: "oxp_e927d854-d6fd-4606-baca-3874882eccd4/crypt/zone" } file = sled-storage/src/manager.rs:1431
5342025-01-15T00:39:53.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-15T00:39:53.722ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-01-15T00:39:53.722ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone/oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone/oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa" } file = sled-storage/src/manager.rs:1431
5372025-01-15T00:39:53.785ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-15T00:39:53.785ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392025-01-15T00:39:53.785ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5402025-01-15T00:39:53.804ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4485
5412025-01-15T00:39:53.804ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4527
5422025-01-15T00:39:53.832ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5432025-01-15T00:39:53.832ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5442025-01-15T00:39:53.832ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone/oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone/oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0" } file = sled-storage/src/manager.rs:1431
5452025-01-15T00:39:53.887ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5462025-01-15T00:39:53.887ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5472025-01-15T00:39:53.887ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/debug"), full_name: "oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/debug" } file = sled-storage/src/manager.rs:1431
5482025-01-15T00:39:53.915ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492025-01-15T00:39:53.916ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5502025-01-15T00:39:53.916ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/debug"), full_name: "oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/debug" } file = sled-storage/src/manager.rs:1431
5512025-01-15T00:39:53.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522025-01-15T00:39:53.943ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5532025-01-15T00:39:53.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/zone/oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d"), full_name: "oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/zone/oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d" } file = sled-storage/src/manager.rs:1431
5542025-01-15T00:39:54.000ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552025-01-15T00:39:54.000ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5562025-01-15T00:39:54.000ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crypt/debug"), full_name: "oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crypt/debug" } file = sled-storage/src/manager.rs:1431
5572025-01-15T00:39:54.028ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582025-01-15T00:39:54.028ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5592025-01-15T00:39:54.028ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5602025-01-15T00:39:54.074ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612025-01-15T00:39:54.074ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5622025-01-15T00:39:54.074ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/debug"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/debug" } file = sled-storage/src/manager.rs:1431
5632025-01-15T00:39:54.101ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642025-01-15T00:39:54.101ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652025-01-15T00:39:54.101ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e927d854-d6fd-4606-baca-3874882eccd4/crypt/zone/oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4"), full_name: "oxp_e927d854-d6fd-4606-baca-3874882eccd4/crypt/zone/oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4" } file = sled-storage/src/manager.rs:1431
5662025-01-15T00:39:54.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672025-01-15T00:39:54.156ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682025-01-15T00:39:54.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/zone/oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b"), full_name: "oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/zone/oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b" } file = sled-storage/src/manager.rs:1431
5692025-01-15T00:39:54.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702025-01-15T00:39:54.212ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712025-01-15T00:39:54.212ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5722025-01-15T00:39:54.258ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732025-01-15T00:39:54.258ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742025-01-15T00:39:54.258ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6" } file = sled-storage/src/manager.rs:1431
5752025-01-15T00:39:54.314ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762025-01-15T00:39:54.314ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5772025-01-15T00:39:54.314ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crucible" } file = sled-storage/src/manager.rs:1431
5782025-01-15T00:39:54.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-01-15T00:39:54.361ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802025-01-15T00:39:54.361ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/zone/oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002"), full_name: "oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/zone/oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002" } file = sled-storage/src/manager.rs:1431
5812025-01-15T00:39:54.372ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) file = sled-agent/src/probe_manager.rs:231 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
5822025-01-15T00:39:54.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-01-15T00:39:54.416ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5842025-01-15T00:39:54.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/zone"), full_name: "oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/zone" } file = sled-storage/src/manager.rs:1431
5852025-01-15T00:39:54.444ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-01-15T00:39:54.444ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872025-01-15T00:39:54.444ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone/oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9"), full_name: "oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone/oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9" } file = sled-storage/src/manager.rs:1431
5882025-01-15T00:39:54.498ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-01-15T00:39:54.498ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5902025-01-15T00:39:54.498ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/zone/oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c"), full_name: "oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/zone/oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c" } file = sled-storage/src/manager.rs:1431
5912025-01-15T00:39:54.553ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922025-01-15T00:39:54.553ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5932025-01-15T00:39:54.553ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc/crucible" } file = sled-storage/src/manager.rs:1431
5942025-01-15T00:39:54.597ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952025-01-15T00:39:54.597ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962025-01-15T00:39:54.597ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone/oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone/oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8" } file = sled-storage/src/manager.rs:1431
5972025-01-15T00:39:54.651ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982025-01-15T00:39:54.651ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5992025-01-15T00:39:54.651ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone/oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8"), full_name: "oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone/oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8" } file = sled-storage/src/manager.rs:1431
6002025-01-15T00:39:54.706ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012025-01-15T00:39:54.706ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022025-01-15T00:39:54.706ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac" } file = sled-storage/src/manager.rs:1431
6032025-01-15T00:39:54.763ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042025-01-15T00:39:54.763ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6052025-01-15T00:39:54.763ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone/oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09"), full_name: "oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone/oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09" } file = sled-storage/src/manager.rs:1431
6062025-01-15T00:39:54.818ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072025-01-15T00:39:54.818ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082025-01-15T00:39:54.818ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6092025-01-15T00:39:54.865ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102025-01-15T00:39:54.865ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6112025-01-15T00:39:54.865ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone"), full_name: "oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crypt/zone" } file = sled-storage/src/manager.rs:1431
6122025-01-15T00:39:54.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-01-15T00:39:54.891ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6142025-01-15T00:39:54.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a6ee976a-8413-4b79-86fd-0416e935e722/crypt/debug"), full_name: "oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crypt/debug" } file = sled-storage/src/manager.rs:1431
6152025-01-15T00:39:54.918ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-01-15T00:39:54.918ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6172025-01-15T00:39:54.918ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone" } file = sled-storage/src/manager.rs:1431
6182025-01-15T00:39:54.945ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-01-15T00:39:54.945ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6202025-01-15T00:39:54.945ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3131655f-f0d6-4fd3-bf28-70e12f0bf549/crypt/zone"), full_name: "oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549/crypt/zone" } file = sled-storage/src/manager.rs:1431
6212025-01-15T00:39:54.972ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-01-15T00:39:54.972ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6232025-01-15T00:39:54.972ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3131655f-f0d6-4fd3-bf28-70e12f0bf549/crypt/debug"), full_name: "oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549/crypt/debug" } file = sled-storage/src/manager.rs:1431
6242025-01-15T00:39:55.000ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-01-15T00:39:55.000ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262025-01-15T00:39:55.000ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crucible" } file = sled-storage/src/manager.rs:1431
6272025-01-15T00:39:55.045ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282025-01-15T00:39:55.045ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292025-01-15T00:39:55.045ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6302025-01-15T00:39:55.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-01-15T00:39:55.090ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6322025-01-15T00:39:55.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crucible" } file = sled-storage/src/manager.rs:1431
6332025-01-15T00:39:55.135ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342025-01-15T00:39:55.135ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352025-01-15T00:39:55.135ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f" } file = sled-storage/src/manager.rs:1431
6362025-01-15T00:39:55.190ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372025-01-15T00:39:55.191ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382025-01-15T00:39:55.191ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6392025-01-15T00:39:55.236ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402025-01-15T00:39:55.236ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412025-01-15T00:39:55.236ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6422025-01-15T00:39:55.281ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432025-01-15T00:39:55.281ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442025-01-15T00:39:55.281ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e927d854-d6fd-4606-baca-3874882eccd4/crypt/zone/oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea"), full_name: "oxp_e927d854-d6fd-4606-baca-3874882eccd4/crypt/zone/oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea" } file = sled-storage/src/manager.rs:1431
6452025-01-15T00:39:55.338ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462025-01-15T00:39:55.338ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6472025-01-15T00:39:55.338ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e927d854-d6fd-4606-baca-3874882eccd4/crypt/debug"), full_name: "oxp_e927d854-d6fd-4606-baca-3874882eccd4/crypt/debug" } file = sled-storage/src/manager.rs:1431
6482025-01-15T00:39:55.366ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6492025-01-15T00:39:55.366ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6502025-01-15T00:39:55.366ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone/oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55"), full_name: "oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/zone/oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55" } file = sled-storage/src/manager.rs:1431
6512025-01-15T00:39:55.375ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) file = sled-agent/src/probe_manager.rs:231 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6522025-01-15T00:39:55.427ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6532025-01-15T00:39:55.427ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6542025-01-15T00:39:55.427ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/zone"), full_name: "oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/zone" } file = sled-storage/src/manager.rs:1431
6552025-01-15T00:39:55.455ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6562025-01-15T00:39:55.455ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6572025-01-15T00:39:55.455ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd"), full_name: "oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/zone/oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd" } file = sled-storage/src/manager.rs:1431
6582025-01-15T00:39:55.517ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6592025-01-15T00:39:55.518ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6602025-01-15T00:39:55.518ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6612025-01-15T00:39:55.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3064276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38814 req_id = 454068a6-7216-466c-8fc1-448cd39879b2 response_code = 200 uri = /datasets
6622025-01-15T00:39:55.542ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 22.774863373s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6632025-01-15T00:39:55.550ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 40ae34f1-1e3b-45ab-8bbd-332390cbbebd (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ca7cda21-9b20-4e26-b219-943f968e7f55 (service), filesystem_pool: Some(ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 794b81d3-84d4-414f-8833-aa968fe812f9 (service), filesystem_pool: Some(ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6642025-01-15T00:39:55.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53628
6652025-01-15T00:39:55.551ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6662025-01-15T00:39:55.551ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6672025-01-15T00:39:55.560ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6682025-01-15T00:39:55.560ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6692025-01-15T00:39:55.569ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6702025-01-15T00:39:55.569ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6712025-01-15T00:39:55.576ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-01-15T00:39:55.576ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:188
6732025-01-15T00:39:55.576ZINFOSledAgent (ServiceManager): No ledger in /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:188
6742025-01-15T00:39:55.576ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6752025-01-15T00:39:55.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6762025-01-15T00:39:55.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6772025-01-15T00:39:55.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6782025-01-15T00:39:55.671ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd file = illumos-utils/src/zone.rs:325
6792025-01-15T00:39:55.675ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55 file = illumos-utils/src/zone.rs:325
6802025-01-15T00:39:55.679ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9 file = illumos-utils/src/zone.rs:325
6812025-01-15T00:39:55.691ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd file = illumos-utils/src/zone.rs:363
6822025-01-15T00:39:55.695ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55 file = illumos-utils/src/zone.rs:363
6832025-01-15T00:39:55.699ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9 file = illumos-utils/src/zone.rs:363
6842025-01-15T00:39:56.377ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) file = sled-agent/src/probe_manager.rs:231 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6852025-01-15T00:39:57.276ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6862025-01-15T00:39:57.276ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6872025-01-15T00:39:57.276ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
6882025-01-15T00:39:57.762ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6892025-01-15T00:39:57.877ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4559
6902025-01-15T00:39:57.877ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4565
6912025-01-15T00:39:57.962ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4606
6922025-01-15T00:39:57.962ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6932025-01-15T00:39:58.111ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7424018342430084307 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6942025-01-15T00:39:58.111ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17934692407794399149 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6952025-01-15T00:39:58.244ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6962025-01-15T00:39:58.244ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6972025-01-15T00:39:58.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9") failed: Property not found. retry in 27.274909ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
6982025-01-15T00:39:58.251ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6992025-01-15T00:39:58.251ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7002025-01-15T00:39:58.255ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7012025-01-15T00:39:58.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9") failed: Property not found. retry in 97.017365ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
7022025-01-15T00:39:58.317ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 43.156972ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
7032025-01-15T00:39:58.361ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 105.12595ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
7042025-01-15T00:39:58.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55") failed: Property not found. retry in 50.536683ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7052025-01-15T00:39:58.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd") failed: Property not found. retry in 39.842446ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7062025-01-15T00:39:58.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9") failed: Property not found. retry in 224.366349ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
7072025-01-15T00:39:58.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd") failed: Property not found. retry in 137.138144ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7082025-01-15T00:39:58.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55") failed: Property not found. retry in 92.244436ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7092025-01-15T00:39:58.474ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7102025-01-15T00:39:58.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55") failed: Property not found. retry in 260.403995ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7112025-01-15T00:39:58.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd") failed: Property not found. retry in 184.656386ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7122025-01-15T00:39:58.613ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7132025-01-15T00:39:58.613ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7142025-01-15T00:39:58.615ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 0
7152025-01-15T00:39:58.615ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7162025-01-15T00:39:58.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9") failed: Property not found. retry in 399.555953ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
7172025-01-15T00:39:58.764ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
7182025-01-15T00:39:58.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd") failed: Property not found. retry in 409.708618ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7192025-01-15T00:39:58.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55") failed: Property not found. retry in 363.196227ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7202025-01-15T00:39:58.887ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7212025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7222025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7232025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7242025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7252025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7262025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7272025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7282025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7292025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7302025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7312025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7322025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7332025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7342025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7352025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7362025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7372025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7382025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7392025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7402025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7412025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7422025-01-15T00:39:58.887ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7432025-01-15T00:39:59.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9") failed: Property not found. retry in 1.149016069s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
7442025-01-15T00:39:59.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55") failed: Property not found. retry in 1.050286435s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7452025-01-15T00:39:59.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd") failed: Property not found. retry in 732.685183ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7462025-01-15T00:39:59.309ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7472025-01-15T00:39:59.309ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7482025-01-15T00:40:00.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd") failed: Property not found. retry in 1.258974529s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7492025-01-15T00:40:00.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55") failed: Property not found. retry in 605.699572ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7502025-01-15T00:40:00.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9") failed: Property not found. retry in 500.999737ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
7512025-01-15T00:40:00.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9") failed: Property not found. retry in 1.250280445s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
7522025-01-15T00:40:00.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55") failed: Property not found. retry in 1.104201288s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7532025-01-15T00:40:01.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd") failed: Property not found. retry in 793.107593ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7542025-01-15T00:40:02.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55") failed: Property not found. retry in 1.017563841s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7552025-01-15T00:40:02.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd") failed: Property not found. retry in 601.261411ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7562025-01-15T00:40:02.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9") failed: Property not found. retry in 1.010700592s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
7572025-01-15T00:40:02.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd") failed: Property not found. retry in 1.479625558s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7582025-01-15T00:40:03.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55") failed: Property not found. retry in 1.359192268s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7592025-01-15T00:40:04.427ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_40ae34f1-1e3b-45ab-8bbd-332390cbbebd
7602025-01-15T00:40:04.427ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_ca7cda21-9b20-4e26-b219-943f968e7f55
7612025-01-15T00:40:04.427ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_794b81d3-84d4-414f-8833-aa968fe812f9
7622025-01-15T00:40:04.427ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7632025-01-15T00:40:04.428ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642025-01-15T00:40:04.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8877619 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53628 req_id = 81505908-4fcb-4433-9f41-6f9b618656e0 response_code = 204 uri = /omicron-zones
7652025-01-15T00:40:04.430ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7662025-01-15T00:40:04.477ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7672025-01-15T00:40:04.524ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7682025-01-15T00:40:04.576ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7692025-01-15T00:40:04.576ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7702025-01-15T00:40:04.608ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7712025-01-15T00:40:04.609ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7722025-01-15T00:40:04.609ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7732025-01-15T00:40:04.638ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 40ae34f1-1e3b-45ab-8bbd-332390cbbebd (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ca7cda21-9b20-4e26-b219-943f968e7f55 (service), filesystem_pool: Some(ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 794b81d3-84d4-414f-8833-aa968fe812f9 (service), filesystem_pool: Some(ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: c2cd76d1-d7ab-4fda-837d-fe37f1284f56 (service), filesystem_pool: Some(ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2437f4c0-8b40-4e21-8aa5-d6ce32769b61, kind: Service { id: c2cd76d1-d7ab-4fda-837d-fe37f1284f56 }, name: Name("ntp-c2cd76d1-d7ab-4fda-837d-fe37f1284f56"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 55])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7742025-01-15T00:40:04.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62303
7752025-01-15T00:40:04.639ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7762025-01-15T00:40:04.639ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7772025-01-15T00:40:04.649ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7782025-01-15T00:40:04.649ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7792025-01-15T00:40:04.659ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802025-01-15T00:40:04.659ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812025-01-15T00:40:04.669ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7822025-01-15T00:40:04.669ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:177
7832025-01-15T00:40:04.669ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:177
7842025-01-15T00:40:04.669ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7852025-01-15T00:40:04.680ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7862025-01-15T00:40:04.712ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7872025-01-15T00:40:04.713ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7882025-01-15T00:40:04.713ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7892025-01-15T00:40:04.744ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 151, 55]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7902025-01-15T00:40:04.744ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = boundary_ntp
7912025-01-15T00:40:04.744ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:85
7922025-01-15T00:40:04.744ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:92
7932025-01-15T00:40:04.744ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:120
7942025-01-15T00:40:04.745ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7952025-01-15T00:40:04.768ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56 file = illumos-utils/src/zone.rs:325
7962025-01-15T00:40:04.787ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56 file = illumos-utils/src/zone.rs:363
7972025-01-15T00:40:05.395ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7982025-01-15T00:40:05.396ZINFOSledAgent (ServiceManager): Booting oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
7992025-01-15T00:40:05.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56") failed: Property not found. retry in 62.190866ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8002025-01-15T00:40:05.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56") failed: Property not found. retry in 128.978315ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8012025-01-15T00:40:05.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56") failed: Property not found. retry in 266.459739ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8022025-01-15T00:40:06.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56") failed: Property not found. retry in 312.029969ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8032025-01-15T00:40:06.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56") failed: Property not found. retry in 835.625726ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8042025-01-15T00:40:07.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56") failed: Property not found. retry in 804.064017ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8052025-01-15T00:40:08.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56") failed: Property not found. retry in 622.717223ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8062025-01-15T00:40:08.113ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7424018342430084307 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8072025-01-15T00:40:08.113ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17934692407794399149 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8082025-01-15T00:40:08.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56") failed: Property not found. retry in 946.633255ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8092025-01-15T00:40:09.311ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8102025-01-15T00:40:09.311ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8112025-01-15T00:40:09.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56") failed: Property not found. retry in 1.318826821s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8122025-01-15T00:40:10.927ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56
8132025-01-15T00:40:10.927ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8142025-01-15T00:40:10.928ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8152025-01-15T00:40:10.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6289455 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62303 req_id = fd03bca0-1d0c-4d00-a2bd-4d11c4ae66aa response_code = 204 uri = /omicron-zones
8162025-01-15T00:40:10.931ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8172025-01-15T00:40:10.961ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8182025-01-15T00:40:10.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63228
8192025-01-15T00:40:10.970ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8202025-01-15T00:40:10.970ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63228 req_id = db3f5629-d1fd-4a15-a332-0fb4c9b6aec3 response_code = 500 uri = /timesync
8212025-01-15T00:40:10.973ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8222025-01-15T00:40:11.066ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8232025-01-15T00:40:11.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45015
8242025-01-15T00:40:13.133ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4825505651175012519 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8252025-01-15T00:40:14.191ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1206197035503607411 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8262025-01-15T00:40:14.430ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13002189830320924554 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8272025-01-15T00:40:15.076ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8282025-01-15T00:40:15.076ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009910 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45015 req_id = 13a7f1d2-3753-4dfc-a677-ab2c885b3114 response_code = 500 uri = /timesync
8292025-01-15T00:40:15.079ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8302025-01-15T00:40:15.211ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8312025-01-15T00:40:15.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55959
8322025-01-15T00:40:15.220ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c2cd76d1-d7ab-4fda-837d-fe37f1284f56': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8332025-01-15T00:40:15.220ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55959 req_id = df9ca92e-0db7-42fd-aede-5a5dfb26def7 response_code = 500 uri = /timesync
8342025-01-15T00:40:15.223ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8352025-01-15T00:40:15.447ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8362025-01-15T00:40:15.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43007
8372025-01-15T00:40:15.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8947 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43007 req_id = 70dd7947-8900-45e9-92f7-0360aaf37d49 response_code = 200 uri = /timesync
8382025-01-15T00:40:15.459ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8392025-01-15T00:40:15.459ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8402025-01-15T00:40:15.718ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8412025-01-15T00:40:15.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44150
8422025-01-15T00:40:15.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44150 req_id = 80aa3a7f-1bb1-4dc8-9732-f0f43c053727 response_code = 200 uri = /timesync
8432025-01-15T00:40:15.729ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8442025-01-15T00:40:15.729ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8452025-01-15T00:40:16.021ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8462025-01-15T00:40:16.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35725
8472025-01-15T00:40:16.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35725 req_id = 9a39ef64-e24a-45c3-a7ec-248b96c5850a response_code = 200 uri = /timesync
8482025-01-15T00:40:16.034ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8492025-01-15T00:40:16.034ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8502025-01-15T00:40:16.202ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8512025-01-15T00:40:16.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35524
8522025-01-15T00:40:16.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7718 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35524 req_id = b3599b19-1925-42d5-ae1c-42501e4108e2 response_code = 200 uri = /timesync
8532025-01-15T00:40:16.213ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8542025-01-15T00:40:16.213ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8552025-01-15T00:40:16.520ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8562025-01-15T00:40:16.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63812
8572025-01-15T00:40:16.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7970 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63812 req_id = b2763f09-dfaf-4145-ba56-14c0d36c1060 response_code = 200 uri = /timesync
8582025-01-15T00:40:16.531ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8592025-01-15T00:40:16.531ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8602025-01-15T00:40:17.003ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612025-01-15T00:40:17.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48110
8622025-01-15T00:40:17.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48110 req_id = 42c69994-cf1d-4fb2-9bd6-adfe949eff5a response_code = 200 uri = /timesync
8632025-01-15T00:40:17.013ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8642025-01-15T00:40:17.013ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8652025-01-15T00:40:17.290ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8662025-01-15T00:40:17.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43514
8672025-01-15T00:40:17.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8048 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43514 req_id = 86900454-50e1-4be6-bdef-6698dd6459be response_code = 200 uri = /timesync
8682025-01-15T00:40:17.301ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8692025-01-15T00:40:17.301ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8702025-01-15T00:40:17.816ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7424018342430084307 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8712025-01-15T00:40:17.816ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17934692407794399149 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8722025-01-15T00:40:17.964ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8732025-01-15T00:40:17.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39641
8742025-01-15T00:40:17.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9605 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39641 req_id = c58ba05a-ca62-4a6e-941c-0a7c2e6b3cf0 response_code = 200 uri = /timesync
8752025-01-15T00:40:17.978ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8762025-01-15T00:40:17.978ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8772025-01-15T00:40:18.480ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8782025-01-15T00:40:18.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56691
8792025-01-15T00:40:18.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9644 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56691 req_id = c82c90a5-5b75-4b18-9db3-0c14660f4177 response_code = 200 uri = /timesync
8802025-01-15T00:40:18.492ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8812025-01-15T00:40:18.492ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8822025-01-15T00:40:18.997ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8832025-01-15T00:40:18.997ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8842025-01-15T00:40:19.502ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8852025-01-15T00:40:19.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35467
8862025-01-15T00:40:19.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8091 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35467 req_id = 1988c157-3e42-4bc2-8fbd-c3fdd51f8211 response_code = 200 uri = /timesync
8872025-01-15T00:40:19.511ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.47075516 } file = sled-agent/src/rack_setup/service.rs:743
8882025-01-15T00:40:19.511ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8892025-01-15T00:40:20.388ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8902025-01-15T00:40:20.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36454
8912025-01-15T00:40:20.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36454 req_id = 2201b919-eb6e-4b39-bc21-a1e0263ad39b response_code = 200 uri = /timesync
8922025-01-15T00:40:20.399ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.475379467 } file = sled-agent/src/rack_setup/service.rs:743
8932025-01-15T00:40:20.399ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8942025-01-15T00:40:20.616ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 196403998446493633 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8952025-01-15T00:40:20.617ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9408793632506271666 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
8962025-01-15T00:40:21.179ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8972025-01-15T00:40:21.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37049
8982025-01-15T00:40:21.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8468 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37049 req_id = 0790ab5b-708a-448a-85fa-cfe128f213f6 response_code = 200 uri = /timesync
8992025-01-15T00:40:21.190ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.467162937 } file = sled-agent/src/rack_setup/service.rs:743
9002025-01-15T00:40:21.190ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9012025-01-15T00:40:22.399ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9022025-01-15T00:40:22.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49238
9032025-01-15T00:40:22.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8946 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49238 req_id = 53bac8de-7c78-4ab0-a43b-32d4cb178336 response_code = 200 uri = /timesync
9042025-01-15T00:40:22.411ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.464107722 } file = sled-agent/src/rack_setup/service.rs:743
9052025-01-15T00:40:22.411ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9062025-01-15T00:40:22.827ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4825505651175012519 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9072025-01-15T00:40:23.887ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1206197035503607411 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9082025-01-15T00:40:24.126ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13002189830320924554 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9092025-01-15T00:40:24.622ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9102025-01-15T00:40:24.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42835
9112025-01-15T00:40:24.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8491 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42835 req_id = 49eab44e-4186-4513-adb6-e05e8eb627d5 response_code = 200 uri = /timesync
9122025-01-15T00:40:24.635ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901624.7987192, correction: 0.458182871 } file = sled-agent/src/rack_setup/service.rs:743
9132025-01-15T00:40:24.635ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9142025-01-15T00:40:27.197ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9152025-01-15T00:40:27.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40149
9162025-01-15T00:40:27.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8526 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40149 req_id = df35abcd-f074-4685-9d58-f6b8f4ed5d0b response_code = 200 uri = /timesync
9172025-01-15T00:40:27.209ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901626.562025, correction: 0.450900435 } file = sled-agent/src/rack_setup/service.rs:743
9182025-01-15T00:40:27.209ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9192025-01-15T00:40:27.823ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7424018342430084307 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9202025-01-15T00:40:27.823ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17934692407794399149 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9212025-01-15T00:40:28.275ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50555
9222025-01-15T00:40:28.275ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50555 req_id = c2a408f6-718a-4d59-a9d1-6cdce9765a61 response_code = 200 uri = /baseboard
9232025-01-15T00:40:29.023ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9242025-01-15T00:40:29.023ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9252025-01-15T00:40:29.870ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9262025-01-15T00:40:29.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53840
9272025-01-15T00:40:29.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53840 req_id = a7df780b-9bd2-4bcd-b632-b587dc93510a response_code = 200 uri = /timesync
9282025-01-15T00:40:29.882ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901629.8311691, correction: 0.443745613 } file = sled-agent/src/rack_setup/service.rs:743
9292025-01-15T00:40:29.882ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9302025-01-15T00:40:30.646ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 196403998446493633 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9312025-01-15T00:40:30.646ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9408793632506271666 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9322025-01-15T00:40:32.856ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4825505651175012519 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9332025-01-15T00:40:32.924ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9342025-01-15T00:40:32.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59290
9352025-01-15T00:40:32.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8794 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59290 req_id = 5288252e-3f4c-4ced-94e3-a9a99f96409d response_code = 200 uri = /timesync
9362025-01-15T00:40:32.937ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901632.9825678, correction: 0.435519129 } file = sled-agent/src/rack_setup/service.rs:743
9372025-01-15T00:40:32.937ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9382025-01-15T00:40:33.074ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 154.516283ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9392025-01-15T00:40:33.917ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1206197035503607411 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9402025-01-15T00:40:34.154ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13002189830320924554 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9412025-01-15T00:40:36.642ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9422025-01-15T00:40:36.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48426
9432025-01-15T00:40:36.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9082 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48426 req_id = cf4217a8-544b-4599-8624-c14abc0d049f response_code = 200 uri = /timesync
9442025-01-15T00:40:36.655ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901635.8358605, correction: 0.425488532 } file = sled-agent/src/rack_setup/service.rs:743
9452025-01-15T00:40:36.655ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9462025-01-15T00:40:37.852ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7424018342430084307 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9472025-01-15T00:40:37.852ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17934692407794399149 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9482025-01-15T00:40:39.052ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9492025-01-15T00:40:39.052ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9502025-01-15T00:40:40.659ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9512025-01-15T00:40:40.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35774
9522025-01-15T00:40:40.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8865 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35774 req_id = c06326f2-adc5-4dbb-bbf7-1f941403ab1c response_code = 200 uri = /timesync
9532025-01-15T00:40:40.673ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901638.8047082, correction: 0.414647698 } file = sled-agent/src/rack_setup/service.rs:743
9542025-01-15T00:40:40.673ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9552025-01-15T00:40:40.675ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 196403998446493633 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9562025-01-15T00:40:40.675ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9408793632506271666 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9572025-01-15T00:40:42.885ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4825505651175012519 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9582025-01-15T00:40:43.946ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1206197035503607411 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9592025-01-15T00:40:44.183ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13002189830320924554 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9602025-01-15T00:40:44.617ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9612025-01-15T00:40:44.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38838
9622025-01-15T00:40:44.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38838 req_id = 8e2ae9c2-8182-4aa0-a363-5c584217d542 response_code = 200 uri = /timesync
9632025-01-15T00:40:44.629ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901643.025875, correction: 0.403918177 } file = sled-agent/src/rack_setup/service.rs:743
9642025-01-15T00:40:44.629ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9652025-01-15T00:40:47.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7424018342430084307 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9662025-01-15T00:40:47.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17934692407794399149 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9672025-01-15T00:40:48.304ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 643.058722ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9682025-01-15T00:40:49.082ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9692025-01-15T00:40:49.082ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9702025-01-15T00:40:49.349ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9712025-01-15T00:40:49.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63977
9722025-01-15T00:40:49.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8569 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63977 req_id = 4c7f5566-b1f7-4cc3-aed7-5b3c2b2dc72d response_code = 200 uri = /timesync
9732025-01-15T00:40:49.360ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901648.7546017, correction: 0.391179115 } file = sled-agent/src/rack_setup/service.rs:743
9742025-01-15T00:40:49.360ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9752025-01-15T00:40:50.704ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 196403998446493633 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9762025-01-15T00:40:50.704ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9408793632506271666 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9772025-01-15T00:40:52.915ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4825505651175012519 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9782025-01-15T00:40:53.608ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9792025-01-15T00:40:53.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42752
9802025-01-15T00:40:53.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8466 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42752 req_id = b62a9590-24c7-4cff-a202-c0042741ed71 response_code = 200 uri = /timesync
9812025-01-15T00:40:53.618ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901652.7036388, correction: 0.379699081 } file = sled-agent/src/rack_setup/service.rs:743
9822025-01-15T00:40:53.618ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9832025-01-15T00:40:53.975ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1206197035503607411 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9842025-01-15T00:40:54.210ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13002189830320924554 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9852025-01-15T00:40:57.910ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7424018342430084307 reason = Duration(60s) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9862025-01-15T00:40:57.911ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17934692407794399149 reason = Duration(60s) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9872025-01-15T00:40:58.391ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37367
9882025-01-15T00:40:58.391ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37367 req_id = e0b9bfb7-615c-47a7-b3cd-1fef679d4b68 response_code = 200 uri = /baseboard
9892025-01-15T00:40:59.133ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9902025-01-15T00:40:59.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57912
9912025-01-15T00:40:59.137ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9922025-01-15T00:40:59.137ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9932025-01-15T00:40:59.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57912 req_id = d8e1719f-7bd2-45f9-9a9c-229fb7c73891 response_code = 200 uri = /timesync
9942025-01-15T00:40:59.144ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901657.1497407, correction: 0.364793032 } file = sled-agent/src/rack_setup/service.rs:743
9952025-01-15T00:40:59.144ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9962025-01-15T00:41:00.733ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 196403998446493633 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9972025-01-15T00:41:00.733ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9408793632506271666 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9982025-01-15T00:41:02.944ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4825505651175012519 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
9992025-01-15T00:41:04.005ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1206197035503607411 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10002025-01-15T00:41:04.025ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 753.60512ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10012025-01-15T00:41:04.239ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13002189830320924554 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10022025-01-15T00:41:09.166ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10032025-01-15T00:41:09.167ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10042025-01-15T00:41:10.762ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 196403998446493633 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10052025-01-15T00:41:10.762ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9408793632506271666 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10062025-01-15T00:41:11.190ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10072025-01-15T00:41:11.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56177
10082025-01-15T00:41:11.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56177 req_id = 69e20ea1-d42e-44e1-a199-e860ebafccc8 response_code = 200 uri = /timesync
10092025-01-15T00:41:11.202ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901665.174477, correction: 0.332244575 } file = sled-agent/src/rack_setup/service.rs:743
10102025-01-15T00:41:11.202ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10112025-01-15T00:41:12.973ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4825505651175012519 reason = Duration(60s) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10122025-01-15T00:41:14.033ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1206197035503607411 reason = Duration(60s) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10132025-01-15T00:41:14.268ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13002189830320924554 reason = Duration(60s) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10142025-01-15T00:41:17.062ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10152025-01-15T00:41:17.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34992
10162025-01-15T00:41:17.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34992 req_id = 05c85e3e-b773-497a-8de0-158ca9276474 response_code = 200 uri = /timesync
10172025-01-15T00:41:17.075ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901673.164461, correction: 0.316380978 } file = sled-agent/src/rack_setup/service.rs:743
10182025-01-15T00:41:17.075ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10192025-01-15T00:41:19.196ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10202025-01-15T00:41:19.196ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10212025-01-15T00:41:19.857ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.296914834s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10222025-01-15T00:41:20.791ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 196403998446493633 reason = Duration(60s) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10232025-01-15T00:41:20.792ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9408793632506271666 reason = Duration(60s) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10242025-01-15T00:41:28.505ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52748
10252025-01-15T00:41:28.505ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52748 req_id = 6a2c6ae2-711a-4267-81a2-5ef58c0499ee response_code = 200 uri = /baseboard
10262025-01-15T00:41:29.182ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10272025-01-15T00:41:29.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39536
10282025-01-15T00:41:29.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8967 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39536 req_id = 42d8aaef-57b3-4283-ab96-46d3df4e4717 response_code = 200 uri = /timesync
10292025-01-15T00:41:29.194ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901681.124969, correction: 0.283674777 } file = sled-agent/src/rack_setup/service.rs:743
10302025-01-15T00:41:29.194ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10312025-01-15T00:41:29.225ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10322025-01-15T00:41:29.225ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10332025-01-15T00:41:36.233ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.141633886s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10342025-01-15T00:41:39.254ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10352025-01-15T00:41:39.255ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10362025-01-15T00:41:48.403ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10372025-01-15T00:41:48.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43851
10382025-01-15T00:41:48.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43851 req_id = 8dada5f2-7b65-4a91-bdc3-5261793f8d20 response_code = 200 uri = /timesync
10392025-01-15T00:41:48.417ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901705.5806055, correction: 0.231687292 } file = sled-agent/src/rack_setup/service.rs:743
10402025-01-15T00:41:48.417ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10412025-01-15T00:41:49.284ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10422025-01-15T00:41:49.284ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10432025-01-15T00:41:56.466ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.426071257s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10442025-01-15T00:41:58.619ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54701
10452025-01-15T00:41:58.619ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54701 req_id = bd06956e-6c19-4560-996c-2a00c2fd1516 response_code = 200 uri = /baseboard
10462025-01-15T00:41:59.313ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10472025-01-15T00:41:59.313ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10482025-01-15T00:42:05.169ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10492025-01-15T00:42:05.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41304
10502025-01-15T00:42:05.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8526 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41304 req_id = 132059c2-fa2e-425e-819d-95b825a1d778 response_code = 200 uri = /timesync
10512025-01-15T00:42:05.183ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901721.1811914, correction: 0.186415046 } file = sled-agent/src/rack_setup/service.rs:743
10522025-01-15T00:42:05.183ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10532025-01-15T00:42:09.342ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10542025-01-15T00:42:09.343ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10552025-01-15T00:42:19.372ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10562025-01-15T00:42:19.372ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10572025-01-15T00:42:22.998ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 19.237877828s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10582025-01-15T00:42:27.868ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10592025-01-15T00:42:27.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39939
10602025-01-15T00:42:27.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8933 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39939 req_id = dc9b84fa-220e-4121-b0f2-5c8b1bfd74f4 response_code = 200 uri = /timesync
10612025-01-15T00:42:27.882ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901745.4118888, correction: 0.125139043 } file = sled-agent/src/rack_setup/service.rs:743
10622025-01-15T00:42:27.882ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10632025-01-15T00:42:28.734ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48441
10642025-01-15T00:42:28.735ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48441 req_id = c6c1b639-99a2-4bb8-95df-f6b08bfb717e response_code = 200 uri = /baseboard
10652025-01-15T00:42:29.401ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10662025-01-15T00:42:29.401ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10672025-01-15T00:42:39.429ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10682025-01-15T00:42:39.429ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10692025-01-15T00:42:48.877ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10702025-01-15T00:42:48.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43171
10712025-01-15T00:42:48.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43171 req_id = 4db6884d-d352-44f4-9993-66cacd782814 response_code = 200 uri = /timesync
10722025-01-15T00:42:48.890ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901761.975322, correction: 0.068404712 } file = sled-agent/src/rack_setup/service.rs:743
10732025-01-15T00:42:48.890ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10742025-01-15T00:42:49.458ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10752025-01-15T00:42:49.459ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10762025-01-15T00:42:57.363ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 32.660420728s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10772025-01-15T00:42:58.851ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54562
10782025-01-15T00:42:58.851ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54562 req_id = edb68d8b-775e-4745-9f4f-ced6c1f73bd8 response_code = 200 uri = /baseboard
10792025-01-15T00:42:59.488ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10802025-01-15T00:42:59.488ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10812025-01-15T00:43:09.517ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1593436184761117197 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10822025-01-15T00:43:09.517ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17736151827485904276 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10832025-01-15T00:43:15.133ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10842025-01-15T00:43:15.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51204
10852025-01-15T00:43:15.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51204 req_id = 9dd3d09e-5a4e-4768-9201-d788e9b2f0b2 response_code = 200 uri = /timesync
10862025-01-15T00:43:15.158ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-15T00:40:57.911054211Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17934692407794399149 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10872025-01-15T00:43:15.158ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-15T00:41:20.792225087Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9408793632506271666 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10882025-01-15T00:43:15.158ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-15T00:41:20.791896539Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 196403998446493633 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10892025-01-15T00:43:15.158ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-15T00:40:57.910421434Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7424018342430084307 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10902025-01-15T00:43:15.159ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-15T00:41:14.268079273Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13002189830320924554 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10912025-01-15T00:43:15.159ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-15T00:41:14.033903107Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1206197035503607411 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10922025-01-15T00:43:15.159ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-15T00:41:12.973032056Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4825505651175012519 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
10932025-01-15T00:43:15.162ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736901794.0338373, correction: -0.000440075 } file = sled-agent/src/rack_setup/service.rs:743
10942025-01-15T00:43:15.162ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10952025-01-15T00:43:15.193ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 40ae34f1-1e3b-45ab-8bbd-332390cbbebd (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ca7cda21-9b20-4e26-b219-943f968e7f55 (service), filesystem_pool: Some(ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 794b81d3-84d4-414f-8833-aa968fe812f9 (service), filesystem_pool: Some(ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: c2cd76d1-d7ab-4fda-837d-fe37f1284f56 (service), filesystem_pool: Some(ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2437f4c0-8b40-4e21-8aa5-d6ce32769b61, kind: Service { id: c2cd76d1-d7ab-4fda-837d-fe37f1284f56 }, name: Name("ntp-c2cd76d1-d7ab-4fda-837d-fe37f1284f56"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 55])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 86c94a9b-4877-474d-9057-304a69d29bc6 (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8 (service), filesystem_pool: Some(ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40e100e9-e997-4fd2-9d6d-27f4fe9c2746 (service), filesystem_pool: Some(ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External } } } }, OmicronZoneConfig { id: e6c98709-2c51-44be-bc16-326586a6ded4 (service), filesystem_pool: Some(ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 227a1343-8400-4620-95da-a366a25f629b (service), filesystem_pool: Some(ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10962025-01-15T00:43:15.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56547
10972025-01-15T00:43:15.194ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10982025-01-15T00:43:15.194ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10992025-01-15T00:43:15.205ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11002025-01-15T00:43:15.205ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11012025-01-15T00:43:15.215ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11022025-01-15T00:43:15.215ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11032025-01-15T00:43:15.224ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11042025-01-15T00:43:15.224ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11052025-01-15T00:43:15.233ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11062025-01-15T00:43:15.233ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11072025-01-15T00:43:15.242ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11082025-01-15T00:43:15.242ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11092025-01-15T00:43:15.251ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11102025-01-15T00:43:15.251ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11112025-01-15T00:43:15.261ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11122025-01-15T00:43:15.261ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Cockroach }, responder: ... }
11132025-01-15T00:43:15.270ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11142025-01-15T00:43:15.270ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:177
11152025-01-15T00:43:15.270ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:177
11162025-01-15T00:43:15.270ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11172025-01-15T00:43:15.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11182025-01-15T00:43:15.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11192025-01-15T00:43:15.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11202025-01-15T00:43:15.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11212025-01-15T00:43:15.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11222025-01-15T00:43:15.446ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746 file = illumos-utils/src/zone.rs:325
11232025-01-15T00:43:15.451ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b file = illumos-utils/src/zone.rs:325
11242025-01-15T00:43:15.455ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6 file = illumos-utils/src/zone.rs:325
11252025-01-15T00:43:15.460ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8 file = illumos-utils/src/zone.rs:325
11262025-01-15T00:43:15.465ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4 file = illumos-utils/src/zone.rs:325
11272025-01-15T00:43:15.469ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746 file = illumos-utils/src/zone.rs:363
11282025-01-15T00:43:15.474ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b file = illumos-utils/src/zone.rs:363
11292025-01-15T00:43:15.478ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6 file = illumos-utils/src/zone.rs:363
11302025-01-15T00:43:15.483ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8 file = illumos-utils/src/zone.rs:363
11312025-01-15T00:43:15.487ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4 file = illumos-utils/src/zone.rs:363
11322025-01-15T00:43:18.407ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e6c98709-2c51-44be-bc16-326586a6ded4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11332025-01-15T00:43:18.407ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='227a1343-8400-4620-95da-a366a25f629b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11342025-01-15T00:43:18.407ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11352025-01-15T00:43:18.413ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11362025-01-15T00:43:18.429ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11372025-01-15T00:43:18.430ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='40e100e9-e997-4fd2-9d6d-27f4fe9c2746'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11382025-01-15T00:43:18.430ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11392025-01-15T00:43:18.435ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11402025-01-15T00:43:18.439ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='86c94a9b-4877-474d-9057-304a69d29bc6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11412025-01-15T00:43:18.440ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11422025-01-15T00:43:18.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 25.339804ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11432025-01-15T00:43:18.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 57.217687ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11442025-01-15T00:43:18.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 50.727641ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11452025-01-15T00:43:18.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 49.072672ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11462025-01-15T00:43:18.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 59.618347ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11472025-01-15T00:43:18.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 146.702811ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11482025-01-15T00:43:18.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 126.182019ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11492025-01-15T00:43:18.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 59.825009ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11502025-01-15T00:43:19.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 59.70815ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11512025-01-15T00:43:19.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 140.139993ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11522025-01-15T00:43:19.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 222.676486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11532025-01-15T00:43:19.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 161.678666ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11542025-01-15T00:43:19.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 160.757807ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11552025-01-15T00:43:19.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 105.756252ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11562025-01-15T00:43:19.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 272.805264ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11572025-01-15T00:43:19.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 489.592526ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11582025-01-15T00:43:19.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 243.373587ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11592025-01-15T00:43:19.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 407.498003ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11602025-01-15T00:43:19.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 475.986156ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11612025-01-15T00:43:20.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 370.504611ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11622025-01-15T00:43:20.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 895.884431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11632025-01-15T00:43:20.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 589.839171ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11642025-01-15T00:43:20.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 1.179320737s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11652025-01-15T00:43:20.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 1.011063633s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11662025-01-15T00:43:20.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.110081825s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11672025-01-15T00:43:20.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 821.628724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11682025-01-15T00:43:21.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 566.971402ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11692025-01-15T00:43:21.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 1.064022229s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11702025-01-15T00:43:21.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 1.173337971s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11712025-01-15T00:43:21.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.051079639s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11722025-01-15T00:43:21.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 1.195256145s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11732025-01-15T00:43:21.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 1.231891965s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11742025-01-15T00:43:22.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 902.386304ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11752025-01-15T00:43:22.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.301049529s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11762025-01-15T00:43:22.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 1.135189518s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11772025-01-15T00:43:22.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 1.269081547s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11782025-01-15T00:43:23.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 661.181784ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11792025-01-15T00:43:23.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 570.977417ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11802025-01-15T00:43:23.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 1.446083148s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11812025-01-15T00:43:23.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 1.077085268s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11822025-01-15T00:43:24.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.353554829s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11832025-01-15T00:43:24.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 689.096778ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11842025-01-15T00:43:24.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 1.320736221s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11852025-01-15T00:43:24.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 720.184738ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11862025-01-15T00:43:25.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 1.411340097s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11872025-01-15T00:43:25.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 1.053954599s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11882025-01-15T00:43:25.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.151795956s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11892025-01-15T00:43:25.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 727.20597ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11902025-01-15T00:43:25.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 1.046214153s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11912025-01-15T00:43:26.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 837.134925ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11922025-01-15T00:43:26.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 819.90881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11932025-01-15T00:43:26.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 784.307631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
11942025-01-15T00:43:26.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 1.295270707s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
11952025-01-15T00:43:26.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 538.191483ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11962025-01-15T00:43:27.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 594.810405ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
11972025-01-15T00:43:27.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 594.035117ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
11982025-01-15T00:43:27.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.373346333s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
11992025-01-15T00:43:27.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 1.391635325s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
12002025-01-15T00:43:27.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 584.708244ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
12012025-01-15T00:43:27.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 1.228491033s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
12022025-01-15T00:43:27.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 855.800607ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
12032025-01-15T00:43:28.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 723.699519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
12042025-01-15T00:43:28.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.285293028s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
12052025-01-15T00:43:28.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 961.04113ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
12062025-01-15T00:43:28.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 646.05844ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
12072025-01-15T00:43:28.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 661.472842ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
12082025-01-15T00:43:28.928ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44259
12092025-01-15T00:43:28.928ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44259 req_id = cb494780-0f92-4471-9aef-6a9702006c7b response_code = 200 uri = /baseboard
12102025-01-15T00:43:28.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 1.150687407s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
12112025-01-15T00:43:29.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 1.472322709s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
12122025-01-15T00:43:29.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 1.405583363s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
12132025-01-15T00:43:29.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 1.00941378s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
12142025-01-15T00:43:29.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.35257886s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
12152025-01-15T00:43:30.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 1.151994488s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
12162025-01-15T00:43:30.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 817.094378ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
12172025-01-15T00:43:30.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 928.533476ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
12182025-01-15T00:43:30.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 1.090550257s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
12192025-01-15T00:43:31.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.17669144s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
12202025-01-15T00:43:31.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 1.236403868s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
12212025-01-15T00:43:31.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 748.262073ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
12222025-01-15T00:43:31.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 1.042894045s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
12232025-01-15T00:43:32.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 684.796043ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
12242025-01-15T00:43:32.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 1.4597515s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
12252025-01-15T00:43:32.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 1.262904983s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
12262025-01-15T00:43:32.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 1.088909784s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
12272025-01-15T00:43:32.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 841.485662ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
12282025-01-15T00:43:32.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 574.846214ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
12292025-01-15T00:43:33.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 834.154263ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
12302025-01-15T00:43:33.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8") failed: Property not found. retry in 861.422807ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
12312025-01-15T00:43:33.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b") failed: Property not found. retry in 1.446688534s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
12322025-01-15T00:43:33.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6") failed: Property not found. retry in 945.031303ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
12332025-01-15T00:43:33.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4") failed: Property not found. retry in 867.248358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
12342025-01-15T00:43:34.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746") failed: Property not found. retry in 1.086207163s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
12352025-01-15T00:43:35.384ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_40e100e9-e997-4fd2-9d6d-27f4fe9c2746
12362025-01-15T00:43:35.385ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b
12372025-01-15T00:43:35.385ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_86c94a9b-4877-474d-9057-304a69d29bc6
12382025-01-15T00:43:35.385ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8
12392025-01-15T00:43:35.385ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_e6c98709-2c51-44be-bc16-326586a6ded4
12402025-01-15T00:43:35.385ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12412025-01-15T00:43:35.385ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12422025-01-15T00:43:35.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20194237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56547 req_id = 447d5008-96da-4145-b3b0-0c88096b6a71 response_code = 204 uri = /omicron-zones
12432025-01-15T00:43:35.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58196
12442025-01-15T00:43:35.449ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29728 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58196 req_id = e84e6f30-e81b-426c-804d-bac49436f368 response_code = 500 uri = /cockroachdb
12452025-01-15T00:43:35.450ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e84e6f30-e81b-426c-804d-bac49436f368", "content-length": "124", "date": "Wed, 15 Jan 2025 00:43:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e84e6f30-e81b-426c-804d-bac49436f368" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 114.181568ms
12462025-01-15T00:43:35.590ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25121 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58196 req_id = 4db4ba15-b332-4893-a512-caeed1efbc4d response_code = 500 uri = /cockroachdb
12472025-01-15T00:43:35.590ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4db4ba15-b332-4893-a512-caeed1efbc4d", "content-length": "124", "date": "Wed, 15 Jan 2025 00:43:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4db4ba15-b332-4893-a512-caeed1efbc4d" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 116.858026ms
12482025-01-15T00:43:35.735ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26555 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58196 req_id = 697590e3-8a39-46c0-b9b2-0a4193ce08b0 response_code = 500 uri = /cockroachdb
12492025-01-15T00:43:35.735ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "697590e3-8a39-46c0-b9b2-0a4193ce08b0", "content-length": "124", "date": "Wed, 15 Jan 2025 00:43:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "697590e3-8a39-46c0-b9b2-0a4193ce08b0" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 182.8624ms
12502025-01-15T00:43:35.949ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58196 req_id = 0a6e52b3-52e2-48f9-9a1e-63657a62d142 response_code = 500 uri = /cockroachdb
12512025-01-15T00:43:35.949ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0a6e52b3-52e2-48f9-9a1e-63657a62d142", "content-length": "124", "date": "Wed, 15 Jan 2025 00:43:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0a6e52b3-52e2-48f9-9a1e-63657a62d142" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 125.735673ms
12522025-01-15T00:43:36.102ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58196 req_id = 8571115f-7037-4200-abe1-dca34557a4f9 response_code = 500 uri = /cockroachdb
12532025-01-15T00:43:36.103ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8571115f-7037-4200-abe1-dca34557a4f9", "content-length": "124", "date": "Wed, 15 Jan 2025 00:43:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8571115f-7037-4200-abe1-dca34557a4f9" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 113.194955ms
12542025-01-15T00:43:36.242ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25527 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58196 req_id = 1cfb17f3-d042-40ee-805a-83760206f25f response_code = 500 uri = /cockroachdb
12552025-01-15T00:43:36.242ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1cfb17f3-d042-40ee-805a-83760206f25f", "content-length": "124", "date": "Wed, 15 Jan 2025 00:43:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1cfb17f3-d042-40ee-805a-83760206f25f" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 304.863503ms
12562025-01-15T00:43:36.582ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3769
12572025-01-15T00:44:02.676ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
12582025-01-15T00:44:05.116ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize CockroachDb: Error running command in zone 'oxz_cockroachdb_227a1343-8400-4620-95da-a366a25f629b': Command [/opt/oxide/cockroachdb/bin/cockroach sql --insecure --host [fd00:1122:3344:101::7]:32221 --file /opt/oxide/cockroachdb/sql/dbinit.sql] executed and failed with status: exit status: 1 stdout: BEGIN\nCREATE DATABASE\nCREATE ROLE\nALTER DEFAULT PRIVILEGES\nCONFIGURE ZONE 1\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE VIEW\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\n stderr: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_CLIENT_REJECT): "sql txn" meta={id=d8dcf816 key=/NamespaceTable/30/1/106/0/"public"/4/1 pri=0.01986544 epo=0 ts=1736901845.007715035,1 min=1736901844.082804927,0 seq=639} lock=true stat=PENDING rts=1736901844.082804927,0 wto=false gul=1736901844.582804927,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_client_reject\nERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_CLIENT_REJECT): "sql txn" meta={id=d8dcf816 key=/NamespaceTable/30/1/106/0/"public"/4/1 pri=0.01986544 epo=0 ts=1736901845.007715035,1 min=1736901844.082804927,0 seq=639} lock=true stat=PENDING rts=1736901844.082804927,0 wto=false gul=1736901844.582804927,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_client_reject\nFailed running "sql"\n file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28567758 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58196 req_id = 42741e89-87c5-48d3-a530-852a467e97b9 response_code = 500 uri = /cockroachdb
12592025-01-15T00:44:05.118ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60572
12602025-01-15T00:44:05.119ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 613 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60572 req_id = 4c02faa1-cfe8-4fb1-b765-8b21c0f7774b response_code = 200 uri = /baseboard
12612025-01-15T00:44:05.119ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "42741e89-87c5-48d3-a530-852a467e97b9", "content-length": "124", "date": "Wed, 15 Jan 2025 00:44:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "42741e89-87c5-48d3-a530-852a467e97b9" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 190.707997ms
12622025-01-15T00:44:05.129ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 58.612740202s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
12632025-01-15T00:44:05.349ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3769
12642025-01-15T00:44:05.458ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
12652025-01-15T00:44:15.107ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3810
12662025-01-15T00:44:15.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9795892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:58196 req_id = 11a626e5-3f97-48e7-97c7-52be5f283abc response_code = 204 uri = /cockroachdb
12672025-01-15T00:44:15.149ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 40ae34f1-1e3b-45ab-8bbd-332390cbbebd (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ca7cda21-9b20-4e26-b219-943f968e7f55 (service), filesystem_pool: Some(ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 794b81d3-84d4-414f-8833-aa968fe812f9 (service), filesystem_pool: Some(ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: c2cd76d1-d7ab-4fda-837d-fe37f1284f56 (service), filesystem_pool: Some(ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2437f4c0-8b40-4e21-8aa5-d6ce32769b61, kind: Service { id: c2cd76d1-d7ab-4fda-837d-fe37f1284f56 }, name: Name("ntp-c2cd76d1-d7ab-4fda-837d-fe37f1284f56"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 55])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 86c94a9b-4877-474d-9057-304a69d29bc6 (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 97697ab3-a4ac-44b5-bdf7-4c9dcf655ef8 (service), filesystem_pool: Some(ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40e100e9-e997-4fd2-9d6d-27f4fe9c2746 (service), filesystem_pool: Some(ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External } } } }, OmicronZoneConfig { id: e6c98709-2c51-44be-bc16-326586a6ded4 (service), filesystem_pool: Some(ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 227a1343-8400-4620-95da-a366a25f629b (service), filesystem_pool: Some(ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External } } } }, OmicronZoneConfig { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa (service), filesystem_pool: Some(ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 (service), filesystem_pool: Some(ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c (service), filesystem_pool: Some(ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea (service), filesystem_pool: Some(ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: dee7453b-558a-4d94-b6a0-8b27cb27f002 (service), filesystem_pool: Some(ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 6935d5da-bc1a-439f-9845-607427a8635c (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } } } }, OmicronZoneConfig { id: bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5 (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 140a6d6b-296b-441d-836e-1d2cc15b8f09 (service), filesystem_pool: Some(ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 5c576201-922c-4648-819f-6250ccdbb4ac (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: c7a02724-213e-4f8e-aada-698e0be8c23f (service), filesystem_pool: Some(ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 10a5d851-c7b9-46f3-a297-ea56cb8721a0 (service), filesystem_pool: Some(ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6d1a626e-74c7-46fa-989c-8f021dae4fe8 (service), filesystem_pool: Some(ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External } } } }, OmicronZoneConfig { id: c6f5aaee-2431-44a8-a978-c6ee4bb8bce1 (service), filesystem_pool: Some(ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External } } } }, OmicronZoneConfig { id: b3ccb50b-c2b5-4595-9712-100ff17515f5 (service), filesystem_pool: Some(ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External } } } }, OmicronZoneConfig { id: 428dc573-16e0-46ff-bade-0eb64d01fd9d (service), filesystem_pool: Some(ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External } } } }, OmicronZoneConfig { id: f6997e47-23c2-4dfd-ab41-ed79c9a26e49 (service), filesystem_pool: Some(ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 09bdd1ce-4f12-42d4-a66a-2ac8c3e16678 (service), filesystem_pool: Some(ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External } } } }, OmicronZoneConfig { id: 996d5a00-7bbc-4bd6-9290-e95abc9ba929 (service), filesystem_pool: Some(ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
12682025-01-15T00:44:15.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38586
12692025-01-15T00:44:15.150ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12702025-01-15T00:44:15.150ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12712025-01-15T00:44:15.164ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12722025-01-15T00:44:15.165ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12732025-01-15T00:44:15.175ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12742025-01-15T00:44:15.175ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12752025-01-15T00:44:15.187ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12762025-01-15T00:44:15.187ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12772025-01-15T00:44:15.198ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12782025-01-15T00:44:15.198ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12792025-01-15T00:44:15.208ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12802025-01-15T00:44:15.208ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12812025-01-15T00:44:15.218ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12822025-01-15T00:44:15.218ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12832025-01-15T00:44:15.227ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12842025-01-15T00:44:15.227ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Cockroach }, responder: ... }
12852025-01-15T00:44:15.237ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12862025-01-15T00:44:15.237ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12872025-01-15T00:44:15.247ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12882025-01-15T00:44:15.247ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12892025-01-15T00:44:15.257ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12902025-01-15T00:44:15.257ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12912025-01-15T00:44:15.274ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12922025-01-15T00:44:15.274ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, kind: Crucible }, responder: ... }
12932025-01-15T00:44:15.283ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12942025-01-15T00:44:15.284ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, kind: Crucible }, responder: ... }
12952025-01-15T00:44:15.294ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12962025-01-15T00:44:15.294ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, kind: Crucible }, responder: ... }
12972025-01-15T00:44:15.304ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12982025-01-15T00:44:15.304ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, kind: Crucible }, responder: ... }
12992025-01-15T00:44:15.313ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
13002025-01-15T00:44:15.313ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, kind: Crucible }, responder: ... }
13012025-01-15T00:44:15.323ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
13022025-01-15T00:44:15.323ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, kind: Crucible }, responder: ... }
13032025-01-15T00:44:15.341ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
13042025-01-15T00:44:15.341ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, kind: Crucible }, responder: ... }
13052025-01-15T00:44:15.352ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
13062025-01-15T00:44:15.352ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, kind: Crucible }, responder: ... }
13072025-01-15T00:44:15.363ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
13082025-01-15T00:44:15.363ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, kind: Crucible }, responder: ... }
13092025-01-15T00:44:15.373ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13102025-01-15T00:44:15.373ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:177
13112025-01-15T00:44:15.373ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:177
13122025-01-15T00:44:15.373ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13132025-01-15T00:44:15.493ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13142025-01-15T00:44:15.510ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13152025-01-15T00:44:15.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13162025-01-15T00:44:15.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13172025-01-15T00:44:15.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13182025-01-15T00:44:15.525ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13192025-01-15T00:44:15.525ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13202025-01-15T00:44:15.572ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13212025-01-15T00:44:15.572ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13222025-01-15T00:44:15.572ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13232025-01-15T00:44:15.778ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13242025-01-15T00:44:15.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13252025-01-15T00:44:15.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13262025-01-15T00:44:15.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13272025-01-15T00:44:15.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13282025-01-15T00:44:15.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13292025-01-15T00:44:15.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13302025-01-15T00:44:15.791ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13312025-01-15T00:44:15.791ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13322025-01-15T00:44:15.792ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002 file = illumos-utils/src/zone.rs:325
13332025-01-15T00:44:15.796ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac file = illumos-utils/src/zone.rs:325
13342025-01-15T00:44:15.801ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09 file = illumos-utils/src/zone.rs:325
13352025-01-15T00:44:15.805ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0 file = illumos-utils/src/zone.rs:325
13362025-01-15T00:44:15.811ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d file = illumos-utils/src/zone.rs:325
13372025-01-15T00:44:15.816ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8 file = illumos-utils/src/zone.rs:325
13382025-01-15T00:44:15.821ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49 file = illumos-utils/src/zone.rs:325
13392025-01-15T00:44:15.955ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002 file = illumos-utils/src/zone.rs:363
13402025-01-15T00:44:15.960ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac file = illumos-utils/src/zone.rs:363
13412025-01-15T00:44:15.965ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09 file = illumos-utils/src/zone.rs:363
13422025-01-15T00:44:15.970ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0 file = illumos-utils/src/zone.rs:363
13432025-01-15T00:44:15.975ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d file = illumos-utils/src/zone.rs:363
13442025-01-15T00:44:15.980ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8 file = illumos-utils/src/zone.rs:363
13452025-01-15T00:44:15.985ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49 file = illumos-utils/src/zone.rs:363
13462025-01-15T00:44:15.991ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929 file = illumos-utils/src/zone.rs:325
13472025-01-15T00:44:15.996ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1 file = illumos-utils/src/zone.rs:325
13482025-01-15T00:44:16.002ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678 file = illumos-utils/src/zone.rs:325
13492025-01-15T00:44:16.007ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f file = illumos-utils/src/zone.rs:325
13502025-01-15T00:44:16.013ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c file = illumos-utils/src/zone.rs:325
13512025-01-15T00:44:16.019ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5 file = illumos-utils/src/zone.rs:325
13522025-01-15T00:44:16.026ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5 file = illumos-utils/src/zone.rs:325
13532025-01-15T00:44:16.034ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929 file = illumos-utils/src/zone.rs:363
13542025-01-15T00:44:16.040ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1 file = illumos-utils/src/zone.rs:363
13552025-01-15T00:44:16.047ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678 file = illumos-utils/src/zone.rs:363
13562025-01-15T00:44:16.055ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f file = illumos-utils/src/zone.rs:363
13572025-01-15T00:44:16.062ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c file = illumos-utils/src/zone.rs:363
13582025-01-15T00:44:16.071ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5 file = illumos-utils/src/zone.rs:363
13592025-01-15T00:44:16.080ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5 file = illumos-utils/src/zone.rs:363
13602025-01-15T00:44:16.151ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13612025-01-15T00:44:16.209ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13622025-01-15T00:44:16.273ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13632025-01-15T00:44:16.351ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13642025-01-15T00:44:16.408ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13652025-01-15T00:44:16.410ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13662025-01-15T00:44:16.410ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13672025-01-15T00:44:16.468ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 145, 60]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13682025-01-15T00:44:16.468ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
13692025-01-15T00:44:16.470ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13702025-01-15T00:44:16.470ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13712025-01-15T00:44:16.527ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 208, 13]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13722025-01-15T00:44:16.527ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
13732025-01-15T00:44:16.529ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13742025-01-15T00:44:16.529ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13752025-01-15T00:44:16.597ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 185, 79]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13762025-01-15T00:44:16.597ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
13772025-01-15T00:44:16.601ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13782025-01-15T00:44:16.601ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13792025-01-15T00:44:16.654ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 217, 118]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13802025-01-15T00:44:16.654ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
13812025-01-15T00:44:16.655ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13822025-01-15T00:44:16.655ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13832025-01-15T00:44:16.713ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 129, 134]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13842025-01-15T00:44:16.713ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
13852025-01-15T00:44:16.714ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:85
13862025-01-15T00:44:16.714ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:92
13872025-01-15T00:44:16.714ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:85
13882025-01-15T00:44:16.714ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:92
13892025-01-15T00:44:16.714ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:85
13902025-01-15T00:44:16.714ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:92
13912025-01-15T00:44:16.714ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:85
13922025-01-15T00:44:16.714ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:92
13932025-01-15T00:44:16.715ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:85
13942025-01-15T00:44:16.715ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:92
13952025-01-15T00:44:16.726ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:120
13962025-01-15T00:44:16.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13972025-01-15T00:44:16.774ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:120
13982025-01-15T00:44:16.778ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:120
13992025-01-15T00:44:16.779ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
14002025-01-15T00:44:16.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
14012025-01-15T00:44:16.782ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:120
14022025-01-15T00:44:16.785ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:120
14032025-01-15T00:44:16.785ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
14042025-01-15T00:44:16.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
14052025-01-15T00:44:17.078ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea file = illumos-utils/src/zone.rs:325
14062025-01-15T00:44:17.095ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c file = illumos-utils/src/zone.rs:325
14072025-01-15T00:44:17.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c file = illumos-utils/src/zone.rs:325
14082025-01-15T00:44:17.122ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa file = illumos-utils/src/zone.rs:325
14092025-01-15T00:44:17.133ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 file = illumos-utils/src/zone.rs:325
14102025-01-15T00:44:17.150ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea file = illumos-utils/src/zone.rs:363
14112025-01-15T00:44:17.157ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c file = illumos-utils/src/zone.rs:363
14122025-01-15T00:44:17.167ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c file = illumos-utils/src/zone.rs:363
14132025-01-15T00:44:17.180ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa file = illumos-utils/src/zone.rs:363
14142025-01-15T00:44:17.199ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 file = illumos-utils/src/zone.rs:363
14152025-01-15T00:44:18.941ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14162025-01-15T00:44:18.941ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
14172025-01-15T00:44:18.982ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8c89ec39-df9e-4d8f-a566-f09887b55464'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14182025-01-15T00:44:18.982ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
14192025-01-15T00:44:18.989ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3f527ef1-100b-4dd4-8432-d90959185c11'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14202025-01-15T00:44:18.989ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e927d854-d6fd-4606-baca-3874882eccd4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='09197ba3-7c86-4d10-8a4f-3a2a84bb2a93'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14212025-01-15T00:44:18.990ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8d9112e3-7929-4bb9-9e99-02030b1a550a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14222025-01-15T00:44:18.990ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ba26a070-5665-4b80-b702-e0bfb62227f6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e22c6bbe-487c-47a8-b2c3-be8bbde7a9eb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14232025-01-15T00:44:18.990ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a551c2b7-cd94-4f57-bdfa-30ec12cf714d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14242025-01-15T00:44:18.990ZINFOSledAgent (ServiceManager): Booting oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
14252025-01-15T00:44:18.997ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
14262025-01-15T00:44:19.004ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f611dc28-a5b8-4456-accd-0c6a1f6564ca'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14272025-01-15T00:44:19.004ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
14282025-01-15T00:44:19.010ZINFOSledAgent (ServiceManager): Booting oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
14292025-01-15T00:44:19.016ZINFOSledAgent (ServiceManager): Booting oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
14302025-01-15T00:44:19.021ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a6ee976a-8413-4b79-86fd-0416e935e722/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='43b1269d-dd8d-4b20-8ac3-2ac8f4d582f4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14312025-01-15T00:44:19.022ZINFOSledAgent (ServiceManager): Booting oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
14322025-01-15T00:44:19.028ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
14332025-01-15T00:44:19.218ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14342025-01-15T00:44:19.218ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
14352025-01-15T00:44:19.235ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='dee7453b-558a-4d94-b6a0-8b27cb27f002'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14362025-01-15T00:44:19.235ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
14372025-01-15T00:44:19.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 69.21761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
14382025-01-15T00:44:19.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 29.480419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
14392025-01-15T00:44:19.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 60.678455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
14402025-01-15T00:44:19.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 52.953407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
14412025-01-15T00:44:19.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 44.859398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
14422025-01-15T00:44:19.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 48.375085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
14432025-01-15T00:44:19.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 41.858055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
14442025-01-15T00:44:19.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 63.760401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
14452025-01-15T00:44:19.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 63.872244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
14462025-01-15T00:44:19.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 140.319649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
14472025-01-15T00:44:19.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 48.705669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
14482025-01-15T00:44:19.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 63.773026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
14492025-01-15T00:44:19.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 92.83346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
14502025-01-15T00:44:19.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 98.508799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
14512025-01-15T00:44:19.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 113.898716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
14522025-01-15T00:44:20.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 123.818793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
14532025-01-15T00:44:20.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 36.436942ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
14542025-01-15T00:44:22.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 65.370453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
14552025-01-15T00:44:23.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 27.0769ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
14562025-01-15T00:44:23.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 241.343096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
14572025-01-15T00:44:23.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 241.495353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
14582025-01-15T00:44:23.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 144.620878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
14592025-01-15T00:44:23.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 192.273954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
14602025-01-15T00:44:23.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 142.267157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
14612025-01-15T00:44:23.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 250.880198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
14622025-01-15T00:44:24.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 191.914689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
14632025-01-15T00:44:24.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 160.179669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
14642025-01-15T00:44:24.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 146.2442ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
14652025-01-15T00:44:24.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 281.1536ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
14662025-01-15T00:44:24.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 121.804497ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
14672025-01-15T00:44:24.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 289.151058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
14682025-01-15T00:44:24.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 523.844585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
14692025-01-15T00:44:24.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 148.330135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
14702025-01-15T00:44:24.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 242.390593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
14712025-01-15T00:44:24.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 498.499527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
14722025-01-15T00:44:24.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 210.227906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
14732025-01-15T00:44:24.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 484.338783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
14742025-01-15T00:44:24.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 256.828506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
14752025-01-15T00:44:24.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 277.157005ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
14762025-01-15T00:44:25.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 152.390064ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
14772025-01-15T00:44:25.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 233.308085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
14782025-01-15T00:44:25.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 209.168365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
14792025-01-15T00:44:25.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 364.952734ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
14802025-01-15T00:44:25.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 1.040200726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
14812025-01-15T00:44:25.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 1.032585915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
14822025-01-15T00:44:25.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 811.37592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
14832025-01-15T00:44:25.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 772.781386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
14842025-01-15T00:44:25.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 256.707988ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
14852025-01-15T00:44:25.286ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14862025-01-15T00:44:25.286ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14872025-01-15T00:44:25.286ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14882025-01-15T00:44:25.286ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
14892025-01-15T00:44:25.293ZINFOSledAgent (ServiceManager): Booting oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
14902025-01-15T00:44:25.300ZINFOSledAgent (ServiceManager): Booting oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
14912025-01-15T00:44:25.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 1.018009172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
14922025-01-15T00:44:25.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 1.101400364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
14932025-01-15T00:44:25.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 885.147267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
14942025-01-15T00:44:25.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 990.982727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
14952025-01-15T00:44:25.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 693.789493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
14962025-01-15T00:44:25.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 1.040556475s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
14972025-01-15T00:44:25.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 515.0849ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
14982025-01-15T00:44:25.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 38.939272ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
14992025-01-15T00:44:25.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 47.358687ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
15002025-01-15T00:44:25.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 60.90636ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
15012025-01-15T00:44:25.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 142.911596ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
15022025-01-15T00:44:25.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 74.557314ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
15032025-01-15T00:44:25.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 89.249131ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
15042025-01-15T00:44:26.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 288.347919ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
15052025-01-15T00:44:26.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 851.224186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
15062025-01-15T00:44:26.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 206.395308ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
15072025-01-15T00:44:26.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 113.101088ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
15082025-01-15T00:44:26.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 1.348856661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
15092025-01-15T00:44:26.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 1.144952441s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
15102025-01-15T00:44:26.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 585.06164ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
15112025-01-15T00:44:26.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 759.524241ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
15122025-01-15T00:44:26.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 632.616596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
15132025-01-15T00:44:26.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 1.009962619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
15142025-01-15T00:44:26.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 398.702447ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
15152025-01-15T00:44:26.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 416.230045ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
15162025-01-15T00:44:26.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 517.602046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
15172025-01-15T00:44:26.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 940.288677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
15182025-01-15T00:44:26.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 1.326223587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
15192025-01-15T00:44:26.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 1.146427949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
15202025-01-15T00:44:26.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 565.022903ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
15212025-01-15T00:44:26.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 1.004416255s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
15222025-01-15T00:44:26.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 1.408012628s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
15232025-01-15T00:44:26.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 620.68985ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
15242025-01-15T00:44:26.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 538.517587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
15252025-01-15T00:44:26.889ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15262025-01-15T00:44:26.902ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15272025-01-15T00:44:26.902ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
15282025-01-15T00:44:26.912ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
15292025-01-15T00:44:26.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 1.395173564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
15302025-01-15T00:44:26.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 1.41732058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
15312025-01-15T00:44:27.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 1.036762402s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
15322025-01-15T00:44:27.104ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='726d912d-c5d6-4a7e-8bfb-9552b2e5705d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15332025-01-15T00:44:27.105ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
15342025-01-15T00:44:27.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 36.199856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
15352025-01-15T00:44:27.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 52.485126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
15362025-01-15T00:44:27.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 133.283115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
15372025-01-15T00:44:27.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 58.233032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
15382025-01-15T00:44:27.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 1.101946226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
15392025-01-15T00:44:27.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 1.091234101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
15402025-01-15T00:44:27.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 1.439859318s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
15412025-01-15T00:44:27.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 260.280349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
15422025-01-15T00:44:27.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 670.792031ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
15432025-01-15T00:44:27.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 149.385336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
15442025-01-15T00:44:27.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 1.199499283s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
15452025-01-15T00:44:27.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 1.435647838s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
15462025-01-15T00:44:27.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 28.867656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
15472025-01-15T00:44:27.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 1.420404035s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
15482025-01-15T00:44:27.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 1.315208114s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
15492025-01-15T00:44:27.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 139.589417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
15502025-01-15T00:44:27.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 347.330406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
15512025-01-15T00:44:27.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 316.410454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
15522025-01-15T00:44:27.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 1.324408421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
15532025-01-15T00:44:27.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 157.248911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
15542025-01-15T00:44:27.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 692.820987ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
15552025-01-15T00:44:28.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 439.683541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
15562025-01-15T00:44:28.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 726.029667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
15572025-01-15T00:44:28.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 959.93321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
15582025-01-15T00:44:28.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 1.291208685s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
15592025-01-15T00:44:28.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 1.202861388s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
15602025-01-15T00:44:28.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 734.615601ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
15612025-01-15T00:44:28.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 751.617238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
15622025-01-15T00:44:28.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 816.20568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
15632025-01-15T00:44:28.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 1.176708624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
15642025-01-15T00:44:28.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 1.106784251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
15652025-01-15T00:44:28.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 876.164558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
15662025-01-15T00:44:28.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 816.105088ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
15672025-01-15T00:44:28.699ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15682025-01-15T00:44:28.699ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
15692025-01-15T00:44:28.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 1.207031058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
15702025-01-15T00:44:28.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 1.156843218s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
15712025-01-15T00:44:28.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 1.446140016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
15722025-01-15T00:44:29.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 1.339994882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
15732025-01-15T00:44:29.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 1.303444202s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
15742025-01-15T00:44:29.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 828.065742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
15752025-01-15T00:44:29.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 45.053077ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
15762025-01-15T00:44:29.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 1.258002609s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
15772025-01-15T00:44:29.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 1.432709817s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
15782025-01-15T00:44:29.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 955.709798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
15792025-01-15T00:44:29.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 144.843564ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
15802025-01-15T00:44:29.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 695.910742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
15812025-01-15T00:44:29.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 1.080594068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
15822025-01-15T00:44:29.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 891.305396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
15832025-01-15T00:44:29.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 1.356580282s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
15842025-01-15T00:44:29.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 710.75936ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
15852025-01-15T00:44:29.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 1.016182531s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
15862025-01-15T00:44:29.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 291.582088ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
15872025-01-15T00:44:29.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 1.464117199s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
15882025-01-15T00:44:29.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 759.015089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
15892025-01-15T00:44:29.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 307.02512ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
15902025-01-15T00:44:29.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 791.273269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
15912025-01-15T00:44:29.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 961.230874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
15922025-01-15T00:44:30.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 1.412008827s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
15932025-01-15T00:44:30.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 1.058801589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
15942025-01-15T00:44:30.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 909.480456ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
15952025-01-15T00:44:30.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 1.250927849s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
15962025-01-15T00:44:30.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 1.207872993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
15972025-01-15T00:44:30.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 1.386391454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
15982025-01-15T00:44:30.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 1.490697877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
15992025-01-15T00:44:30.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 703.085791ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
16002025-01-15T00:44:30.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 1.375684644s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
16012025-01-15T00:44:30.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 540.433692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
16022025-01-15T00:44:30.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 1.443020154s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
16032025-01-15T00:44:30.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 1.187928728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
16042025-01-15T00:44:30.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 1.046548044s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
16052025-01-15T00:44:30.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 1.008258426s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
16062025-01-15T00:44:30.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 1.488331364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
16072025-01-15T00:44:30.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 1.277152385s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
16082025-01-15T00:44:30.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 916.00488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
16092025-01-15T00:44:30.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 850.892571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
16102025-01-15T00:44:31.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 890.272855ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
16112025-01-15T00:44:31.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 1.184196298s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
16122025-01-15T00:44:31.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 970.706955ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
16132025-01-15T00:44:31.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 579.02803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
16142025-01-15T00:44:31.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 1.295466101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
16152025-01-15T00:44:31.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 1.156212222s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
16162025-01-15T00:44:31.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 727.080041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
16172025-01-15T00:44:31.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 992.78081ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
16182025-01-15T00:44:31.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 513.530983ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
16192025-01-15T00:44:31.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 940.158898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
16202025-01-15T00:44:31.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 1.000931927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
16212025-01-15T00:44:31.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 779.732728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
16222025-01-15T00:44:31.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 572.071145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
16232025-01-15T00:44:31.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 1.329273288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
16242025-01-15T00:44:31.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 1.413441584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
16252025-01-15T00:44:31.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 562.645701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
16262025-01-15T00:44:31.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 1.358221171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
16272025-01-15T00:44:31.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 1.307637834s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
16282025-01-15T00:44:32.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 1.114494972s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
16292025-01-15T00:44:32.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 1.441736657s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
16302025-01-15T00:44:32.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 1.373279879s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
16312025-01-15T00:44:32.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 1.401304854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
16322025-01-15T00:44:32.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 546.034708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
16332025-01-15T00:44:32.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 582.376967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
16342025-01-15T00:44:32.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 1.428326969s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
16352025-01-15T00:44:32.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 1.422384117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
16362025-01-15T00:44:32.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 1.443690673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
16372025-01-15T00:44:32.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 893.06022ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
16382025-01-15T00:44:32.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 1.056055556s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
16392025-01-15T00:44:32.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 1.381772477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
16402025-01-15T00:44:32.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 868.3289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
16412025-01-15T00:44:32.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 914.125758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
16422025-01-15T00:44:32.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 681.229975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
16432025-01-15T00:44:32.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 1.426705452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
16442025-01-15T00:44:33.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 1.362683844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
16452025-01-15T00:44:33.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 1.092611823s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
16462025-01-15T00:44:33.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 1.073463185s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
16472025-01-15T00:44:33.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 977.447163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
16482025-01-15T00:44:33.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 608.555282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
16492025-01-15T00:44:33.394ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16502025-01-15T00:44:33.394ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
16512025-01-15T00:44:33.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 1.098305513s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
16522025-01-15T00:44:33.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 941.586832ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
16532025-01-15T00:44:33.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 1.091973076s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
16542025-01-15T00:44:33.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 1.285310534s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
16552025-01-15T00:44:33.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 606.949585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
16562025-01-15T00:44:33.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 683.587202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
16572025-01-15T00:44:33.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 660.242716ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
16582025-01-15T00:44:33.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 620.297359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
16592025-01-15T00:44:33.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 39.638292ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
16602025-01-15T00:44:33.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 51.266349ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
16612025-01-15T00:44:33.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 150.783329ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
16622025-01-15T00:44:33.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 596.08279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
16632025-01-15T00:44:33.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 816.95709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
16642025-01-15T00:44:34.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 1.274142595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
16652025-01-15T00:44:34.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 1.04017969s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
16662025-01-15T00:44:34.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 569.920684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
16672025-01-15T00:44:34.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 431.547888ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
16682025-01-15T00:44:34.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09") failed: Property not found. retry in 561.241893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
16692025-01-15T00:44:34.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929") failed: Property not found. retry in 1.391476831s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
16702025-01-15T00:44:34.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 1.018274671s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
16712025-01-15T00:44:34.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 571.546349ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
16722025-01-15T00:44:34.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 799.83744ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
16732025-01-15T00:44:34.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 1.141081192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
16742025-01-15T00:44:34.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 698.093344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
16752025-01-15T00:44:34.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 1.154994651s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
16762025-01-15T00:44:34.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 996.02381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
16772025-01-15T00:44:34.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002") failed: Property not found. retry in 1.256033676s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
16782025-01-15T00:44:34.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 1.071112353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
16792025-01-15T00:44:34.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 1.360324102s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
16802025-01-15T00:44:34.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 427.017729ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
16812025-01-15T00:44:34.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 1.427538117s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
16822025-01-15T00:44:34.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 666.736851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
16832025-01-15T00:44:34.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 1.283699003s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
16842025-01-15T00:44:34.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa") failed: Property not found. retry in 766.427745ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
16852025-01-15T00:44:34.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 864.58505ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
16862025-01-15T00:44:35.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 1.212052083s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
16872025-01-15T00:44:35.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 970.868283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
16882025-01-15T00:44:35.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c") failed: Property not found. retry in 1.421894473s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
16892025-01-15T00:44:35.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 1.080181437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
16902025-01-15T00:44:35.188ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60990
16912025-01-15T00:44:35.196ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 622 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60990 req_id = 1e392014-2644-473b-869f-5d22cf07352e response_code = 200 uri = /baseboard
16922025-01-15T00:44:35.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 1.054342913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
16932025-01-15T00:44:35.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5") failed: Property not found. retry in 1.189517071s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
16942025-01-15T00:44:35.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8") failed: Property not found. retry in 1.214323936s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
16952025-01-15T00:44:35.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac") failed: Property not found. retry in 1.112881388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
16962025-01-15T00:44:35.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 706.708829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
16972025-01-15T00:44:35.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 1.481312713s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
16982025-01-15T00:44:35.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 584.171086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
16992025-01-15T00:44:35.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea") failed: Property not found. retry in 1.069808788s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
17002025-01-15T00:44:35.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49") failed: Property not found. retry in 1.259498634s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
17012025-01-15T00:44:36.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678") failed: Property not found. retry in 1.19706333s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
17022025-01-15T00:44:36.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85") failed: Property not found. retry in 1.367204811s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
17032025-01-15T00:44:36.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1") failed: Property not found. retry in 1.335716596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
17042025-01-15T00:44:36.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d") failed: Property not found. retry in 712.212757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
17052025-01-15T00:44:36.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0") failed: Property not found. retry in 1.251384269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
17062025-01-15T00:44:36.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 642.576108ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
17072025-01-15T00:44:36.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5") failed: Property not found. retry in 1.471080856s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
17082025-01-15T00:44:36.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f") failed: Property not found. retry in 650.443655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
17092025-01-15T00:44:36.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 1.306458091s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
17102025-01-15T00:44:37.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 735.660726ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
17112025-01-15T00:44:37.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c") failed: Property not found. retry in 642.342868ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
17122025-01-15T00:44:38.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 821.839729ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
17132025-01-15T00:44:39.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 1.038051445s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
17142025-01-15T00:44:40.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 599.512903ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
17152025-01-15T00:44:40.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 571.788992ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
17162025-01-15T00:44:41.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 652.406222ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
17172025-01-15T00:44:41.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c") failed: Property not found. retry in 720.990536ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
17182025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_1b0c7acf-5911-4566-8fa4-6d93171259ea
17192025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_oximeter_dee7453b-558a-4d94-b6a0-8b27cb27f002
17202025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_5c576201-922c-4648-819f-6250ccdbb4ac
17212025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_140a6d6b-296b-441d-836e-1d2cc15b8f09
17222025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_b51ac62e-be31-47f6-aa1e-af03a1941a9c
17232025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_10a5d851-c7b9-46f3-a297-ea56cb8721a0
17242025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_72fbdda4-ce05-4dc2-9f16-1272a893088c
17252025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_428dc573-16e0-46ff-bade-0eb64d01fd9d
17262025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_6d1a626e-74c7-46fa-989c-8f021dae4fe8
17272025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_f6997e47-23c2-4dfd-ab41-ed79c9a26e49
17282025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_996d5a00-7bbc-4bd6-9290-e95abc9ba929
17292025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_c6f5aaee-2431-44a8-a978-c6ee4bb8bce1
17302025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_09bdd1ce-4f12-42d4-a66a-2ac8c3e16678
17312025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_c7a02724-213e-4f8e-aada-698e0be8c23f
17322025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_clickhouse_6935d5da-bc1a-439f-9845-607427a8635c
17332025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_bb8cc41a-d0df-4c1d-a2fa-8b633358fbf5
17342025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_428f96bb-3527-41ae-b455-13a78e2ab5fa
17352025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_b3ccb50b-c2b5-4595-9712-100ff17515f5
17362025-01-15T00:44:42.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
17372025-01-15T00:44:42.751ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17382025-01-15T00:44:42.766ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17392025-01-15T00:44:42.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27663777 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38586 req_id = 2c97c3f2-a536-43b5-8871-fab735ded4b4 response_code = 204 uri = /omicron-zones
17402025-01-15T00:44:42.822ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17412025-01-15T00:44:42.867ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17422025-01-15T00:44:42.882ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:803
17432025-01-15T00:44:42.953ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
17442025-01-15T00:44:42.969ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17452025-01-15T00:44:43.061ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17462025-01-15T00:44:43.199ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17472025-01-15T00:44:43.320ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17482025-01-15T00:44:43.532ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17492025-01-15T00:44:43.686ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17502025-01-15T00:44:43.941ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17512025-01-15T00:44:44.331ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17522025-01-15T00:44:44.648ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17532025-01-15T00:44:45.187ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17542025-01-15T00:44:45.559ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c52fc7fb-8746-40c6-805b-707ae8abbd97/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17552025-01-15T00:44:48.265ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f0fc9ef6-866c-47c2-8d87-97dfa92c15be", "content-length": "173", "date": "Wed, 15 Jan 2025 00:44:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"c52fc7fb-8746-40c6-805b-707ae8abbd97\"", request_id: "f0fc9ef6-866c-47c2-8d87-97dfa92c15be" } file = sled-agent/src/rack_setup/service.rs:1079
17562025-01-15T00:44:49.301ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0c680ad7-143d-4577-8b73-aac36ac213fb", "content-length": "173", "date": "Wed, 15 Jan 2025 00:44:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"c52fc7fb-8746-40c6-805b-707ae8abbd97\"", request_id: "0c680ad7-143d-4577-8b73-aac36ac213fb" } file = sled-agent/src/rack_setup/service.rs:1079
17572025-01-15T00:44:50.781ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c9618ab9-c6a7-4f06-835f-ee5b514fb7ed", "content-length": "173", "date": "Wed, 15 Jan 2025 00:44:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"c52fc7fb-8746-40c6-805b-707ae8abbd97\"", request_id: "c9618ab9-c6a7-4f06-835f-ee5b514fb7ed" } file = sled-agent/src/rack_setup/service.rs:1079
17582025-01-15T00:44:51.549ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1948fa3a-9eb5-424f-971a-686055c2c559", "content-length": "173", "date": "Wed, 15 Jan 2025 00:44:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"c52fc7fb-8746-40c6-805b-707ae8abbd97\"", request_id: "1948fa3a-9eb5-424f-971a-686055c2c559" } file = sled-agent/src/rack_setup/service.rs:1079
17592025-01-15T00:44:52.576ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
17602025-01-15T00:44:54.196ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "571c1d13-cf4e-40f4-9414-360ec7150224", "content-length": "173", "date": "Wed, 15 Jan 2025 00:44:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "571c1d13-cf4e-40f4-9414-360ec7150224" } file = sled-agent/src/rack_setup/service.rs:1079
17612025-01-15T00:44:57.269ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1ffa190e-3ad4-4f6d-8ac6-2c8fbe462f92", "content-length": "173", "date": "Wed, 15 Jan 2025 00:44:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "1ffa190e-3ad4-4f6d-8ac6-2c8fbe462f92" } file = sled-agent/src/rack_setup/service.rs:1079
17622025-01-15T00:44:59.936ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c8c91ee8-93d6-4215-807f-669766e66664", "content-length": "173", "date": "Wed, 15 Jan 2025 00:44:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "c8c91ee8-93d6-4215-807f-669766e66664" } file = sled-agent/src/rack_setup/service.rs:1079
17632025-01-15T00:45:02.020ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5d90c69d-5dd3-456c-8b93-2b121278eef0", "content-length": "173", "date": "Wed, 15 Jan 2025 00:45:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "5d90c69d-5dd3-456c-8b93-2b121278eef0" } file = sled-agent/src/rack_setup/service.rs:1079
17642025-01-15T00:45:04.492ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "adfcf24e-580f-4e8f-aa97-6b62f7a37126", "content-length": "173", "date": "Wed, 15 Jan 2025 00:45:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "adfcf24e-580f-4e8f-aa97-6b62f7a37126" } file = sled-agent/src/rack_setup/service.rs:1079
17652025-01-15T00:45:05.225ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34556
17662025-01-15T00:45:05.225ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34556 req_id = 4ce5d904-adc9-4f05-b7c6-4f93dd2ac4ef response_code = 200 uri = /baseboard
17672025-01-15T00:45:08.977ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1b8688d9-623e-4423-bccf-51db96b49102", "content-length": "173", "date": "Wed, 15 Jan 2025 00:45:08 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "1b8688d9-623e-4423-bccf-51db96b49102" } file = sled-agent/src/rack_setup/service.rs:1079
17682025-01-15T00:45:12.041ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b58ae03c-72f8-48f3-932c-3901ceb2ec2d", "content-length": "173", "date": "Wed, 15 Jan 2025 00:45:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "b58ae03c-72f8-48f3-932c-3901ceb2ec2d" } file = sled-agent/src/rack_setup/service.rs:1079
17692025-01-15T00:45:16.875ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6e17b98e-3da2-435e-b4d9-e0c2713ed9fb", "content-length": "173", "date": "Wed, 15 Jan 2025 00:45:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "6e17b98e-3da2-435e-b4d9-e0c2713ed9fb" } file = sled-agent/src/rack_setup/service.rs:1079
17702025-01-15T00:45:23.110ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2b27edc7-63b7-4541-8b9e-ba89bba8c611", "content-length": "173", "date": "Wed, 15 Jan 2025 00:45:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "2b27edc7-63b7-4541-8b9e-ba89bba8c611" } file = sled-agent/src/rack_setup/service.rs:1079
17712025-01-15T00:45:30.742ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ced75ba6-083a-43e1-a84f-ec7f62d8d674", "content-length": "173", "date": "Wed, 15 Jan 2025 00:45:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9\"", request_id: "ced75ba6-083a-43e1-a84f-ec7f62d8d674" } file = sled-agent/src/rack_setup/service.rs:1079
17722025-01-15T00:45:34.291ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:51877 remote_addr = [fd00:1122:3344:101::d]:32928 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17732025-01-15T00:45:34.309ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18344 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = a74b7795-5962-4388-8afa-90bdf14bfd17 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17742025-01-15T00:45:35.260ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57515
17752025-01-15T00:45:35.261ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57515 req_id = 4af604ca-0abd-4f56-b69e-910ed9f242c6 response_code = 200 uri = /baseboard
17762025-01-15T00:45:37.276ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17772025-01-15T00:45:37.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54004
17782025-01-15T00:45:37.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17792025-01-15T00:45:37.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17802025-01-15T00:45:37.371ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:177
17812025-01-15T00:45:37.373ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:177
17822025-01-15T00:45:37.385ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17832025-01-15T00:45:37.385ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0
17842025-01-15T00:45:37.411ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17852025-01-15T00:45:37.411ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba26a070-5665-4b80-b702-e0bfb62227f6
17862025-01-15T00:45:37.434ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17872025-01-15T00:45:37.434ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a6ee976a-8413-4b79-86fd-0416e935e722
17882025-01-15T00:45:37.458ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17892025-01-15T00:45:37.458ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e927d854-d6fd-4606-baca-3874882eccd4
17902025-01-15T00:45:37.479ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17912025-01-15T00:45:37.479ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c
17922025-01-15T00:45:37.498ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17932025-01-15T00:45:37.499ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4
17942025-01-15T00:45:37.522ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17952025-01-15T00:45:37.522ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4
17962025-01-15T00:45:37.542ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17972025-01-15T00:45:37.542ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc
17982025-01-15T00:45:37.563ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17992025-01-15T00:45:37.563ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549
18002025-01-15T00:45:37.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207647 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54004 req_id = a801d880-bd7c-4b10-a5af-d73d206a2470 response_code = 200 uri = /inventory
18012025-01-15T00:45:38.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36260
18022025-01-15T00:45:38.862ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18032025-01-15T00:45:38.862ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18042025-01-15T00:45:38.862ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18052025-01-15T00:45:38.862ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18062025-01-15T00:45:38.862ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18072025-01-15T00:45:38.862ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18082025-01-15T00:45:38.862ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18092025-01-15T00:45:38.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5760 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36260 req_id = c8a883f0-b993-4057-9c0c-0392600c5ba9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18102025-01-15T00:45:38.864ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
18112025-01-15T00:45:38.868ZINFOSledAgent (RSS): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18122025-01-15T00:45:38.873ZINFOSledAgent (RSS): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18132025-01-15T00:45:39.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65105
18142025-01-15T00:45:39.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18152025-01-15T00:45:39.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18162025-01-15T00:45:39.192ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:177
18172025-01-15T00:45:39.193ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:177
18182025-01-15T00:45:39.205ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18192025-01-15T00:45:39.205ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0
18202025-01-15T00:45:39.231ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18212025-01-15T00:45:39.232ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba26a070-5665-4b80-b702-e0bfb62227f6
18222025-01-15T00:45:39.256ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18232025-01-15T00:45:39.256ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a6ee976a-8413-4b79-86fd-0416e935e722
18242025-01-15T00:45:39.280ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18252025-01-15T00:45:39.280ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e927d854-d6fd-4606-baca-3874882eccd4
18262025-01-15T00:45:39.302ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18272025-01-15T00:45:39.302ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c
18282025-01-15T00:45:39.326ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18292025-01-15T00:45:39.326ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4
18302025-01-15T00:45:39.349ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18312025-01-15T00:45:39.349ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4
18322025-01-15T00:45:39.370ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18332025-01-15T00:45:39.370ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc
18342025-01-15T00:45:39.392ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18352025-01-15T00:45:39.393ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549
18362025-01-15T00:45:39.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65105 req_id = 545e0ff4-8725-4660-ab39-3b8092c004b2 response_code = 200 uri = /inventory
18372025-01-15T00:45:39.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49843
18382025-01-15T00:45:39.514ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18392025-01-15T00:45:39.514ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18402025-01-15T00:45:39.514ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18412025-01-15T00:45:39.514ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18422025-01-15T00:45:39.514ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18432025-01-15T00:45:39.514ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18442025-01-15T00:45:39.514ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18452025-01-15T00:45:39.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49843 req_id = d1481b42-57ab-49c6-9764-e5e1ac5d2cec response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18462025-01-15T00:45:39.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51645
18472025-01-15T00:45:39.868ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18482025-01-15T00:45:39.868ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18492025-01-15T00:45:39.868ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18502025-01-15T00:45:39.868ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18512025-01-15T00:45:39.868ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18522025-01-15T00:45:39.868ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18532025-01-15T00:45:39.868ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18542025-01-15T00:45:39.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51645 req_id = d1003acf-757c-4dcc-aad0-5bc90b4fb794 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18552025-01-15T00:45:40.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43577
18562025-01-15T00:45:40.015ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18572025-01-15T00:45:40.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18582025-01-15T00:45:40.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18592025-01-15T00:45:40.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18602025-01-15T00:45:40.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18612025-01-15T00:45:40.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18622025-01-15T00:45:40.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18632025-01-15T00:45:40.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43577 req_id = 749cfd64-5d23-48b2-9765-e2948c8cf3a4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18642025-01-15T00:45:45.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55064
18652025-01-15T00:45:45.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55064 req_id = 2573c67e-31d0-49eb-a229-e2e2ca7589aa response_code = 200 uri = /vpc-routes
18662025-01-15T00:45:45.271ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
18672025-01-15T00:45:45.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 566 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55064 req_id = 107cf0c5-552b-4640-a286-edabd8a266d0 response_code = 204 uri = /eip-gateways
18682025-01-15T00:45:45.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55064 req_id = fc0caafe-449e-41aa-8f9f-edcb9ceec2d9 response_code = 204 uri = /vpc-routes
18692025-01-15T00:45:52.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57008
18702025-01-15T00:45:52.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57008 req_id = 12daa571-1a5f-43be-a614-e2b4554d625e response_code = 200 uri = /vpc-routes
18712025-01-15T00:45:52.086ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
18722025-01-15T00:45:52.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57008 req_id = 444f9fd4-f46f-44f5-a9d2-c256b210d4a1 response_code = 204 uri = /eip-gateways
18732025-01-15T00:45:52.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57008 req_id = 6b355bc2-6975-4fbb-a8f1-37f40fad3cde response_code = 204 uri = /vpc-routes
18742025-01-15T00:45:52.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59750
18752025-01-15T00:45:52.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59750 req_id = 7a03125f-4ee2-4053-b42a-fefd53af2af5 response_code = 200 uri = /v2p
18762025-01-15T00:45:52.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54606
18772025-01-15T00:45:52.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54606 req_id = 6b45e231-5d80-4691-a841-c8b75a2a46db response_code = 200 uri = /vpc-routes
18782025-01-15T00:45:52.511ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
18792025-01-15T00:45:52.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54606 req_id = ed291c17-4731-4d4e-955e-c630383000f5 response_code = 204 uri = /eip-gateways
18802025-01-15T00:45:52.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54606 req_id = 1328706e-62c3-4f7d-828e-2c53c36c16b3 response_code = 204 uri = /vpc-routes
18812025-01-15T00:45:52.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38913
18822025-01-15T00:45:52.617ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18832025-01-15T00:45:52.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18842025-01-15T00:45:52.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162813 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38913 req_id = 9aae857e-b3aa-47fc-9d05-d6839705cc93 response_code = 204 uri = /switch-ports
18852025-01-15T00:45:52.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 429 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38913 req_id = ca4a3343-f7fa-4a7a-9bdf-759ca472def7 response_code = 200 uri = /network-bootstore-config
18862025-01-15T00:45:52.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47389
18872025-01-15T00:45:52.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47389 req_id = b5efe279-4a00-47f5-b384-356f9039a050 response_code = 200 uri = /v2p
18882025-01-15T00:45:52.852ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18892025-01-15T00:45:52.852ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18902025-01-15T00:45:52.853ZINFOSledAgent (bootstore): Writing ledger to /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18912025-01-15T00:45:52.854ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18922025-01-15T00:45:52.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2815 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38913 req_id = c006c047-2987-4803-9d54-4a51c1363412 response_code = 204 uri = /network-bootstore-config
18932025-01-15T00:45:52.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35962
18942025-01-15T00:45:52.877ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18952025-01-15T00:45:52.919ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18962025-01-15T00:45:52.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106155 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35962 req_id = 41bc562e-e8ce-47a0-8b07-df0db233da4f response_code = 204 uri = /switch-ports
18972025-01-15T00:45:52.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35962 req_id = 982f2fef-2d9b-49dc-bbd5-2d30718449c3 response_code = 200 uri = /network-bootstore-config
18982025-01-15T00:45:53.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42065
18992025-01-15T00:45:53.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42065 req_id = 860d17b7-a1b7-46c6-8136-03d28f3ceb64 response_code = 200 uri = /v2p
19002025-01-15T00:45:53.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39446
19012025-01-15T00:45:53.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39446 req_id = 009df9b8-a0d7-4e8f-bf99-411e1d6d2386 response_code = 200 uri = /vpc-routes
19022025-01-15T00:45:53.136ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
19032025-01-15T00:45:53.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39446 req_id = 9451bcb9-714e-4475-acfe-33ffbcd949ae response_code = 204 uri = /eip-gateways
19042025-01-15T00:45:53.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39446 req_id = df2bc14b-03ba-454e-b5b3-de128aef4cc3 response_code = 204 uri = /vpc-routes
19052025-01-15T00:45:53.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51097
19062025-01-15T00:45:53.278ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19072025-01-15T00:45:53.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19082025-01-15T00:45:53.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102391 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51097 req_id = 55f10e05-5270-4eff-9595-2c4a22e9e38d response_code = 204 uri = /switch-ports
19092025-01-15T00:45:53.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51097 req_id = a1ea363b-e225-4a30-96d1-b35e8bf3669f response_code = 200 uri = /network-bootstore-config
19102025-01-15T00:46:04.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6755 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = cad0ccf6-eb60-4535-a486-95b8f62baa1b response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
19112025-01-15T00:46:05.303ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63738
19122025-01-15T00:46:05.303ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63738 req_id = 3584f572-b6a5-48d1-b12f-cfd67a5c785e response_code = 200 uri = /baseboard
19132025-01-15T00:46:22.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59055
19142025-01-15T00:46:22.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59055 req_id = 8692c1ed-965a-40e6-9b2e-1c599d292791 response_code = 200 uri = /v2p
19152025-01-15T00:46:22.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40747
19162025-01-15T00:46:22.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40747 req_id = cc8c6cc0-8567-4098-a882-424b715de53c response_code = 200 uri = /vpc-routes
19172025-01-15T00:46:22.079ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
19182025-01-15T00:46:22.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40747 req_id = ff03c808-57e2-4588-a5e6-99377ba07292 response_code = 204 uri = /eip-gateways
19192025-01-15T00:46:22.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40747 req_id = 2d67b8ef-d1e1-4b64-9b13-6319199d5524 response_code = 204 uri = /vpc-routes
19202025-01-15T00:46:22.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60371
19212025-01-15T00:46:22.327ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19222025-01-15T00:46:22.377ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19232025-01-15T00:46:22.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122880 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60371 req_id = 276fb1da-776f-40ba-a927-8d9a5ff8b4bc response_code = 204 uri = /switch-ports
19242025-01-15T00:46:22.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43089
19252025-01-15T00:46:22.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43089 req_id = 8592b17d-3404-44d4-b145-38ad3b676207 response_code = 200 uri = /vpc-routes
19262025-01-15T00:46:22.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60371 req_id = b02c6349-2e94-47e1-90f4-57e3acdb93bc response_code = 200 uri = /network-bootstore-config
19272025-01-15T00:46:22.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61329
19282025-01-15T00:46:22.501ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19292025-01-15T00:46:22.538ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19302025-01-15T00:46:22.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90697 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61329 req_id = b1dff8c1-31a4-41e4-b400-9986d606d59e response_code = 204 uri = /switch-ports
19312025-01-15T00:46:22.591ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
19322025-01-15T00:46:22.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43089 req_id = 2557178a-ca57-49b1-a391-3388a9a434a7 response_code = 204 uri = /eip-gateways
19332025-01-15T00:46:22.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61329 req_id = a436ea3a-a460-455b-86ca-4e980e118c0b response_code = 200 uri = /network-bootstore-config
19342025-01-15T00:46:22.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44530
19352025-01-15T00:46:22.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44530 req_id = d152ab4f-42f9-4fb7-91f8-3028ccc6f241 response_code = 200 uri = /v2p
19362025-01-15T00:46:22.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43089 req_id = 8067e315-18d1-4d7c-802d-275b75df7a44 response_code = 204 uri = /vpc-routes
19372025-01-15T00:46:22.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44968
19382025-01-15T00:46:22.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44968 req_id = c4ba3ce0-1241-44f5-9fb0-d9a6d6c78b54 response_code = 200 uri = /v2p
19392025-01-15T00:46:22.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47625
19402025-01-15T00:46:22.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47625 req_id = a0635335-0f68-42cc-9eb9-8dddde78b46b response_code = 200 uri = /vpc-routes
19412025-01-15T00:46:22.991ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
19422025-01-15T00:46:22.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47625 req_id = 1f811928-81b1-45db-a4c6-2c257a0fb737 response_code = 204 uri = /eip-gateways
19432025-01-15T00:46:23.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47625 req_id = 965fae7f-2116-4107-a0d1-2f2ca046d58b response_code = 204 uri = /vpc-routes
19442025-01-15T00:46:23.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61803
19452025-01-15T00:46:23.105ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19462025-01-15T00:46:23.145ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19472025-01-15T00:46:23.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61803 req_id = 5c18bb24-5733-4cca-8232-d0496f8cde10 response_code = 204 uri = /switch-ports
19482025-01-15T00:46:23.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61803 req_id = 342f314f-f337-45f0-b9d0-0e6c8c200458 response_code = 200 uri = /network-bootstore-config
19492025-01-15T00:46:34.300ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9202 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 336202dd-fdbc-4624-9870-3a9f4532688d response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
19502025-01-15T00:46:35.337ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60615
19512025-01-15T00:46:35.337ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60615 req_id = ac24bb94-9c90-49a0-9a6a-3de1186870f6 response_code = 200 uri = /baseboard
19522025-01-15T00:46:52.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55147
19532025-01-15T00:46:52.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55147 req_id = 115c9f3c-6dee-44f8-87bb-6ef104323f52 response_code = 200 uri = /v2p
19542025-01-15T00:46:52.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63924
19552025-01-15T00:46:52.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63924 req_id = 3e859ee4-98aa-4b26-9bc0-f88397838771 response_code = 200 uri = /vpc-routes
19562025-01-15T00:46:52.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
19572025-01-15T00:46:52.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63924 req_id = 1f5be622-ba94-4603-8ab2-5c7d3ef18854 response_code = 204 uri = /eip-gateways
19582025-01-15T00:46:52.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63924 req_id = 1e194314-8f21-4b87-a6f5-3f1a070906b2 response_code = 204 uri = /vpc-routes
19592025-01-15T00:46:52.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36421
19602025-01-15T00:46:52.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36421 req_id = 8e6119b6-82e8-45a6-9010-d713494af05b response_code = 200 uri = /vpc-routes
19612025-01-15T00:46:52.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
19622025-01-15T00:46:52.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36421 req_id = 417fe1ef-6b99-4c30-975e-62c769cb830c response_code = 204 uri = /eip-gateways
19632025-01-15T00:46:52.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33641
19642025-01-15T00:46:52.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33641 req_id = ecb1e828-50f4-4fcc-b1d3-7350f0bc2713 response_code = 200 uri = /v2p
19652025-01-15T00:46:52.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36421 req_id = 43ead37e-73fe-437f-881f-d1cd6f4f8ffe response_code = 204 uri = /vpc-routes
19662025-01-15T00:46:52.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45913
19672025-01-15T00:46:52.805ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19682025-01-15T00:46:52.846ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19692025-01-15T00:46:52.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104060 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45913 req_id = f64d6433-66da-4a15-940e-780b1fe3f2dd response_code = 204 uri = /switch-ports
19702025-01-15T00:46:52.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55689
19712025-01-15T00:46:52.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45913 req_id = 778de512-ff47-44ee-9ea3-940e854447b6 response_code = 200 uri = /network-bootstore-config
19722025-01-15T00:46:52.909ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19732025-01-15T00:46:52.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19742025-01-15T00:46:52.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42971
19752025-01-15T00:46:52.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42971 req_id = 61efabb9-2374-4306-98f1-3cafa0ec73eb response_code = 200 uri = /vpc-routes
19762025-01-15T00:46:53.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103531 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55689 req_id = fd48bd65-ee5e-401c-b367-1db384912bd2 response_code = 204 uri = /switch-ports
19772025-01-15T00:46:53.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55689 req_id = 5f39caf4-02e4-4f21-8661-e9c6752407a9 response_code = 200 uri = /network-bootstore-config
19782025-01-15T00:46:53.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36395
19792025-01-15T00:46:53.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36395 req_id = 860c4bb1-8fbe-4dbb-9f5b-4688259c7ec6 response_code = 200 uri = /v2p
19802025-01-15T00:46:53.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58950
19812025-01-15T00:46:53.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19822025-01-15T00:46:53.275ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19832025-01-15T00:46:53.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87038 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58950 req_id = 60bed46a-5b48-4296-982d-e3ff35b11ea5 response_code = 204 uri = /switch-ports
19842025-01-15T00:46:53.327ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
19852025-01-15T00:46:53.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42971 req_id = 5cde1833-aed4-4974-b8b4-d3a5b71f232a response_code = 204 uri = /eip-gateways
19862025-01-15T00:46:53.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58950 req_id = 8ee56f8b-77bb-464e-85a6-4d2a552ebd8c response_code = 200 uri = /network-bootstore-config
19872025-01-15T00:46:53.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42971 req_id = 0bd48e41-a943-4a7c-a79d-b42a5afea1aa response_code = 204 uri = /vpc-routes
19882025-01-15T00:47:04.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7405 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 79c650c2-514a-4905-a777-fa0b754a6af8 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
19892025-01-15T00:47:05.371ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44083
19902025-01-15T00:47:05.371ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44083 req_id = 6eef7af2-f98b-4eb0-a72b-b5cd1c7f3ae9 response_code = 200 uri = /baseboard
19912025-01-15T00:47:22.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59002
19922025-01-15T00:47:22.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59002 req_id = 699eb52f-485c-49dd-9ac1-50655d8de390 response_code = 200 uri = /vpc-routes
19932025-01-15T00:47:22.089ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
19942025-01-15T00:47:22.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59002 req_id = cfd6c34a-fd5f-4d50-8295-abe9d85f62a8 response_code = 204 uri = /eip-gateways
19952025-01-15T00:47:22.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48232
19962025-01-15T00:47:22.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48232 req_id = 502012ab-c533-4c23-a4b7-16edb0637df2 response_code = 200 uri = /v2p
19972025-01-15T00:47:22.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59002 req_id = 204c98aa-d6e7-43e7-b5ec-ed8271eb6036 response_code = 204 uri = /vpc-routes
19982025-01-15T00:47:22.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48110
19992025-01-15T00:47:22.217ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20002025-01-15T00:47:22.259ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20012025-01-15T00:47:22.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117529 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48110 req_id = b2d2989e-849c-4e62-8209-75429e95161f response_code = 204 uri = /switch-ports
20022025-01-15T00:47:22.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49879
20032025-01-15T00:47:22.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49879 req_id = b63bf3f6-3962-4d77-ad5b-b2587404cd11 response_code = 200 uri = /vpc-routes
20042025-01-15T00:47:22.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48110 req_id = 1257b8a9-1b38-43e5-8bf2-37c42c21d7ee response_code = 200 uri = /network-bootstore-config
20052025-01-15T00:47:22.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38654
20062025-01-15T00:47:22.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38654 req_id = d24c1c1a-9857-4b4b-a872-1c65b9caccd2 response_code = 200 uri = /v2p
20072025-01-15T00:47:22.430ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
20082025-01-15T00:47:22.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49879 req_id = 4706ad0f-df27-4432-93d9-869aaa7a0b10 response_code = 204 uri = /eip-gateways
20092025-01-15T00:47:22.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58501
20102025-01-15T00:47:22.500ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20112025-01-15T00:47:22.539ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20122025-01-15T00:47:22.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98504 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58501 req_id = 6b3b6b2a-c07a-4bce-a5c7-11575eaf6a23 response_code = 204 uri = /switch-ports
20132025-01-15T00:47:22.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58501 req_id = 5f71591b-6acd-4fdf-9570-92a6b2fd8ae9 response_code = 200 uri = /network-bootstore-config
20142025-01-15T00:47:22.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 470 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49879 req_id = 8b12c5bc-5fb3-46a8-8b3a-11af6e5397c1 response_code = 204 uri = /vpc-routes
20152025-01-15T00:47:22.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53430
20162025-01-15T00:47:22.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53430 req_id = ef38f3c7-f937-4546-acb5-fe85eff52f58 response_code = 200 uri = /vpc-routes
20172025-01-15T00:47:22.895ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
20182025-01-15T00:47:22.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53430 req_id = 05ab90dc-1cc0-4e7e-839e-8747d1223c55 response_code = 204 uri = /eip-gateways
20192025-01-15T00:47:22.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53430 req_id = 1fdcb57b-115b-4762-974d-f134b2d761a5 response_code = 204 uri = /vpc-routes
20202025-01-15T00:47:22.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39185
20212025-01-15T00:47:22.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39185 req_id = eb34ef4e-2742-4c8b-b054-b22a85509cfe response_code = 200 uri = /v2p
20222025-01-15T00:47:23.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61838
20232025-01-15T00:47:23.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20242025-01-15T00:47:23.118ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20252025-01-15T00:47:23.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61838 req_id = b2d941a7-d42d-4576-a478-26f8c2a475bc response_code = 204 uri = /switch-ports
20262025-01-15T00:47:23.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61838 req_id = 28d364b1-cc5a-4e90-a72e-4fa3fd70cd30 response_code = 200 uri = /network-bootstore-config
20272025-01-15T00:47:34.296ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5523 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 7e8bc608-5715-4eb0-b085-8ea8dd79ba31 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20282025-01-15T00:47:35.405ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58673
20292025-01-15T00:47:35.406ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58673 req_id = 0902b7f9-e774-4e3d-aa16-1ef114e70f9b response_code = 200 uri = /baseboard
20302025-01-15T00:47:52.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38691
20312025-01-15T00:47:52.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38691 req_id = bbe30b38-9b0d-4db1-b8e8-8b783832fbe0 response_code = 200 uri = /vpc-routes
20322025-01-15T00:47:52.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45293
20332025-01-15T00:47:52.456ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20342025-01-15T00:47:52.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20352025-01-15T00:47:52.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93565 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45293 req_id = 9541c0eb-d0b4-4f2d-828d-b5c8dab879b0 response_code = 204 uri = /switch-ports
20362025-01-15T00:47:52.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34470
20372025-01-15T00:47:52.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
20382025-01-15T00:47:52.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38691 req_id = 40a74fb4-aaab-4e5c-8d28-69c40893b32c response_code = 204 uri = /eip-gateways
20392025-01-15T00:47:52.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39650
20402025-01-15T00:47:52.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34470 req_id = 95da844b-f2b5-4153-916c-841347387209 response_code = 200 uri = /vpc-routes
20412025-01-15T00:47:52.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45293 req_id = 338a29d8-7cec-44a7-b2f7-2682c2b98a34 response_code = 200 uri = /network-bootstore-config
20422025-01-15T00:47:52.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39650 req_id = 5fa4581d-03cc-4c2d-a156-172146b71032 response_code = 200 uri = /v2p
20432025-01-15T00:47:52.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38691 req_id = df2e4d02-a0d5-4bbe-8b9d-8b0c5b16d2cd response_code = 204 uri = /vpc-routes
20442025-01-15T00:47:52.564ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
20452025-01-15T00:47:52.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34470 req_id = d0dfd8c2-affa-447a-b926-402a0fb35545 response_code = 204 uri = /eip-gateways
20462025-01-15T00:47:52.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32841
20472025-01-15T00:47:52.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32841 req_id = f2f3c86d-1e2f-4579-8cc2-9f8a828e0abc response_code = 200 uri = /v2p
20482025-01-15T00:47:52.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34470 req_id = b83d579d-f25b-4ec2-98c4-fa8146fbb7e1 response_code = 204 uri = /vpc-routes
20492025-01-15T00:47:52.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64743
20502025-01-15T00:47:52.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20512025-01-15T00:47:52.910ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20522025-01-15T00:47:52.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64743 req_id = 273200ff-b10d-4a52-a5d3-574dbd10eefd response_code = 204 uri = /switch-ports
20532025-01-15T00:47:52.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64743 req_id = 582ced20-3311-4816-8a2e-5ca7e1448a15 response_code = 200 uri = /network-bootstore-config
20542025-01-15T00:47:53.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54223
20552025-01-15T00:47:53.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54223 req_id = f64caad4-de82-44bc-9179-be202f6b13ea response_code = 200 uri = /vpc-routes
20562025-01-15T00:47:53.056ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
20572025-01-15T00:47:53.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54223 req_id = 9f68aff7-37ca-41c5-9202-344657f2a607 response_code = 204 uri = /eip-gateways
20582025-01-15T00:47:53.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34471
20592025-01-15T00:47:53.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34471 req_id = 2c985d81-eebc-4f1a-8b03-8a8fe36bb0a7 response_code = 200 uri = /v2p
20602025-01-15T00:47:53.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54223 req_id = 9dabeaf6-aed4-46b8-a2de-6a2159158caa response_code = 204 uri = /vpc-routes
20612025-01-15T00:47:53.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61764
20622025-01-15T00:47:53.325ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20632025-01-15T00:47:53.365ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20642025-01-15T00:47:53.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61764 req_id = 6e8168d2-1a11-465e-9b75-6e3ad4386439 response_code = 204 uri = /switch-ports
20652025-01-15T00:47:53.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61764 req_id = 27ab4d0a-92b2-4f07-a2a8-543d08848d48 response_code = 200 uri = /network-bootstore-config
20662025-01-15T00:48:04.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6340 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 4f504de9-b59b-4285-9f09-f4ef39f3c1c8 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20672025-01-15T00:48:05.441ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38536
20682025-01-15T00:48:05.441ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38536 req_id = b1121902-8941-4ff5-80e2-f28072a3e220 response_code = 200 uri = /baseboard
20692025-01-15T00:48:22.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33016
20702025-01-15T00:48:22.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33016 req_id = 917773a0-4c2a-49ad-b57f-b5d3ff5be814 response_code = 200 uri = /vpc-routes
20712025-01-15T00:48:22.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56323
20722025-01-15T00:48:22.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20732025-01-15T00:48:22.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20742025-01-15T00:48:22.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56323 req_id = 5fc27d0f-abfb-44c3-8cef-cdc2d80cdff7 response_code = 204 uri = /switch-ports
20752025-01-15T00:48:22.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57144
20762025-01-15T00:48:22.327ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
20772025-01-15T00:48:22.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33016 req_id = 11fcaf85-5234-4bf9-a238-a234c8c4bdb5 response_code = 204 uri = /eip-gateways
20782025-01-15T00:48:22.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56323 req_id = b1d33b73-7ebd-4b40-86c3-6494126f5e14 response_code = 200 uri = /network-bootstore-config
20792025-01-15T00:48:22.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57144 req_id = 3ec5e8bf-cd04-4c0c-8c83-8303f93f2a4f response_code = 200 uri = /vpc-routes
20802025-01-15T00:48:22.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33016 req_id = 0af973dc-08dc-41ca-9199-5b96a5a4454b response_code = 204 uri = /vpc-routes
20812025-01-15T00:48:22.376ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
20822025-01-15T00:48:22.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57144 req_id = e3227ad6-5500-4240-a346-0bf7616284f1 response_code = 204 uri = /eip-gateways
20832025-01-15T00:48:22.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57144 req_id = f9640a2e-d0cc-4a4e-826a-f7a9dc4d2d5f response_code = 204 uri = /vpc-routes
20842025-01-15T00:48:22.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50150
20852025-01-15T00:48:22.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50150 req_id = 02eb7548-b116-4f4d-881e-50cea4744d41 response_code = 200 uri = /v2p
20862025-01-15T00:48:22.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36802
20872025-01-15T00:48:22.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36802 req_id = 611abcd1-e600-46cd-8256-36562dd63e74 response_code = 200 uri = /v2p
20882025-01-15T00:48:22.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55475
20892025-01-15T00:48:22.723ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20902025-01-15T00:48:22.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20912025-01-15T00:48:22.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98815 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55475 req_id = d6fd19be-01f5-440d-a81a-12bd73442862 response_code = 204 uri = /switch-ports
20922025-01-15T00:48:22.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55475 req_id = cb28b6c3-b50f-4a21-9f71-97fcf5a39ef6 response_code = 200 uri = /network-bootstore-config
20932025-01-15T00:48:22.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32914
20942025-01-15T00:48:22.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32914 req_id = 9f2cce1c-18f9-4d71-8799-79613d98bd05 response_code = 200 uri = /vpc-routes
20952025-01-15T00:48:22.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
20962025-01-15T00:48:22.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32914 req_id = 7eff9699-b0a2-4a4f-8e4d-b19c74d47c8b response_code = 204 uri = /eip-gateways
20972025-01-15T00:48:22.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32914 req_id = 664bd16f-a845-4a6f-9d58-109c0c9d15cd response_code = 204 uri = /vpc-routes
20982025-01-15T00:48:22.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61032
20992025-01-15T00:48:22.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61032 req_id = f0550d7d-d880-454c-906c-7f02544fc827 response_code = 200 uri = /v2p
21002025-01-15T00:48:22.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55500
21012025-01-15T00:48:22.977ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21022025-01-15T00:48:23.013ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21032025-01-15T00:48:23.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92394 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55500 req_id = c138f40d-cfc4-446f-85cf-dfea7d8b7e1f response_code = 204 uri = /switch-ports
21042025-01-15T00:48:23.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55500 req_id = 0e2a3b21-155e-4f87-ac7e-0f547d40b5d3 response_code = 200 uri = /network-bootstore-config
21052025-01-15T00:48:34.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6377 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = f28ad6f8-9dff-4895-9278-b4407eca6cda response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21062025-01-15T00:48:35.475ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37821
21072025-01-15T00:48:35.475ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37821 req_id = 0c5d17c4-507f-4931-9ec2-512abcf3ac82 response_code = 200 uri = /baseboard
21082025-01-15T00:48:52.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37744
21092025-01-15T00:48:52.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37744 req_id = 4100069d-215d-4ef3-b73e-164537d8e735 response_code = 200 uri = /vpc-routes
21102025-01-15T00:48:52.343ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
21112025-01-15T00:48:52.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37744 req_id = 47d9cabe-81de-49ab-847d-3ec1a534ad73 response_code = 204 uri = /eip-gateways
21122025-01-15T00:48:52.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37744 req_id = 7eecf7e6-c839-498e-95b4-dfc96402e391 response_code = 204 uri = /vpc-routes
21132025-01-15T00:48:52.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35157
21142025-01-15T00:48:52.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35157 req_id = 121eae3f-e41d-44e1-9c78-960bc4857311 response_code = 200 uri = /vpc-routes
21152025-01-15T00:48:52.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58364
21162025-01-15T00:48:52.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58364 req_id = 2b54b3ed-ee44-40ce-95fd-085152db495e response_code = 200 uri = /v2p
21172025-01-15T00:48:52.475ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
21182025-01-15T00:48:52.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35157 req_id = 31121206-47ad-49e3-bd8e-7b892a1adfb9 response_code = 204 uri = /eip-gateways
21192025-01-15T00:48:52.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35157 req_id = 28e58121-19ef-47b5-902e-cde72998d6a9 response_code = 204 uri = /vpc-routes
21202025-01-15T00:48:52.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47135
21212025-01-15T00:48:52.623ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21222025-01-15T00:48:52.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21232025-01-15T00:48:52.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133652 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47135 req_id = 8cfaeb66-27a2-4945-8a7e-1fd5bf6a6408 response_code = 204 uri = /switch-ports
21242025-01-15T00:48:52.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43007
21252025-01-15T00:48:52.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43007 req_id = c6421940-743b-43c8-b007-d57edff0eb60 response_code = 200 uri = /v2p
21262025-01-15T00:48:52.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47135 req_id = 0f2d1f0b-f715-4c4a-9ed0-61dce6711d1a response_code = 200 uri = /network-bootstore-config
21272025-01-15T00:48:52.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36335
21282025-01-15T00:48:52.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36335 req_id = 99362030-2fb1-4e48-ac74-c6ad52782fa7 response_code = 200 uri = /vpc-routes
21292025-01-15T00:48:52.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41249
21302025-01-15T00:48:52.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21312025-01-15T00:48:53.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21322025-01-15T00:48:53.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94534 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41249 req_id = 9e5752a5-eb64-47c2-86ca-6cfb7bfd0785 response_code = 204 uri = /switch-ports
21332025-01-15T00:48:53.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
21342025-01-15T00:48:53.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36335 req_id = df8da1bd-8857-4d6a-8c73-ea7c44095366 response_code = 204 uri = /eip-gateways
21352025-01-15T00:48:53.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41249 req_id = ce4360b0-50e1-4fc3-bbb0-644d2153e4e8 response_code = 200 uri = /network-bootstore-config
21362025-01-15T00:48:53.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53260
21372025-01-15T00:48:53.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53260 req_id = bd96ed37-f2ef-435b-bd35-a78a04a09610 response_code = 200 uri = /v2p
21382025-01-15T00:48:53.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36335 req_id = 63281c9c-8e58-4fa8-bbb0-c3c0b6a6d807 response_code = 204 uri = /vpc-routes
21392025-01-15T00:48:53.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42307
21402025-01-15T00:48:53.122ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21412025-01-15T00:48:53.158ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21422025-01-15T00:48:53.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92215 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42307 req_id = 15ace1bf-7328-4365-80cb-ffcd2aca17f8 response_code = 204 uri = /switch-ports
21432025-01-15T00:48:53.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42307 req_id = 7278bfdd-ec94-4ad1-bd2c-ab46dac97da7 response_code = 200 uri = /network-bootstore-config
21442025-01-15T00:49:04.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6895 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 57ce0d74-dc7a-4110-961a-97d505bc7b99 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21452025-01-15T00:49:05.510ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37974
21462025-01-15T00:49:05.510ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37974 req_id = a60d5cf2-948d-4ae4-9e10-86862a64aa98 response_code = 200 uri = /baseboard
21472025-01-15T00:49:21.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36123
21482025-01-15T00:49:21.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36123 req_id = e6783e2b-2ce6-4492-8451-3f7d4a17c0ee response_code = 200 uri = /vpc-routes
21492025-01-15T00:49:22.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
21502025-01-15T00:49:22.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36123 req_id = 8621f09c-7fe8-4854-b23e-8262152394e0 response_code = 204 uri = /eip-gateways
21512025-01-15T00:49:22.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36123 req_id = 5797da05-5fb2-47ec-87c8-da5c7d847e36 response_code = 204 uri = /vpc-routes
21522025-01-15T00:49:22.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64899
21532025-01-15T00:49:22.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64899 req_id = a3464f32-5dd1-402a-8af2-843025313a93 response_code = 200 uri = /v2p
21542025-01-15T00:49:22.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56925
21552025-01-15T00:49:22.188ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21562025-01-15T00:49:22.230ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21572025-01-15T00:49:22.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111386 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56925 req_id = c6d2415d-964d-4c1e-9db4-975cfaec8292 response_code = 204 uri = /switch-ports
21582025-01-15T00:49:22.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52427
21592025-01-15T00:49:22.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52427 req_id = 978d9787-2e4a-48db-aaf0-c3286b368e13 response_code = 200 uri = /vpc-routes
21602025-01-15T00:49:22.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56925 req_id = a3255ad7-3c7d-4ed8-b002-8b683f2ef5f5 response_code = 200 uri = /network-bootstore-config
21612025-01-15T00:49:22.347ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
21622025-01-15T00:49:22.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52427 req_id = 46b8849f-e547-4194-90b0-235bc5ea072f response_code = 204 uri = /eip-gateways
21632025-01-15T00:49:22.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52427 req_id = 2e3ce76d-27ca-4438-8f40-573416399a6b response_code = 204 uri = /vpc-routes
21642025-01-15T00:49:22.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37764
21652025-01-15T00:49:22.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37764 req_id = 8f19109e-f8d0-49a8-833e-1c5ca132c2e6 response_code = 200 uri = /v2p
21662025-01-15T00:49:22.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52813
21672025-01-15T00:49:22.433ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21682025-01-15T00:49:22.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21692025-01-15T00:49:22.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95047 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52813 req_id = dcae61a8-af3f-4be0-a82e-9182322149f1 response_code = 204 uri = /switch-ports
21702025-01-15T00:49:22.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52813 req_id = 4bf09e31-647e-46cd-8f68-5b6b9f304608 response_code = 200 uri = /network-bootstore-config
21712025-01-15T00:49:22.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33353
21722025-01-15T00:49:22.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33353 req_id = a4af91c0-755a-4f3c-b2e1-e4e50713bab5 response_code = 200 uri = /vpc-routes
21732025-01-15T00:49:22.856ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
21742025-01-15T00:49:22.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33353 req_id = 186acfd7-ec79-466d-bfeb-78c12af611f6 response_code = 204 uri = /eip-gateways
21752025-01-15T00:49:22.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33353 req_id = cb17cfe7-0ab0-4dc9-94b5-ace06bdeb3ef response_code = 204 uri = /vpc-routes
21762025-01-15T00:49:22.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44601
21772025-01-15T00:49:22.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44601 req_id = 5445f7df-cc13-4dad-84d0-9eaac428413b response_code = 200 uri = /v2p
21782025-01-15T00:49:22.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33845
21792025-01-15T00:49:22.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21802025-01-15T00:49:23.007ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21812025-01-15T00:49:23.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91202 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33845 req_id = 11c470dc-889d-4741-beb9-dce061b7b792 response_code = 204 uri = /switch-ports
21822025-01-15T00:49:23.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33845 req_id = 4d44a288-e135-46d5-962c-00a48934fcca response_code = 200 uri = /network-bootstore-config
21832025-01-15T00:49:34.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6326 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 2b17e58d-f3e6-4934-9e97-6182e462aae1 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21842025-01-15T00:49:35.542ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43117
21852025-01-15T00:49:35.542ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43117 req_id = 7f8bd9d4-79d2-499f-9537-9161a480e33c response_code = 200 uri = /baseboard
21862025-01-15T00:49:38.279ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
21872025-01-15T00:49:38.280ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21882025-01-15T00:49:38.312ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1798, tv_nsec: 642554096 } time_to_next_cleanup = 599.999995949s
21892025-01-15T00:49:52.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34459
21902025-01-15T00:49:52.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34459 req_id = 27c83031-dc4d-43ce-8111-ddaba816db63 response_code = 200 uri = /vpc-routes
21912025-01-15T00:49:52.358ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
21922025-01-15T00:49:52.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34459 req_id = e7e11711-42b7-4a06-a723-7a7736683392 response_code = 204 uri = /eip-gateways
21932025-01-15T00:49:52.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34459 req_id = 40ee3eeb-b41d-4470-81af-a1c8143e92c4 response_code = 204 uri = /vpc-routes
21942025-01-15T00:49:52.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47097
21952025-01-15T00:49:52.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47097 req_id = beba8ed9-7ece-4afa-8b03-4d543b8f19fa response_code = 200 uri = /v2p
21962025-01-15T00:49:52.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47224
21972025-01-15T00:49:52.504ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21982025-01-15T00:49:52.540ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21992025-01-15T00:49:52.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89401 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47224 req_id = 5596b572-0b42-48f1-8dd0-25d8770ff883 response_code = 204 uri = /switch-ports
22002025-01-15T00:49:52.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40966
22012025-01-15T00:49:52.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59863
22022025-01-15T00:49:52.593ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22032025-01-15T00:49:52.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59863 req_id = 0108cb40-5cf0-4cef-905a-ea8d0350bb0a response_code = 200 uri = /v2p
22042025-01-15T00:49:52.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40966 req_id = bb9f07b9-6af1-4932-8877-50f845380ce9 response_code = 200 uri = /vpc-routes
22052025-01-15T00:49:52.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47224 req_id = b1639e96-6cb7-46b1-8ce8-106618afd95b response_code = 200 uri = /network-bootstore-config
22062025-01-15T00:49:52.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63815
22072025-01-15T00:49:52.614ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22082025-01-15T00:49:52.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22092025-01-15T00:49:52.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22102025-01-15T00:49:52.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22112025-01-15T00:49:52.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22122025-01-15T00:49:52.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22132025-01-15T00:49:52.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22142025-01-15T00:49:52.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63815 req_id = 9561e83d-ea33-45aa-b1a4-e6f13a34c88c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22152025-01-15T00:49:52.656ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
22162025-01-15T00:49:52.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40966 req_id = d97de571-ea65-4898-a29b-465964da3ac0 response_code = 204 uri = /eip-gateways
22172025-01-15T00:49:52.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40966 req_id = 8d866c6a-4ddc-467d-8c7e-8d1917c3f721 response_code = 204 uri = /vpc-routes
22182025-01-15T00:49:52.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63945
22192025-01-15T00:49:52.698ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22202025-01-15T00:49:52.748ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22212025-01-15T00:49:52.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114938 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63945 req_id = 232a7ae6-11ca-4ff3-8fa0-6a04322d2659 response_code = 204 uri = /switch-ports
22222025-01-15T00:49:52.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63945 req_id = 3a6b4f66-1bf7-4c01-b81e-2b8ef1e4ffc8 response_code = 200 uri = /network-bootstore-config
22232025-01-15T00:49:52.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53334
22242025-01-15T00:49:52.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53334 req_id = 856eb967-d655-41e1-b2d9-1a2dffb3dba5 response_code = 200 uri = /vpc-routes
22252025-01-15T00:49:52.945ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
22262025-01-15T00:49:52.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53334 req_id = 4c4e8f4b-e7f1-487c-b4f7-3d15781a3e55 response_code = 204 uri = /eip-gateways
22272025-01-15T00:49:52.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53334 req_id = 22dccdf2-bd58-42b7-9d08-010e8ae3889c response_code = 204 uri = /vpc-routes
22282025-01-15T00:49:52.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38955
22292025-01-15T00:49:52.965ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22302025-01-15T00:49:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22312025-01-15T00:49:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22322025-01-15T00:49:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22332025-01-15T00:49:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22342025-01-15T00:49:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22352025-01-15T00:49:52.965ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22362025-01-15T00:49:52.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38955 req_id = ea2722d8-7c71-4eec-a4b2-d00d6d1a1479 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22372025-01-15T00:49:53.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51344
22382025-01-15T00:49:53.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51344 req_id = 12e23079-a217-4f80-a551-403b8da16b06 response_code = 200 uri = /v2p
22392025-01-15T00:49:53.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33780
22402025-01-15T00:49:53.262ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22412025-01-15T00:49:53.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22422025-01-15T00:49:53.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109699 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33780 req_id = afa30156-1600-4299-b378-f5303f8280a8 response_code = 204 uri = /switch-ports
22432025-01-15T00:49:53.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33780 req_id = 98e0e7b3-103b-4060-af75-10c8718dba9a response_code = 200 uri = /network-bootstore-config
22442025-01-15T00:49:53.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35153
22452025-01-15T00:49:53.395ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22462025-01-15T00:49:53.395ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22472025-01-15T00:49:53.395ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22482025-01-15T00:49:53.395ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22492025-01-15T00:49:53.395ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22502025-01-15T00:49:53.395ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22512025-01-15T00:49:53.395ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22522025-01-15T00:49:53.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35153 req_id = 8138d199-2f4c-4f88-8675-b478232f5003 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22532025-01-15T00:50:04.299ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7895 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 058b1e47-2552-4bb0-a6d0-ac41a9dd54fc response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
22542025-01-15T00:50:05.573ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64684
22552025-01-15T00:50:05.574ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64684 req_id = 9c24cdcc-ff24-416c-a00f-aa3f2e6b4aa5 response_code = 200 uri = /baseboard
22562025-01-15T00:50:22.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41369
22572025-01-15T00:50:22.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41369 req_id = c2cd48b3-f758-4b5b-8e68-086757afdb4a response_code = 200 uri = /vpc-routes
22582025-01-15T00:50:22.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
22592025-01-15T00:50:22.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41369 req_id = 726223a5-4d49-4f24-b850-211ed935a0dc response_code = 204 uri = /eip-gateways
22602025-01-15T00:50:22.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41369 req_id = a71b6413-71e3-424f-83c6-978f5f2ac1cd response_code = 204 uri = /vpc-routes
22612025-01-15T00:50:22.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46882
22622025-01-15T00:50:22.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46882 req_id = 106c45e2-4548-46a0-9ea3-39589a23d275 response_code = 200 uri = /v2p
22632025-01-15T00:50:22.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62938
22642025-01-15T00:50:22.188ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22652025-01-15T00:50:22.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22662025-01-15T00:50:22.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102051 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62938 req_id = 1365662e-b745-4c1b-b4cd-23962e4c4955 response_code = 204 uri = /switch-ports
22672025-01-15T00:50:22.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62938 req_id = e2d0b539-9113-46de-9db3-8ff5ec552612 response_code = 200 uri = /network-bootstore-config
22682025-01-15T00:50:22.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37911
22692025-01-15T00:50:22.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37911 req_id = 678373fe-0fc5-4845-8272-95028f6ef48e response_code = 200 uri = /vpc-routes
22702025-01-15T00:50:22.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56562
22712025-01-15T00:50:22.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56562 req_id = d6a46679-408e-4590-bfa1-e22ecea4171e response_code = 200 uri = /v2p
22722025-01-15T00:50:22.394ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
22732025-01-15T00:50:22.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37911 req_id = e19f51e4-6378-43c3-bb9d-6a5367d79fe5 response_code = 204 uri = /eip-gateways
22742025-01-15T00:50:22.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37911 req_id = 2b16fb55-dc7f-48bb-857d-5abb5cfad7b0 response_code = 204 uri = /vpc-routes
22752025-01-15T00:50:22.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51147
22762025-01-15T00:50:22.443ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22772025-01-15T00:50:22.480ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22782025-01-15T00:50:22.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51147 req_id = 85ec1f21-3d9e-4cd7-a320-5a208b714593 response_code = 204 uri = /switch-ports
22792025-01-15T00:50:22.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51147 req_id = b1300d91-6184-4fb5-af7f-301f6a2402ca response_code = 200 uri = /network-bootstore-config
22802025-01-15T00:50:22.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40178
22812025-01-15T00:50:22.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40178 req_id = dd329fb4-b42e-44b6-8f40-6dfe1d0e0403 response_code = 200 uri = /vpc-routes
22822025-01-15T00:50:22.803ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
22832025-01-15T00:50:22.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40178 req_id = faea6b0a-b4c3-4821-8902-6eea59f90cbb response_code = 204 uri = /eip-gateways
22842025-01-15T00:50:22.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40178 req_id = f0dcc374-3356-4277-9d80-49dc033863d3 response_code = 204 uri = /vpc-routes
22852025-01-15T00:50:22.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33934
22862025-01-15T00:50:22.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22872025-01-15T00:50:22.990ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22882025-01-15T00:50:23.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96333 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33934 req_id = 9d565e82-1b9c-40a0-bcc7-97de3b3edb45 response_code = 204 uri = /switch-ports
22892025-01-15T00:50:23.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60360
22902025-01-15T00:50:23.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60360 req_id = 2f252d65-c27a-4efc-8361-d0bd0f49f80d response_code = 200 uri = /v2p
22912025-01-15T00:50:23.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33934 req_id = e19940da-ee57-4975-a686-b3f7aacdb5d8 response_code = 200 uri = /network-bootstore-config
22922025-01-15T00:50:34.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6625 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 09b67f3c-6782-41fe-8256-32c9b9fd1c17 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
22932025-01-15T00:50:35.606ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35576
22942025-01-15T00:50:35.606ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35576 req_id = a1f51395-904d-4034-8453-ad585061ea10 response_code = 200 uri = /baseboard
22952025-01-15T00:50:52.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44508
22962025-01-15T00:50:52.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44508 req_id = 768ee81f-ff9c-44ea-aba1-b50f1717e1c8 response_code = 200 uri = /vpc-routes
22972025-01-15T00:50:52.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
22982025-01-15T00:50:52.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44508 req_id = 2046e50d-330b-47a0-853f-bfbfdead4bb5 response_code = 204 uri = /eip-gateways
22992025-01-15T00:50:52.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46990
23002025-01-15T00:50:52.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46990 req_id = c0596124-b320-4599-ba53-48f835b89a0f response_code = 200 uri = /vpc-routes
23012025-01-15T00:50:52.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55367
23022025-01-15T00:50:52.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55367 req_id = 82a5d246-62c4-4433-8f24-0ffdbd4fed7a response_code = 200 uri = /v2p
23032025-01-15T00:50:52.408ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
23042025-01-15T00:50:52.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46990 req_id = feef5860-6cfc-47fd-a9ff-008a033a7064 response_code = 204 uri = /eip-gateways
23052025-01-15T00:50:52.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44508 req_id = 02fb11e2-1db7-4eca-b33e-8378b03b8e36 response_code = 204 uri = /vpc-routes
23062025-01-15T00:50:52.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46990 req_id = cbf59990-7b26-4661-a9ed-cb1932e98fc2 response_code = 204 uri = /vpc-routes
23072025-01-15T00:50:52.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65124
23082025-01-15T00:50:52.494ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23092025-01-15T00:50:52.531ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23102025-01-15T00:50:52.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92799 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65124 req_id = 147688fd-dab3-4d8c-93cc-5ef3b6fe7453 response_code = 204 uri = /switch-ports
23112025-01-15T00:50:52.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62519
23122025-01-15T00:50:52.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62519 req_id = 62816d98-265f-4d32-817a-6133bd47bcda response_code = 200 uri = /v2p
23132025-01-15T00:50:52.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65124 req_id = 79c26b00-c5ab-4f12-9f61-fff472173c18 response_code = 200 uri = /network-bootstore-config
23142025-01-15T00:50:52.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44585
23152025-01-15T00:50:52.639ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23162025-01-15T00:50:52.695ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23172025-01-15T00:50:52.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136394 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44585 req_id = e095140b-8768-4e36-9cdd-2df5776df5f5 response_code = 204 uri = /switch-ports
23182025-01-15T00:50:52.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44585 req_id = 22c7a434-af33-411c-8f57-1d689d0d2693 response_code = 200 uri = /network-bootstore-config
23192025-01-15T00:50:52.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62750
23202025-01-15T00:50:52.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62750 req_id = 9384124f-8d62-4945-aa99-8843c5f9d124 response_code = 200 uri = /vpc-routes
23212025-01-15T00:50:52.980ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
23222025-01-15T00:50:52.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62750 req_id = b134937b-9691-4600-aee2-d069c7ca8ccd response_code = 204 uri = /eip-gateways
23232025-01-15T00:50:52.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62750 req_id = 324726a6-9204-4d95-bd04-e3fd3265aa41 response_code = 204 uri = /vpc-routes
23242025-01-15T00:50:53.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44371
23252025-01-15T00:50:53.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44371 req_id = fff77e38-8518-4ed3-aae8-69ca04e99ad8 response_code = 200 uri = /v2p
23262025-01-15T00:50:53.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53674
23272025-01-15T00:50:53.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23282025-01-15T00:50:53.159ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23292025-01-15T00:50:53.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53674 req_id = 9b2868b7-d081-40b8-8a26-d6ce2249455e response_code = 204 uri = /switch-ports
23302025-01-15T00:50:53.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53674 req_id = e216b8b2-2440-4f66-b742-e0df2a394373 response_code = 200 uri = /network-bootstore-config
23312025-01-15T00:51:04.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6852 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = eacfffda-a413-4429-ac4b-a6033d4f585c response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
23322025-01-15T00:51:05.640ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39829
23332025-01-15T00:51:05.640ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39829 req_id = bb4ddb64-8a23-4f9c-bcf3-692767f8c2af response_code = 200 uri = /baseboard
23342025-01-15T00:51:22.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36660
23352025-01-15T00:51:22.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36660 req_id = b01680f4-0b42-4fbc-bfdc-3571feea96bf response_code = 200 uri = /vpc-routes
23362025-01-15T00:51:22.170ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
23372025-01-15T00:51:22.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36660 req_id = 4f7eb039-e483-453f-a725-5fa0d1cfd365 response_code = 204 uri = /eip-gateways
23382025-01-15T00:51:22.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36660 req_id = b50583b6-6144-461c-b85d-a47cf551ca25 response_code = 204 uri = /vpc-routes
23392025-01-15T00:51:22.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60958
23402025-01-15T00:51:22.197ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23412025-01-15T00:51:22.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23422025-01-15T00:51:22.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60958 req_id = 09f6cfdd-fe5b-4924-a3cf-8d7f8bf366a2 response_code = 204 uri = /switch-ports
23432025-01-15T00:51:22.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43434
23442025-01-15T00:51:22.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43434 req_id = 2a237b69-19fa-4df8-80af-1425f19cbd0e response_code = 200 uri = /v2p
23452025-01-15T00:51:22.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60958 req_id = e2f14bf0-31e2-4db4-aa8d-d9f231ceb940 response_code = 200 uri = /network-bootstore-config
23462025-01-15T00:51:22.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60032
23472025-01-15T00:51:22.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60032 req_id = 74325e0d-40a9-44b4-bd89-7b920a55823a response_code = 200 uri = /vpc-routes
23482025-01-15T00:51:22.465ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
23492025-01-15T00:51:22.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60032 req_id = 6005cc77-3e36-4d66-a147-682d3e782052 response_code = 204 uri = /eip-gateways
23502025-01-15T00:51:22.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35531
23512025-01-15T00:51:22.471ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23522025-01-15T00:51:22.510ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23532025-01-15T00:51:22.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35531 req_id = 93c11830-6c2f-44b7-a647-a9d6a0c9c58a response_code = 204 uri = /switch-ports
23542025-01-15T00:51:22.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49326
23552025-01-15T00:51:22.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35531 req_id = 6d5c2e27-492a-4698-bbc1-5ed2dc8c7a6e response_code = 200 uri = /network-bootstore-config
23562025-01-15T00:51:22.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49326 req_id = 0174cd64-570e-4384-b6d2-f9ec9e700535 response_code = 200 uri = /v2p
23572025-01-15T00:51:22.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 539 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60032 req_id = 19f3bfed-8aef-4996-9d61-da97d17963b2 response_code = 204 uri = /vpc-routes
23582025-01-15T00:51:22.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61296
23592025-01-15T00:51:22.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61296 req_id = 3c9e60e9-cb00-478c-9907-dc4051c3a30b response_code = 200 uri = /vpc-routes
23602025-01-15T00:51:22.834ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
23612025-01-15T00:51:22.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61296 req_id = e100215b-abd8-4d15-94ea-1d8385b67ce8 response_code = 204 uri = /eip-gateways
23622025-01-15T00:51:22.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61296 req_id = 08a0a138-eb84-4b78-a82f-e908fe171f4e response_code = 204 uri = /vpc-routes
23632025-01-15T00:51:22.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35255
23642025-01-15T00:51:22.884ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23652025-01-15T00:51:22.921ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23662025-01-15T00:51:22.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97810 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35255 req_id = f0a647b1-8c99-4beb-9121-be45a807a831 response_code = 204 uri = /switch-ports
23672025-01-15T00:51:22.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53879
23682025-01-15T00:51:22.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 606 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53879 req_id = 1b64dfe5-443a-4c44-88eb-31e56d5f5c8a response_code = 200 uri = /v2p
23692025-01-15T00:51:22.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35255 req_id = 7e5507c4-7791-4854-9a16-062bd98151ae response_code = 200 uri = /network-bootstore-config
23702025-01-15T00:51:34.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6882 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 9181d5f0-eaed-4f1c-9ebe-02a37373ffbd response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
23712025-01-15T00:51:35.674ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53000
23722025-01-15T00:51:35.674ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53000 req_id = 072b1955-9561-41f2-9fe6-4077109f1d7d response_code = 200 uri = /baseboard
23732025-01-15T00:51:52.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58524
23742025-01-15T00:51:52.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58524 req_id = 1081931c-e05e-4e89-bd54-2da94e794634 response_code = 200 uri = /vpc-routes
23752025-01-15T00:51:52.220ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
23762025-01-15T00:51:52.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58524 req_id = 7098b94a-6546-4d12-b02d-51fce2298b16 response_code = 204 uri = /eip-gateways
23772025-01-15T00:51:52.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58524 req_id = cb91c315-57d1-45d4-8252-6e321f972d11 response_code = 204 uri = /vpc-routes
23782025-01-15T00:51:52.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64813
23792025-01-15T00:51:52.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64813 req_id = 9efe8516-6cfb-493c-beac-a800e4020525 response_code = 200 uri = /v2p
23802025-01-15T00:51:52.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46790
23812025-01-15T00:51:52.390ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23822025-01-15T00:51:52.430ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23832025-01-15T00:51:52.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101069 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46790 req_id = ccf5c690-8830-4ee8-9878-a0b17b462215 response_code = 204 uri = /switch-ports
23842025-01-15T00:51:52.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59933
23852025-01-15T00:51:52.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46790 req_id = 383a84b3-3ba2-4d9a-9eaa-d72cbcdb5bc9 response_code = 200 uri = /network-bootstore-config
23862025-01-15T00:51:52.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59933 req_id = f3d84d7e-4a2b-49a7-a907-81280917a0a0 response_code = 200 uri = /vpc-routes
23872025-01-15T00:51:52.539ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
23882025-01-15T00:51:52.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59933 req_id = 4b778dfe-6896-4c91-b3eb-d29edaa84074 response_code = 204 uri = /eip-gateways
23892025-01-15T00:51:52.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59933 req_id = 27e0ac65-5cb8-4ccc-b791-fed70ae5a4e1 response_code = 204 uri = /vpc-routes
23902025-01-15T00:51:52.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53891
23912025-01-15T00:51:52.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53891 req_id = f93b6f84-6739-4501-a59f-4fbb63895a86 response_code = 200 uri = /v2p
23922025-01-15T00:51:52.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54995
23932025-01-15T00:51:52.777ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23942025-01-15T00:51:52.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23952025-01-15T00:51:52.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54995 req_id = 0884cdde-479a-41a7-b76b-6288260d08c7 response_code = 204 uri = /switch-ports
23962025-01-15T00:51:52.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54995 req_id = 346b27c4-0872-452f-a589-345cec4edd5a response_code = 200 uri = /network-bootstore-config
23972025-01-15T00:51:52.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53981
23982025-01-15T00:51:52.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53981 req_id = 8cb2b633-962b-4ca7-b7bb-04529da37141 response_code = 200 uri = /vpc-routes
23992025-01-15T00:51:52.952ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
24002025-01-15T00:51:52.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53981 req_id = 12e23638-2291-46d6-807e-173f6f5ae7e2 response_code = 204 uri = /eip-gateways
24012025-01-15T00:51:53.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45181
24022025-01-15T00:51:53.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45181 req_id = ee70cb91-d557-4aea-8599-83cd959876b5 response_code = 200 uri = /v2p
24032025-01-15T00:51:53.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53981 req_id = accfe6cf-485b-4696-9ab0-ae129e670509 response_code = 204 uri = /vpc-routes
24042025-01-15T00:51:53.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49223
24052025-01-15T00:51:53.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24062025-01-15T00:51:53.229ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24072025-01-15T00:51:53.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49223 req_id = 05e7f71f-89c9-48f5-b197-533464ec9dd1 response_code = 204 uri = /switch-ports
24082025-01-15T00:51:53.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49223 req_id = 05591cd1-fd6e-4da9-8ed5-4bac54221e61 response_code = 200 uri = /network-bootstore-config
24092025-01-15T00:52:04.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6953 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 2ca99cc3-d0d0-45ed-ace1-2c192e1d3f59 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
24102025-01-15T00:52:05.708ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44386
24112025-01-15T00:52:05.708ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44386 req_id = b4b510a8-772b-44d5-802a-2ae382d3a381 response_code = 200 uri = /baseboard
24122025-01-15T00:52:21.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65079
24132025-01-15T00:52:21.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65079 req_id = c468a0b5-9417-4fbb-b9f3-2458ad7db8a8 response_code = 200 uri = /vpc-routes
24142025-01-15T00:52:22.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
24152025-01-15T00:52:22.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65079 req_id = 2bda61af-4328-4d49-a108-bab9b010a984 response_code = 204 uri = /eip-gateways
24162025-01-15T00:52:22.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65079 req_id = 779da9d6-1ef9-49ac-9e4c-168909e83f03 response_code = 204 uri = /vpc-routes
24172025-01-15T00:52:22.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38170
24182025-01-15T00:52:22.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38170 req_id = 6a7ad338-b989-445f-b292-3e5beaa21649 response_code = 200 uri = /v2p
24192025-01-15T00:52:22.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51604
24202025-01-15T00:52:22.196ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24212025-01-15T00:52:22.239ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24222025-01-15T00:52:22.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51604 req_id = adcba42f-bcfb-44a9-839e-c00074ce49d5 response_code = 204 uri = /switch-ports
24232025-01-15T00:52:22.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51604 req_id = 362b7f37-f143-4c1a-bbee-decc04caed58 response_code = 200 uri = /network-bootstore-config
24242025-01-15T00:52:22.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47845
24252025-01-15T00:52:22.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47845 req_id = ee94cd39-171a-40c7-b0c6-f4c8374992b2 response_code = 200 uri = /vpc-routes
24262025-01-15T00:52:22.358ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
24272025-01-15T00:52:22.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47845 req_id = 5ec35636-b2f7-452d-8f93-2c97b8c21eb1 response_code = 204 uri = /eip-gateways
24282025-01-15T00:52:22.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38703
24292025-01-15T00:52:22.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38703 req_id = 3ad04623-d3f4-41fd-afab-2e9cef128613 response_code = 200 uri = /v2p
24302025-01-15T00:52:22.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47845 req_id = 7b484711-8d4f-4049-8bbd-b97716e86b2a response_code = 204 uri = /vpc-routes
24312025-01-15T00:52:22.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59956
24322025-01-15T00:52:22.432ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24332025-01-15T00:52:22.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24342025-01-15T00:52:22.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59956 req_id = 94f1f484-a63c-485d-9bdf-0fa42917cfc9 response_code = 204 uri = /switch-ports
24352025-01-15T00:52:22.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59956 req_id = df6cc220-9a00-4deb-9f4a-1f2cddcbc2bf response_code = 200 uri = /network-bootstore-config
24362025-01-15T00:52:22.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35370
24372025-01-15T00:52:22.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35370 req_id = 1c395c7c-b5cd-401c-82ba-531ee5217634 response_code = 200 uri = /vpc-routes
24382025-01-15T00:52:22.835ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
24392025-01-15T00:52:22.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35370 req_id = ff308a8d-225b-4aa0-892d-b467273bc09f response_code = 204 uri = /eip-gateways
24402025-01-15T00:52:22.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57781
24412025-01-15T00:52:22.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57781 req_id = 46e8509b-af1b-432c-845a-2987b93d21be response_code = 200 uri = /v2p
24422025-01-15T00:52:22.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35370 req_id = bf49d73c-5ddd-438f-9b68-48868be98148 response_code = 204 uri = /vpc-routes
24432025-01-15T00:52:22.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39245
24442025-01-15T00:52:22.892ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24452025-01-15T00:52:22.928ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24462025-01-15T00:52:22.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39245 req_id = cc9af319-16ce-4c3b-938c-a909fb02571c response_code = 204 uri = /switch-ports
24472025-01-15T00:52:22.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39245 req_id = d956f227-f82c-41dd-b474-66172d83a161 response_code = 200 uri = /network-bootstore-config
24482025-01-15T00:52:34.295ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5237 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 4703fede-1454-4dde-90a4-7b48362298bb response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
24492025-01-15T00:52:35.766ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42141
24502025-01-15T00:52:35.766ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42141 req_id = c3e7a97c-4e88-427e-bed2-1406fa3f054a response_code = 200 uri = /baseboard
24512025-01-15T00:52:52.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42170
24522025-01-15T00:52:52.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42170 req_id = 6bd7f914-2f8b-41f5-aaef-2d416900a3a7 response_code = 200 uri = /vpc-routes
24532025-01-15T00:52:52.257ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
24542025-01-15T00:52:52.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42170 req_id = 3bcf8d68-27ae-438e-a082-c615032b5f86 response_code = 204 uri = /eip-gateways
24552025-01-15T00:52:52.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42170 req_id = 699d9837-a549-47d2-a655-1f655d2bd74c response_code = 204 uri = /vpc-routes
24562025-01-15T00:52:52.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40318
24572025-01-15T00:52:52.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40318 req_id = 6e34b913-f81a-4f80-99a8-a5360d2f6034 response_code = 200 uri = /v2p
24582025-01-15T00:52:52.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62582
24592025-01-15T00:52:52.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62582 req_id = 1d56c6e4-5ad9-4277-8b0b-dfa6cd6c2e83 response_code = 200 uri = /vpc-routes
24602025-01-15T00:52:52.440ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
24612025-01-15T00:52:52.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62582 req_id = 23ee7859-6e08-45e9-b3c7-ac084d7d3a61 response_code = 204 uri = /eip-gateways
24622025-01-15T00:52:52.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62582 req_id = eaa2a706-acf1-41cc-a5fb-d3d0eef32160 response_code = 204 uri = /vpc-routes
24632025-01-15T00:52:52.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39485
24642025-01-15T00:52:52.477ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24652025-01-15T00:52:52.524ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24662025-01-15T00:52:52.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39485 req_id = 027d0046-cf87-41ce-b4f0-4a9d376198ad response_code = 204 uri = /switch-ports
24672025-01-15T00:52:52.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39485 req_id = 87f4b3c0-8e79-4ad0-ad90-adc73831b016 response_code = 200 uri = /network-bootstore-config
24682025-01-15T00:52:52.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63919
24692025-01-15T00:52:52.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63919 req_id = 984859c0-cc93-4e5c-8f0f-94a8509b8ff1 response_code = 200 uri = /v2p
24702025-01-15T00:52:52.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64070
24712025-01-15T00:52:52.748ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24722025-01-15T00:52:52.806ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24732025-01-15T00:52:52.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139992 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64070 req_id = 981c1f41-6ceb-4b9d-b127-6dac86090104 response_code = 204 uri = /switch-ports
24742025-01-15T00:52:52.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64070 req_id = fedd5b52-899f-495b-86e7-e3c8e4130e0e response_code = 200 uri = /network-bootstore-config
24752025-01-15T00:52:52.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48212
24762025-01-15T00:52:52.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48212 req_id = f51bd754-343a-415c-8ebd-37a605779f05 response_code = 200 uri = /vpc-routes
24772025-01-15T00:52:53.023ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
24782025-01-15T00:52:53.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48212 req_id = bfd282e3-1e7c-41e1-a962-6d835ed16c8e response_code = 204 uri = /eip-gateways
24792025-01-15T00:52:53.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48212 req_id = bfc889e0-91cb-4d50-8418-7a32bdfe0931 response_code = 204 uri = /vpc-routes
24802025-01-15T00:52:53.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50274
24812025-01-15T00:52:53.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50274 req_id = 96b9cb7f-d51e-4612-8628-c9d89dc42f3a response_code = 200 uri = /v2p
24822025-01-15T00:52:53.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41629
24832025-01-15T00:52:53.169ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24842025-01-15T00:52:53.208ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24852025-01-15T00:52:53.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95173 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41629 req_id = d6e20001-10f1-4a2a-ba65-1537168e3fd7 response_code = 204 uri = /switch-ports
24862025-01-15T00:52:53.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41629 req_id = 06b839c6-e4b6-49d0-8ea1-96a95a1064d8 response_code = 200 uri = /network-bootstore-config
24872025-01-15T00:53:04.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6748 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 4f22018e-d5ae-4ac0-8cd5-2cbb675657bd response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
24882025-01-15T00:53:05.798ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47141
24892025-01-15T00:53:05.798ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47141 req_id = c9012720-3a17-49e5-9604-6697b50b2d6e response_code = 200 uri = /baseboard
24902025-01-15T00:53:22.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57756
24912025-01-15T00:53:22.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57756 req_id = bd9b467c-baa3-4edc-8e21-45243110dffb response_code = 200 uri = /vpc-routes
24922025-01-15T00:53:22.083ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
24932025-01-15T00:53:22.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57756 req_id = 578244ab-aa54-4872-bb94-8a6cb1957084 response_code = 204 uri = /eip-gateways
24942025-01-15T00:53:22.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60522
24952025-01-15T00:53:22.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60522 req_id = a7af495b-9b4c-4936-a296-8c1c66b6d4b9 response_code = 200 uri = /v2p
24962025-01-15T00:53:22.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57756 req_id = 1ec7105b-b7a0-442e-888a-2f763d1f182e response_code = 204 uri = /vpc-routes
24972025-01-15T00:53:22.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34075
24982025-01-15T00:53:22.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24992025-01-15T00:53:22.225ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25002025-01-15T00:53:22.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110527 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34075 req_id = a55873cd-a907-4dc4-9085-28b2473b19df response_code = 204 uri = /switch-ports
25012025-01-15T00:53:22.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34075 req_id = 2617765a-3e5b-4fda-9f31-4fc89e56ac37 response_code = 200 uri = /network-bootstore-config
25022025-01-15T00:53:22.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49888
25032025-01-15T00:53:22.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49888 req_id = 132b671e-c89e-4787-b92d-0ee66bd99c84 response_code = 200 uri = /vpc-routes
25042025-01-15T00:53:22.359ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
25052025-01-15T00:53:22.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49888 req_id = 120952d7-c26c-40ad-889b-225050782ab4 response_code = 204 uri = /eip-gateways
25062025-01-15T00:53:22.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46534
25072025-01-15T00:53:22.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46534 req_id = d342cbe5-8a7c-4b47-894a-186b0a5a42f2 response_code = 200 uri = /v2p
25082025-01-15T00:53:22.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49888 req_id = 04ae6284-6631-4484-9a28-b169e8df2c41 response_code = 204 uri = /vpc-routes
25092025-01-15T00:53:22.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55232
25102025-01-15T00:53:22.467ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25112025-01-15T00:53:22.504ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25122025-01-15T00:53:22.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55232 req_id = 49302e31-4580-4c90-9baa-bcaa248d6fa1 response_code = 204 uri = /switch-ports
25132025-01-15T00:53:22.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55232 req_id = e279057c-1931-43bf-bb2c-b45b0e14cd9c response_code = 200 uri = /network-bootstore-config
25142025-01-15T00:53:22.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49240
25152025-01-15T00:53:22.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49240 req_id = 98c9a926-6b6e-4770-ad36-77b7a93cdb32 response_code = 200 uri = /vpc-routes
25162025-01-15T00:53:22.877ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
25172025-01-15T00:53:22.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49240 req_id = aa820069-024f-4252-8685-826c11931160 response_code = 204 uri = /eip-gateways
25182025-01-15T00:53:22.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49240 req_id = e758406b-7a94-44c7-b5bd-4d436a16c8b9 response_code = 204 uri = /vpc-routes
25192025-01-15T00:53:22.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46715
25202025-01-15T00:53:22.976ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25212025-01-15T00:53:23.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25222025-01-15T00:53:23.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46715 req_id = 572d9974-e899-41bd-b617-5147026bdbb9 response_code = 204 uri = /switch-ports
25232025-01-15T00:53:23.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47362
25242025-01-15T00:53:23.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47362 req_id = 72c04f08-24ee-49e3-92ca-7579ce5db3a6 response_code = 200 uri = /v2p
25252025-01-15T00:53:23.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46715 req_id = 65a5be47-e270-41fc-87c5-8ed5a7ce6ca9 response_code = 200 uri = /network-bootstore-config
25262025-01-15T00:53:34.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7306 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = c9ed7945-1567-45d6-82c1-2d9a31343ae5 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25272025-01-15T00:53:35.832ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56389
25282025-01-15T00:53:35.833ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56389 req_id = c264f15d-015b-4b6b-bb18-f298d2e6f714 response_code = 200 uri = /baseboard
25292025-01-15T00:53:52.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33432
25302025-01-15T00:53:52.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33432 req_id = bd7b357e-5cf0-413e-8c48-7478fc9ab7b2 response_code = 200 uri = /vpc-routes
25312025-01-15T00:53:52.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
25322025-01-15T00:53:52.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33432 req_id = 30590fed-c527-4a9f-83e1-773873ebb54a response_code = 204 uri = /eip-gateways
25332025-01-15T00:53:52.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33432 req_id = 01487624-4ba6-46ed-b504-35c97ff71c4a response_code = 204 uri = /vpc-routes
25342025-01-15T00:53:52.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62319
25352025-01-15T00:53:52.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25362025-01-15T00:53:52.330ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25372025-01-15T00:53:52.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91206 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62319 req_id = 0649f982-e2a2-4fc7-9d59-187629356e52 response_code = 204 uri = /switch-ports
25382025-01-15T00:53:52.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43900
25392025-01-15T00:53:52.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62319 req_id = 9932eb45-3261-4f22-b5c0-366db0f11833 response_code = 200 uri = /network-bootstore-config
25402025-01-15T00:53:52.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43900 req_id = c04d5cd7-157a-4c2f-b213-b864338b19f7 response_code = 200 uri = /v2p
25412025-01-15T00:53:52.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42244
25422025-01-15T00:53:52.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42244 req_id = dad6a5c7-9518-4408-abba-0315a78700c4 response_code = 200 uri = /vpc-routes
25432025-01-15T00:53:52.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
25442025-01-15T00:53:52.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42244 req_id = 52e792a9-1aad-4dcf-bb81-c740ca390eeb response_code = 204 uri = /eip-gateways
25452025-01-15T00:53:52.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42244 req_id = bac30f37-d8ed-4759-acab-c11b4952745b response_code = 204 uri = /vpc-routes
25462025-01-15T00:53:52.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60000
25472025-01-15T00:53:52.715ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25482025-01-15T00:53:52.760ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25492025-01-15T00:53:52.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105949 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60000 req_id = 8d1b46d7-565e-4f25-89c5-cf70c72f1bd0 response_code = 204 uri = /switch-ports
25502025-01-15T00:53:52.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45439
25512025-01-15T00:53:52.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45439 req_id = 577fe276-afba-4b51-9e66-7ab727611b2a response_code = 200 uri = /v2p
25522025-01-15T00:53:52.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60000 req_id = 7d54bf45-b102-4aed-acf9-e3d7dffd91fb response_code = 200 uri = /network-bootstore-config
25532025-01-15T00:53:53.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35335
25542025-01-15T00:53:53.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35335 req_id = d200b21b-7efa-4ee1-9aec-489913807964 response_code = 200 uri = /vpc-routes
25552025-01-15T00:53:53.081ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
25562025-01-15T00:53:53.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35335 req_id = c6616b7e-a712-4736-8ece-edea38e704bc response_code = 204 uri = /eip-gateways
25572025-01-15T00:53:53.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35335 req_id = eb96b11e-b53f-4213-b590-50b9e6da1582 response_code = 204 uri = /vpc-routes
25582025-01-15T00:53:53.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62585
25592025-01-15T00:53:53.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62585 req_id = c7d23ba4-c326-4073-8624-0f12753c82be response_code = 200 uri = /v2p
25602025-01-15T00:53:53.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44368
25612025-01-15T00:53:53.154ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25622025-01-15T00:53:53.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25632025-01-15T00:53:53.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94608 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44368 req_id = 6ad87f9e-25e6-4b18-b674-57a75c8f756d response_code = 204 uri = /switch-ports
25642025-01-15T00:53:53.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44368 req_id = 2f041ae2-559e-4fe2-9fcf-68cbc29dcd88 response_code = 200 uri = /network-bootstore-config
25652025-01-15T00:54:04.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6941 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 8bd8e169-8866-48ca-b15d-a6866dfa3b41 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25662025-01-15T00:54:05.865ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57481
25672025-01-15T00:54:05.865ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57481 req_id = 7a400149-6101-4eb4-a5fc-6edd18482810 response_code = 200 uri = /baseboard
25682025-01-15T00:54:22.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36269
25692025-01-15T00:54:22.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36269 req_id = af0dd0ce-cd78-45cc-a3b0-44a49b68d54b response_code = 200 uri = /vpc-routes
25702025-01-15T00:54:22.060ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
25712025-01-15T00:54:22.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36269 req_id = 3a6e64e3-19ea-4aaf-a069-651a70b1418a response_code = 204 uri = /eip-gateways
25722025-01-15T00:54:22.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36269 req_id = 36d431c2-5edc-46ff-95bd-2abbb4bc7841 response_code = 204 uri = /vpc-routes
25732025-01-15T00:54:22.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37784
25742025-01-15T00:54:22.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37784 req_id = bdb264e2-216b-4dad-81a7-2355b6d50bb6 response_code = 200 uri = /v2p
25752025-01-15T00:54:22.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33984
25762025-01-15T00:54:22.214ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25772025-01-15T00:54:22.257ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25782025-01-15T00:54:22.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93943 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33984 req_id = 9d26ad68-6220-4658-86e0-43aa88761e98 response_code = 204 uri = /switch-ports
25792025-01-15T00:54:22.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33984 req_id = 06e4cfc1-4225-49bd-9330-065b724b7e46 response_code = 200 uri = /network-bootstore-config
25802025-01-15T00:54:22.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38518
25812025-01-15T00:54:22.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38518 req_id = 52651e7a-cf67-4b6c-b242-f75cd21e02db response_code = 200 uri = /vpc-routes
25822025-01-15T00:54:22.364ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
25832025-01-15T00:54:22.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38518 req_id = 8b6527d2-0e38-4882-af02-97ae1b09059c response_code = 204 uri = /eip-gateways
25842025-01-15T00:54:22.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40420
25852025-01-15T00:54:22.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40420 req_id = 00922e5e-e408-4b56-8713-58a3f46b85a6 response_code = 200 uri = /v2p
25862025-01-15T00:54:22.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38518 req_id = c13ce0dc-551d-4cf5-86f7-9475e859f668 response_code = 204 uri = /vpc-routes
25872025-01-15T00:54:22.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51352
25882025-01-15T00:54:22.502ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25892025-01-15T00:54:22.537ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25902025-01-15T00:54:22.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84697 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51352 req_id = e01d2695-7191-4550-8dd0-9a1a524ad401 response_code = 204 uri = /switch-ports
25912025-01-15T00:54:22.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51352 req_id = 1dadc0d9-35d4-400d-b621-9e1e54eebc33 response_code = 200 uri = /network-bootstore-config
25922025-01-15T00:54:22.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46425
25932025-01-15T00:54:22.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46425 req_id = 5cd21ae6-26bc-4172-8e65-16bf86bacff0 response_code = 200 uri = /vpc-routes
25942025-01-15T00:54:22.886ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
25952025-01-15T00:54:22.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46425 req_id = fb7fc510-63f0-4e86-ba2c-f3cea070309a response_code = 204 uri = /eip-gateways
25962025-01-15T00:54:22.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46425 req_id = e3b889cb-fd3c-4a9d-b7ef-c658aa0b2a30 response_code = 204 uri = /vpc-routes
25972025-01-15T00:54:22.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53574
25982025-01-15T00:54:22.927ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25992025-01-15T00:54:22.965ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26002025-01-15T00:54:23.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93018 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53574 req_id = ed8dc534-1f14-46a8-9435-0c7331cbf7eb response_code = 204 uri = /switch-ports
26012025-01-15T00:54:23.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37967
26022025-01-15T00:54:23.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37967 req_id = 38054159-0e38-44ff-be5a-c19263c20fb1 response_code = 200 uri = /v2p
26032025-01-15T00:54:23.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53574 req_id = e93e33b9-a302-4ebc-b266-537259440402 response_code = 200 uri = /network-bootstore-config
26042025-01-15T00:54:34.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7278 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 1f816f58-d867-4b08-aed7-49ebfe6f4b48 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26052025-01-15T00:54:35.899ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35982
26062025-01-15T00:54:35.900ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35982 req_id = d295c26d-5e23-43c6-b46f-04784d5e9706 response_code = 200 uri = /baseboard
26072025-01-15T00:54:52.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48024
26082025-01-15T00:54:52.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48024 req_id = 061668b8-aa27-4f3d-b2b8-35f33ca1a70b response_code = 200 uri = /vpc-routes
26092025-01-15T00:54:52.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
26102025-01-15T00:54:52.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48024 req_id = 099139bd-27f1-441a-a440-c63ce41e5eb1 response_code = 204 uri = /eip-gateways
26112025-01-15T00:54:52.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48024 req_id = 57f8c7fe-e4a7-4895-a527-b1ce2028ea56 response_code = 204 uri = /vpc-routes
26122025-01-15T00:54:52.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46585
26132025-01-15T00:54:52.355ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26142025-01-15T00:54:52.355ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26152025-01-15T00:54:52.356ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:177
26162025-01-15T00:54:52.356ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:177
26172025-01-15T00:54:52.369ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26182025-01-15T00:54:52.369ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0
26192025-01-15T00:54:52.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64066
26202025-01-15T00:54:52.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26212025-01-15T00:54:52.405ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26222025-01-15T00:54:52.405ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba26a070-5665-4b80-b702-e0bfb62227f6
26232025-01-15T00:54:52.416ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26242025-01-15T00:54:52.434ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26252025-01-15T00:54:52.435ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a6ee976a-8413-4b79-86fd-0416e935e722
26262025-01-15T00:54:52.461ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26272025-01-15T00:54:52.461ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e927d854-d6fd-4606-baca-3874882eccd4
26282025-01-15T00:54:52.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34043
26292025-01-15T00:54:52.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34043 req_id = e584c7e1-f80e-4688-bb17-6c129d6ba8c2 response_code = 200 uri = /v2p
26302025-01-15T00:54:52.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108094 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64066 req_id = e2b2feed-cbd9-4e6a-b2b3-dd6d7f24d73e response_code = 204 uri = /switch-ports
26312025-01-15T00:54:52.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64066 req_id = c48f6d28-4201-4ad8-b2f6-f037a9362301 response_code = 200 uri = /network-bootstore-config
26322025-01-15T00:54:52.486ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26332025-01-15T00:54:52.486ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c
26342025-01-15T00:54:52.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57095
26352025-01-15T00:54:52.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57095 req_id = 560d3b0b-3c8b-4b34-a2d1-cb5cc1db5a04 response_code = 200 uri = /vpc-routes
26362025-01-15T00:54:52.512ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26372025-01-15T00:54:52.512ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4
26382025-01-15T00:54:52.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46652
26392025-01-15T00:54:52.525ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
26402025-01-15T00:54:52.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57095 req_id = 14b8efb0-8712-476f-95a2-19c590013bb2 response_code = 204 uri = /eip-gateways
26412025-01-15T00:54:52.526ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26422025-01-15T00:54:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26432025-01-15T00:54:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26442025-01-15T00:54:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26452025-01-15T00:54:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26462025-01-15T00:54:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26472025-01-15T00:54:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26482025-01-15T00:54:52.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 483 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46652 req_id = f47709fc-95ed-4f55-8d73-62d9c4947e14 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26492025-01-15T00:54:52.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57095 req_id = 431d832f-f064-47af-9493-b8e5d5768c12 response_code = 204 uri = /vpc-routes
26502025-01-15T00:54:52.539ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26512025-01-15T00:54:52.539ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4
26522025-01-15T00:54:52.564ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26532025-01-15T00:54:52.564ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc
26542025-01-15T00:54:52.588ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26552025-01-15T00:54:52.588ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549
26562025-01-15T00:54:52.595ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
26572025-01-15T00:54:52.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244006 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46585 req_id = 8e97762c-8127-425e-ac9b-1bb7f3569986 response_code = 200 uri = /inventory
26582025-01-15T00:54:52.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37850
26592025-01-15T00:54:52.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37850 req_id = f0ba77dc-59a5-4b7f-9d71-3012c5641db1 response_code = 200 uri = /v2p
26602025-01-15T00:54:52.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55278
26612025-01-15T00:54:52.710ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26622025-01-15T00:54:52.710ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26632025-01-15T00:54:52.710ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:177
26642025-01-15T00:54:52.711ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:177
26652025-01-15T00:54:52.731ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26662025-01-15T00:54:52.731ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0
26672025-01-15T00:54:52.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59356
26682025-01-15T00:54:52.736ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26692025-01-15T00:54:52.780ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26702025-01-15T00:54:52.780ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba26a070-5665-4b80-b702-e0bfb62227f6
26712025-01-15T00:54:52.793ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26722025-01-15T00:54:52.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34718
26732025-01-15T00:54:52.805ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26742025-01-15T00:54:52.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26752025-01-15T00:54:52.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26762025-01-15T00:54:52.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26772025-01-15T00:54:52.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26782025-01-15T00:54:52.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26792025-01-15T00:54:52.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26802025-01-15T00:54:52.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 748 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34718 req_id = 052159d4-e7f9-4dff-9c3a-f01509583e2c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26812025-01-15T00:54:52.813ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26822025-01-15T00:54:52.813ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a6ee976a-8413-4b79-86fd-0416e935e722
26832025-01-15T00:54:52.843ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26842025-01-15T00:54:52.843ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e927d854-d6fd-4606-baca-3874882eccd4
26852025-01-15T00:54:52.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131489 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59356 req_id = d51255ef-c031-4e48-a073-72cdb6147b81 response_code = 204 uri = /switch-ports
26862025-01-15T00:54:52.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59356 req_id = 48cab0a4-1b15-4196-aa1c-b668ed314ad4 response_code = 200 uri = /network-bootstore-config
26872025-01-15T00:54:52.878ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26882025-01-15T00:54:52.878ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c
26892025-01-15T00:54:52.904ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26902025-01-15T00:54:52.904ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4
26912025-01-15T00:54:52.926ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26922025-01-15T00:54:52.926ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4
26932025-01-15T00:54:52.946ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26942025-01-15T00:54:52.946ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc
26952025-01-15T00:54:52.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46074
26962025-01-15T00:54:52.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46074 req_id = c8502d30-91b6-41f3-b2d4-1eb7c646014a response_code = 200 uri = /vpc-routes
26972025-01-15T00:54:52.966ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26982025-01-15T00:54:52.966ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549
26992025-01-15T00:54:52.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270830 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55278 req_id = 0480b8c1-8883-4a0a-8ed6-96913a53542e response_code = 200 uri = /inventory
27002025-01-15T00:54:53.022ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
27012025-01-15T00:54:53.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46074 req_id = ec8656df-732e-4409-b421-e68d3167e027 response_code = 204 uri = /eip-gateways
27022025-01-15T00:54:53.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46074 req_id = f275b7df-81a0-45aa-96f9-f3b0267f38bd response_code = 204 uri = /vpc-routes
27032025-01-15T00:54:53.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60384
27042025-01-15T00:54:53.070ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27052025-01-15T00:54:53.109ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27062025-01-15T00:54:53.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100625 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60384 req_id = b2769d9e-be17-4dd6-a7e1-fcd6efb706a6 response_code = 204 uri = /switch-ports
27072025-01-15T00:54:53.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64220
27082025-01-15T00:54:53.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64220 req_id = 8858fcdb-88c8-4ed8-84f1-9839fe9b15c5 response_code = 200 uri = /v2p
27092025-01-15T00:54:53.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60384 req_id = 3e53ec4a-60e6-4cc8-85af-1f161b577a19 response_code = 200 uri = /network-bootstore-config
27102025-01-15T00:54:53.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45083
27112025-01-15T00:54:53.250ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27122025-01-15T00:54:53.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27132025-01-15T00:54:53.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27142025-01-15T00:54:53.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27152025-01-15T00:54:53.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27162025-01-15T00:54:53.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27172025-01-15T00:54:53.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27182025-01-15T00:54:53.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45083 req_id = 0f9b2103-1296-40c9-8d22-73d2c1a38ca6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27192025-01-15T00:54:53.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54250
27202025-01-15T00:54:53.424ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27212025-01-15T00:54:53.424ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27222025-01-15T00:54:53.424ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/config/omicron-zones.json file = common/src/ledger.rs:177
27232025-01-15T00:54:53.424ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/config/omicron-zones.json file = common/src/ledger.rs:177
27242025-01-15T00:54:53.436ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 00e7ade3-5fdc-4e86-8e36-0048786505c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27252025-01-15T00:54:53.436ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_00e7ade3-5fdc-4e86-8e36-0048786505c0
27262025-01-15T00:54:53.460ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba26a070-5665-4b80-b702-e0bfb62227f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27272025-01-15T00:54:53.460ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba26a070-5665-4b80-b702-e0bfb62227f6
27282025-01-15T00:54:53.484ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a6ee976a-8413-4b79-86fd-0416e935e722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27292025-01-15T00:54:53.484ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a6ee976a-8413-4b79-86fd-0416e935e722
27302025-01-15T00:54:53.507ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e927d854-d6fd-4606-baca-3874882eccd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27312025-01-15T00:54:53.507ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e927d854-d6fd-4606-baca-3874882eccd4
27322025-01-15T00:54:53.529ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b7d3a8c-080a-42b0-aaac-1d8fb94c442c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27332025-01-15T00:54:53.529ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b7d3a8c-080a-42b0-aaac-1d8fb94c442c
27342025-01-15T00:54:53.552ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1607e73c-a939-4c32-9f17-dc51c11d78a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27352025-01-15T00:54:53.552ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1607e73c-a939-4c32-9f17-dc51c11d78a4
27362025-01-15T00:54:53.574ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cfcfcef4-12cf-46bc-a058-afb36dbeb8b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27372025-01-15T00:54:53.574ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cfcfcef4-12cf-46bc-a058-afb36dbeb8b4
27382025-01-15T00:54:53.594ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c10bc967-f2f3-462b-9053-5f03aca47fbc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27392025-01-15T00:54:53.594ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c10bc967-f2f3-462b-9053-5f03aca47fbc
27402025-01-15T00:54:53.615ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3131655f-f0d6-4fd3-bf28-70e12f0bf549 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27412025-01-15T00:54:53.615ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3131655f-f0d6-4fd3-bf28-70e12f0bf549
27422025-01-15T00:54:53.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202729 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54250 req_id = bb4d93a3-2b39-44b2-bd4b-77dffe52bc44 response_code = 200 uri = /inventory
27432025-01-15T00:55:04.295ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5246 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = b675c21f-6737-456c-add1-fad2fc5f560c response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27442025-01-15T00:55:05.932ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45799
27452025-01-15T00:55:05.932ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45799 req_id = 587cf86b-88db-4711-8f91-2e925c7cfcd3 response_code = 200 uri = /baseboard
27462025-01-15T00:55:21.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46222
27472025-01-15T00:55:21.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46222 req_id = 8daefab8-5650-440c-9a43-a4069f6c5008 response_code = 200 uri = /vpc-routes
27482025-01-15T00:55:22.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
27492025-01-15T00:55:22.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46222 req_id = 9d930287-8642-4fb2-9ae0-53d2c1b31cfa response_code = 204 uri = /eip-gateways
27502025-01-15T00:55:22.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46222 req_id = ae8e9571-677e-4a8c-85be-d8627879ff29 response_code = 204 uri = /vpc-routes
27512025-01-15T00:55:22.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56561
27522025-01-15T00:55:22.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56561 req_id = b28466c6-1ddf-42f2-a517-dfedea33138f response_code = 200 uri = /v2p
27532025-01-15T00:55:22.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45390
27542025-01-15T00:55:22.274ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27552025-01-15T00:55:22.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27562025-01-15T00:55:22.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45390 req_id = 44ee872d-a146-4a83-bb08-440abab44c81 response_code = 204 uri = /switch-ports
27572025-01-15T00:55:22.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32803
27582025-01-15T00:55:22.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32803 req_id = ed536555-3278-4e67-8e06-891f04e3ab0d response_code = 200 uri = /vpc-routes
27592025-01-15T00:55:22.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45390 req_id = 9294e657-09c0-430c-9834-d5dbc1081a88 response_code = 200 uri = /network-bootstore-config
27602025-01-15T00:55:22.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58645
27612025-01-15T00:55:22.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58645 req_id = 42289e76-4652-4f8c-b9bd-ba7aacf2fad2 response_code = 200 uri = /v2p
27622025-01-15T00:55:22.411ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
27632025-01-15T00:55:22.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32803 req_id = b9a83918-a2df-4761-9d5e-19e670b9965f response_code = 204 uri = /eip-gateways
27642025-01-15T00:55:22.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32803 req_id = 5eb7a0f5-90bc-4952-9082-d8235862fdbc response_code = 204 uri = /vpc-routes
27652025-01-15T00:55:22.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42563
27662025-01-15T00:55:22.430ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27672025-01-15T00:55:22.463ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27682025-01-15T00:55:22.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83914 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42563 req_id = 75afd0ad-3a31-43de-8d2a-d3fb59ae0d42 response_code = 204 uri = /switch-ports
27692025-01-15T00:55:22.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42563 req_id = 0b8271fe-75e4-4bfa-9aee-c6da4005559b response_code = 200 uri = /network-bootstore-config
27702025-01-15T00:55:22.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47814
27712025-01-15T00:55:22.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47814 req_id = b36244f6-3616-48aa-92ce-c385544f9577 response_code = 200 uri = /vpc-routes
27722025-01-15T00:55:22.914ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
27732025-01-15T00:55:22.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47814 req_id = ee951660-76a8-4251-bd10-3b8b753d39aa response_code = 204 uri = /eip-gateways
27742025-01-15T00:55:22.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47814 req_id = bdd18066-db1f-4931-9cd1-810dffe7e7ce response_code = 204 uri = /vpc-routes
27752025-01-15T00:55:22.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58005
27762025-01-15T00:55:22.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58005 req_id = df690626-d761-4490-bdbc-15e483dd55ca response_code = 200 uri = /v2p
27772025-01-15T00:55:22.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65180
27782025-01-15T00:55:22.997ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27792025-01-15T00:55:23.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27802025-01-15T00:55:23.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92433 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65180 req_id = 0a217011-475a-4f94-b4c7-ab4bedcee66d response_code = 204 uri = /switch-ports
27812025-01-15T00:55:23.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65180 req_id = df77c9a9-5c14-49fc-ab17-20c73ce0730d response_code = 200 uri = /network-bootstore-config
27822025-01-15T00:55:34.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7157 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = b6f45812-2f71-43d8-945c-0ff6f8fb2817 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27832025-01-15T00:55:35.965ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50345
27842025-01-15T00:55:35.965ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50345 req_id = 4d59fb6d-4783-47ff-b185-ad2af0c7c004 response_code = 200 uri = /baseboard
27852025-01-15T00:55:52.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64311
27862025-01-15T00:55:52.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64311 req_id = 71affccb-8e0a-469f-b24f-c53e7f9fd328 response_code = 200 uri = /vpc-routes
27872025-01-15T00:55:52.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50613
27882025-01-15T00:55:52.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50613 req_id = 54febd26-b88d-4b0b-8277-cb6fa656d36f response_code = 200 uri = /v2p
27892025-01-15T00:55:52.316ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
27902025-01-15T00:55:52.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64311 req_id = 5bcd8e16-74ee-401c-b477-add1393fff77 response_code = 204 uri = /eip-gateways
27912025-01-15T00:55:52.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64311 req_id = f517871c-adde-420c-b6f4-60733c1bc526 response_code = 204 uri = /vpc-routes
27922025-01-15T00:55:52.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46847
27932025-01-15T00:55:52.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27942025-01-15T00:55:52.401ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27952025-01-15T00:55:52.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96047 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46847 req_id = 57b329ea-a821-45f3-9278-73968c3261e4 response_code = 204 uri = /switch-ports
27962025-01-15T00:55:52.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46847 req_id = 6e153e8a-9488-48dd-86e3-b7498ba38733 response_code = 200 uri = /network-bootstore-config
27972025-01-15T00:55:52.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41937
27982025-01-15T00:55:52.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41937 req_id = e634ce1d-803d-47bb-845c-e426aca1c18e response_code = 200 uri = /vpc-routes
27992025-01-15T00:55:52.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42759
28002025-01-15T00:55:52.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42759 req_id = 66f29f20-00eb-4ccc-b021-2a44bc5b38d3 response_code = 200 uri = /v2p
28012025-01-15T00:55:52.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43598
28022025-01-15T00:55:52.724ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28032025-01-15T00:55:52.773ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28042025-01-15T00:55:52.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115643 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43598 req_id = cfd4541d-5d44-44ee-8a4c-b2d4c4cd54dc response_code = 204 uri = /switch-ports
28052025-01-15T00:55:52.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
28062025-01-15T00:55:52.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41937 req_id = 6db614d5-b7de-49de-9184-a0704f8b635e response_code = 204 uri = /eip-gateways
28072025-01-15T00:55:52.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43598 req_id = 937f46a9-be83-44d2-946a-b7b3b368621a response_code = 200 uri = /network-bootstore-config
28082025-01-15T00:55:52.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41937 req_id = 4ce4d3cf-e7dc-4d7c-9043-eaba4d7135bb response_code = 204 uri = /vpc-routes
28092025-01-15T00:55:53.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54132
28102025-01-15T00:55:53.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54132 req_id = 4405cfc2-9015-455c-bef1-2aa420cc96c3 response_code = 200 uri = /vpc-routes
28112025-01-15T00:55:53.079ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
28122025-01-15T00:55:53.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54132 req_id = 4161c524-6094-437d-b17b-25dfb2bba91d response_code = 204 uri = /eip-gateways
28132025-01-15T00:55:53.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54132 req_id = 503fda63-3d5f-49d8-9775-c4e26555a97c response_code = 204 uri = /vpc-routes
28142025-01-15T00:55:53.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56917
28152025-01-15T00:55:53.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56917 req_id = 66490083-0ac7-4ce5-acf4-e316a0c564fc response_code = 200 uri = /v2p
28162025-01-15T00:55:53.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36129
28172025-01-15T00:55:53.170ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28182025-01-15T00:55:53.209ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28192025-01-15T00:55:53.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94933 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36129 req_id = a6fc7ecf-943a-468c-b35c-913e49345414 response_code = 204 uri = /switch-ports
28202025-01-15T00:55:53.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36129 req_id = fe3e345f-d41a-46ba-a163-b6848a72132e response_code = 200 uri = /network-bootstore-config
28212025-01-15T00:56:04.297ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7045 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = 11c11268-2288-49b2-8181-dd8d410823ae response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
28222025-01-15T00:56:05.998ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34665
28232025-01-15T00:56:05.998ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34665 req_id = 64141958-f400-420d-80dc-dfb04cbad7e1 response_code = 200 uri = /baseboard
28242025-01-15T00:56:22.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42201
28252025-01-15T00:56:22.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42201 req_id = 7b927ae3-5573-4409-b4d1-e3f0701e7ee0 response_code = 200 uri = /vpc-routes
28262025-01-15T00:56:22.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
28272025-01-15T00:56:22.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42201 req_id = 645a2546-2b88-4399-9bcc-5e88a59b67a6 response_code = 204 uri = /eip-gateways
28282025-01-15T00:56:22.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42201 req_id = df56d129-7abd-4ac2-9668-a15f466fe638 response_code = 204 uri = /vpc-routes
28292025-01-15T00:56:22.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38665
28302025-01-15T00:56:22.199ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28312025-01-15T00:56:22.242ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28322025-01-15T00:56:22.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98482 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38665 req_id = 24cfb07f-1fbe-4731-a7c6-ea8841ecdc71 response_code = 204 uri = /switch-ports
28332025-01-15T00:56:22.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58302
28342025-01-15T00:56:22.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58302 req_id = 0ac0bfb3-dee3-431c-aa59-8197126744b3 response_code = 200 uri = /v2p
28352025-01-15T00:56:22.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38665 req_id = fa3b839f-7c8d-4cdd-b9c9-c8e032e88510 response_code = 200 uri = /network-bootstore-config
28362025-01-15T00:56:22.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54883
28372025-01-15T00:56:22.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54883 req_id = aebc6fa2-221a-462f-9e55-6038cfae63e0 response_code = 200 uri = /vpc-routes
28382025-01-15T00:56:22.517ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
28392025-01-15T00:56:22.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54883 req_id = a0ad9794-b688-43be-9be1-b20377657e31 response_code = 204 uri = /eip-gateways
28402025-01-15T00:56:22.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54883 req_id = f9d9c345-eafe-42a4-a687-605459e0ad54 response_code = 204 uri = /vpc-routes
28412025-01-15T00:56:22.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47297
28422025-01-15T00:56:22.572ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28432025-01-15T00:56:22.610ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28442025-01-15T00:56:22.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47297 req_id = 9168b2b5-fc26-47d5-a614-b5bc7199ef58 response_code = 204 uri = /switch-ports
28452025-01-15T00:56:22.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52140
28462025-01-15T00:56:22.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52140 req_id = 008cb105-4ab2-4185-8f97-3f45b6d0b0cc response_code = 200 uri = /v2p
28472025-01-15T00:56:22.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47297 req_id = 6289904e-33a3-4ce4-8886-221d1b058e63 response_code = 200 uri = /network-bootstore-config
28482025-01-15T00:56:22.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33569
28492025-01-15T00:56:22.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33569 req_id = bbf4049d-ba77-4abe-8e06-dc74d3cdacdc response_code = 200 uri = /vpc-routes
28502025-01-15T00:56:22.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63411
28512025-01-15T00:56:22.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63411 req_id = e25d33af-439b-4137-a9c0-28be6ccd6811 response_code = 200 uri = /v2p
28522025-01-15T00:56:22.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
28532025-01-15T00:56:22.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33569 req_id = db200d1d-0fa0-4e0c-a936-b7aed614ff12 response_code = 204 uri = /eip-gateways
28542025-01-15T00:56:22.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33569 req_id = 0b9489f2-fdc4-4fe9-833a-293b8ef506ff response_code = 204 uri = /vpc-routes
28552025-01-15T00:56:22.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55050
28562025-01-15T00:56:22.987ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28572025-01-15T00:56:23.023ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28582025-01-15T00:56:23.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90410 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55050 req_id = 58c2dacc-4145-491b-8dfa-5c004c615f40 response_code = 204 uri = /switch-ports
28592025-01-15T00:56:23.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55050 req_id = 1dc5d4b0-4250-49d7-8883-1c50f9203b5b response_code = 200 uri = /network-bootstore-config
28602025-01-15T00:56:34.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7105 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = cb09ed4f-b033-4a0c-8cf5-a60a63969d54 response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
28612025-01-15T00:56:36.031ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37111
28622025-01-15T00:56:36.031ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37111 req_id = e01e29b4-1e52-4f8a-89b9-bff9c52da63f response_code = 200 uri = /baseboard
28632025-01-15T00:56:40.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32812
28642025-01-15T00:56:40.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32812 req_id = d5cbd22a-d782-47a3-8d24-ed239b1dde10 response_code = 200 uri = /v2p
28652025-01-15T00:56:40.642ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14632636) }
28662025-01-15T00:56:40.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 923 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32812 req_id = 6a049f7d-69c4-4df1-aa9d-4569e68eb324 response_code = 204 uri = /v2p
28672025-01-15T00:56:40.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48121
28682025-01-15T00:56:40.798ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 78f08dea-b6fa-401f-946b-11f0ea697d8a, kind: Instance { id: 5402056b-362a-490b-a804-8251b2b699f8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14632636), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 78f08dea-b6fa-401f-946b-11f0ea697d8a, kind: Instance { id: 5402056b-362a-490b-a804-8251b2b699f8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14632636), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 78f08dea-b6fa-401f-946b-11f0ea697d8a, kind: Instance { id: 5402056b-362a-490b-a804-8251b2b699f8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14632636), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14632636))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 78f08dea-b6fa-401f-946b-11f0ea697d8a, kind: Instance { id: 5402056b-362a-490b-a804-8251b2b699f8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14632636), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 01b490a1-e680-47b5-a875-9e067f040cbc, slot: 0, read_only: false, vcr_json: .., name: "disk-dbf28fcb84c" }], boot_settings: Some(InstanceBootSettings { order: [01b490a1-e680-47b5-a875-9e067f040cbc] }), cloud_init_bytes: Some(..) } instance_id = 5402056b-362a-490b-a804-8251b2b699f8 metadata = InstanceMetadata { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, project_id: 6752adb0-3b6d-4d0a-88ac-3a4b8f359936 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-15T00:56:40.792805571Z }
28692025-01-15T00:56:40.798ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 migration_id = None propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28702025-01-15T00:56:40.798ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 migration_id = None propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 78f08dea-b6fa-401f-946b-11f0ea697d8a, kind: Instance { id: 5402056b-362a-490b-a804-8251b2b699f8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14632636), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 78f08dea-b6fa-401f-946b-11f0ea697d8a, kind: Instance { id: 5402056b-362a-490b-a804-8251b2b699f8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14632636), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 78f08dea-b6fa-401f-946b-11f0ea697d8a, kind: Instance { id: 5402056b-362a-490b-a804-8251b2b699f8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14632636), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14632636))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 78f08dea-b6fa-401f-946b-11f0ea697d8a, kind: Instance { id: 5402056b-362a-490b-a804-8251b2b699f8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14632636), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 01b490a1-e680-47b5-a875-9e067f040cbc, slot: 0, read_only: false, vcr_json: .., name: "disk-dbf28fcb84c" }], boot_settings: Some(InstanceBootSettings { order: [01b490a1-e680-47b5-a875-9e067f040cbc] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-15T00:56:40.792805571Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28712025-01-15T00:56:40.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9091 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48121 req_id = 2bb463bb-4f0a-4643-8a81-53de92b50e14 response_code = 200 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28722025-01-15T00:56:40.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43544
28732025-01-15T00:56:40.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43544 req_id = 83ac7bcb-8233-49c2-b2df-210b7543bb9c response_code = 200 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1/state
28742025-01-15T00:56:40.904ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 14632636 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28752025-01-15T00:56:40.904ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28762025-01-15T00:56:40.940ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 file = illumos-utils/src/zone.rs:325 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28772025-01-15T00:56:40.964ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 file = illumos-utils/src/zone.rs:363 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28782025-01-15T00:56:41.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57955
28792025-01-15T00:56:41.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57955 req_id = 6297f4d0-6ba0-429a-82a9-1fca54e25ec2 response_code = 200 uri = /vpc-routes
28802025-01-15T00:56:41.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {78f08dea-b6fa-401f-946b-11f0ea697d8a: {10.151.2.175: {acca3b44-1d46-4699-924a-31812b36b4ac}, 10.151.2.176: {acca3b44-1d46-4699-924a-31812b36b4ac}}} }
28812025-01-15T00:56:42.436ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28822025-01-15T00:56:42.437ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28832025-01-15T00:56:42.682ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 28.65907ms file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28842025-01-15T00:56:42.722ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 63.647498ms file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28852025-01-15T00:56:42.800ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 299.210435ms file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28862025-01-15T00:56:43.112ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 469.416192ms file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28872025-01-15T00:56:43.595ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 781.159091ms file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28882025-01-15T00:56:44.388ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 537.320694ms file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28892025-01-15T00:56:44.937ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 765.811738ms file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28902025-01-15T00:56:45.713ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 1.198476433s file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28912025-01-15T00:56:46.923ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 1.196072897s file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 zone = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28922025-01-15T00:56:48.147ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 file = sled-agent/src/instance.rs:2068 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28932025-01-15T00:56:48.156ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 28.454991ms file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28942025-01-15T00:56:48.194ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1") failed: Property not found. retry in 85.073389ms file = illumos-utils/src/svc.rs:36 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28952025-01-15T00:56:48.289ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28962025-01-15T00:56:48.326ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28972025-01-15T00:56:48.463ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
28982025-01-15T00:56:48.464ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
28992025-01-15T00:56:48.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7441132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57955 req_id = 3ce47cd1-20a4-4fbf-b494-7f8afec064ac response_code = 204 uri = /eip-gateways
29002025-01-15T00:56:48.502ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-15T00:56:48.501998884Z } file = sled-agent/src/instance.rs:781 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29012025-01-15T00:56:48.502ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2025-01-15T00:56:48.501998884Z } propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29022025-01-15T00:56:48.502ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2025-01-15T00:56:48.501998884Z }, migration_in: None, migration_out: None }
29032025-01-15T00:56:48.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 397 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57955 req_id = 530b3bef-1ce3-46cc-81de-2eac61d95cb6 response_code = 204 uri = /vpc-routes
29042025-01-15T00:56:52.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60284
29052025-01-15T00:56:52.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60284 req_id = 77e31a0e-d587-4bc4-b5a8-a4e2a566414c response_code = 200 uri = /vpc-routes
29062025-01-15T00:56:52.201ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {78f08dea-b6fa-401f-946b-11f0ea697d8a: {10.151.2.176: {acca3b44-1d46-4699-924a-31812b36b4ac}, 10.151.2.175: {acca3b44-1d46-4699-924a-31812b36b4ac}}} }
29072025-01-15T00:56:52.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60284 req_id = c654bd63-76d5-4b50-90d2-c5c53a85260e response_code = 204 uri = /eip-gateways
29082025-01-15T00:56:52.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37765
29092025-01-15T00:56:52.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 637 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37765 req_id = 9c8e3ae5-524f-4968-b43b-a5da5e819c40 response_code = 200 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1/state
29102025-01-15T00:56:52.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51908
29112025-01-15T00:56:52.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51908 req_id = 77bd16bf-3029-4987-a4a4-ee92be643652 response_code = 200 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1/state
29122025-01-15T00:56:52.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60284 req_id = a3ebba0e-7ea0-4d25-8ff2-82879def9a82 response_code = 204 uri = /vpc-routes
29132025-01-15T00:56:52.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38370
29142025-01-15T00:56:52.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38370 req_id = 03a9e04b-d1b9-4f1b-a135-734f472520de response_code = 200 uri = /v2p
29152025-01-15T00:56:52.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38726
29162025-01-15T00:56:52.520ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29172025-01-15T00:56:52.558ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29182025-01-15T00:56:52.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88130 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38726 req_id = 58c5ba3e-a64f-4951-9026-31a6e976f181 response_code = 204 uri = /switch-ports
29192025-01-15T00:56:52.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38726 req_id = dbab0a1e-fc4d-4dc0-b53f-ad4ba0832f56 response_code = 200 uri = /network-bootstore-config
29202025-01-15T00:56:52.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51306
29212025-01-15T00:56:52.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51306 req_id = b268035a-7772-47ca-83eb-eab1d3170680 response_code = 200 uri = /vpc-routes
29222025-01-15T00:56:52.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52036
29232025-01-15T00:56:52.772ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29242025-01-15T00:56:52.814ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29252025-01-15T00:56:52.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102592 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52036 req_id = 7b357406-8b67-4e8d-b8b1-93259a3e975b response_code = 204 uri = /switch-ports
29262025-01-15T00:56:52.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54026
29272025-01-15T00:56:52.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {78f08dea-b6fa-401f-946b-11f0ea697d8a: {10.151.2.175: {acca3b44-1d46-4699-924a-31812b36b4ac}, 10.151.2.176: {acca3b44-1d46-4699-924a-31812b36b4ac}}} }
29282025-01-15T00:56:52.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51306 req_id = 34db45fa-d321-4d35-825f-1d48c1d4b8c1 response_code = 204 uri = /eip-gateways
29292025-01-15T00:56:52.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52036 req_id = 08164c3e-e89c-43cc-a6d0-4f6de2e6ee5b response_code = 200 uri = /network-bootstore-config
29302025-01-15T00:56:52.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54026 req_id = 80e26a40-e659-4961-a24c-bc81fe2ce034 response_code = 200 uri = /v2p
29312025-01-15T00:56:52.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51306 req_id = 25ca371f-8a21-4084-9ccf-8d76ba17f7a3 response_code = 204 uri = /vpc-routes
29322025-01-15T00:56:52.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37031
29332025-01-15T00:56:52.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37031 req_id = 1ab1fbdf-c5b3-4680-8aab-493a029c799f response_code = 200 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1/state
29342025-01-15T00:56:53.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59199
29352025-01-15T00:56:53.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59199 req_id = a525b128-452b-4ff1-bb81-0d7458de2628 response_code = 200 uri = /vpc-routes
29362025-01-15T00:56:53.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34475
29372025-01-15T00:56:53.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
29382025-01-15T00:56:53.161ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
29392025-01-15T00:56:53.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92505 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34475 req_id = a8a95fc2-0ef9-4709-938c-fd53bf954044 response_code = 204 uri = /switch-ports
29402025-01-15T00:56:53.216ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {78f08dea-b6fa-401f-946b-11f0ea697d8a: {10.151.2.176: {acca3b44-1d46-4699-924a-31812b36b4ac}, 10.151.2.175: {acca3b44-1d46-4699-924a-31812b36b4ac}}} }
29412025-01-15T00:56:53.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59199 req_id = fe2fbad9-a49e-4b83-a8bc-134201c8dcb2 response_code = 204 uri = /eip-gateways
29422025-01-15T00:56:53.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34475 req_id = 3fec67e2-edb2-439a-9478-daed23dafb40 response_code = 200 uri = /network-bootstore-config
29432025-01-15T00:56:53.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59176
29442025-01-15T00:56:53.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59176 req_id = 466fbb36-ec79-4d86-ab17-b8425d049624 response_code = 200 uri = /v2p
29452025-01-15T00:56:53.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59199 req_id = 00fa40f7-8323-4c3e-8ddc-9bbf01c55160 response_code = 204 uri = /vpc-routes
29462025-01-15T00:56:58.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40873
29472025-01-15T00:56:58.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 671 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40873 req_id = d1999792-3cd3-4b20-ac12-81fa7ef3b335 response_code = 200 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1/state
29482025-01-15T00:56:58.535ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-15T00:56:58.535728274Z } file = sled-agent/src/instance.rs:781 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29492025-01-15T00:56:58.535ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2025-01-15T00:56:58.535728274Z } propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29502025-01-15T00:56:58.535ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2025-01-15T00:56:58.535728274Z }, migration_in: None, migration_out: None }
29512025-01-15T00:56:58.580ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-15T00:56:58.580940244Z } file = sled-agent/src/instance.rs:781 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29522025-01-15T00:56:58.580ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2025-01-15T00:56:58.580940244Z } propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29532025-01-15T00:56:58.580ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29542025-01-15T00:56:58.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29552025-01-15T00:56:58.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29562025-01-15T00:56:58.581ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/994257a3-b79a-47bc-af52-5bd8fbba6493/debug/bundle/zone", "/pool/int/e97ac97c-c7f2-4735-a8b9-e1e9d269dbca/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/00e7ade3-5fdc-4e86-8e36-0048786505c0/crypt/debug", "/pool/ext/ba26a070-5665-4b80-b702-e0bfb62227f6/crypt/debug", "/pool/ext/a6ee976a-8413-4b79-86fd-0416e935e722/crypt/debug", "/pool/ext/e927d854-d6fd-4606-baca-3874882eccd4/crypt/debug", "/pool/ext/4b7d3a8c-080a-42b0-aaac-1d8fb94c442c/crypt/debug", "/pool/ext/1607e73c-a939-4c32-9f17-dc51c11d78a4/crypt/debug", "/pool/ext/cfcfcef4-12cf-46bc-a058-afb36dbeb8b4/crypt/debug", "/pool/ext/c10bc967-f2f3-462b-9053-5f03aca47fbc/crypt/debug", "/pool/ext/3131655f-f0d6-4fd3-bf28-70e12f0bf549/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29572025-01-15T00:56:58.582ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 15464572131382211863 n_samples = 6 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29582025-01-15T00:56:58.582ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10206816656135699190 n_samples = 6 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29592025-01-15T00:56:59.241ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1", bundle_id: fb3639d6-a95c-4e0a-864e-58229de17d3a }, time_created: 2025-01-15T00:56:58.582372071Z, version: 0, cause: TerminatedInstance }
29602025-01-15T00:56:59.241ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 file = sled-agent/src/instance.rs:1314 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29612025-01-15T00:57:01.020ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29622025-01-15T00:57:01.037ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(14632636), kind: System }
29632025-01-15T00:57:01.037ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(14632636), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29642025-01-15T00:57:01.043ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-15T00:57:01.043790362Z }, migration_in: None, migration_out: None }
29652025-01-15T00:57:01.181ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-15T00:57:01.043790362Z }, migration_in: None, migration_out: None }
29662025-01-15T00:57:01.186ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
29672025-01-15T00:57:02.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41882
29682025-01-15T00:57:02.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41882 req_id = 3824e43c-68a8-44a9-8c72-fb49017b986a response_code = 200 uri = /vpc-routes
29692025-01-15T00:57:02.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
29702025-01-15T00:57:02.050ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29712025-01-15T00:57:02.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41882 req_id = 1731c6b2-89a3-47f6-92dc-b97dc1a02eb9 response_code = 204 uri = /eip-gateways
29722025-01-15T00:57:02.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41882 req_id = bc9d4b96-c567-46e1-a756-8f072f1d4ba0 response_code = 204 uri = /vpc-routes
29732025-01-15T00:57:02.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44560
29742025-01-15T00:57:02.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44560 req_id = 18e5acc6-f157-4659-9187-4cad740f6930 response_code = 200 uri = /v2p
29752025-01-15T00:57:03.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56958
29762025-01-15T00:57:03.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56958 req_id = ceb63e9a-3ee3-41db-941c-d7c81580cac1 response_code = 200 uri = /v2p
29772025-01-15T00:57:03.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62701
29782025-01-15T00:57:03.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62701 req_id = d1a3fe95-e827-4c6b-a3dd-6ab958015089 response_code = 200 uri = /vpc-routes
29792025-01-15T00:57:03.797ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
29802025-01-15T00:57:03.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62701 req_id = 67647e95-81b0-4e3a-a175-b3903986f27f response_code = 204 uri = /eip-gateways
29812025-01-15T00:57:03.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62701 req_id = c62001e8-b8c4-47e5-9c14-4a887155fae5 response_code = 204 uri = /vpc-routes
29822025-01-15T00:57:04.298ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7618 local_addr = [fd00:1122:3344:101::1]:51877 method = GET remote_addr = [fd00:1122:3344:101::d]:32928 req_id = a42bf6f8-2e87-4186-9bc2-4f4051b7215d response_code = 200 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 uri = /71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29832025-01-15T00:57:04.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37617
29842025-01-15T00:57:04.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37617 req_id = 71e0e698-1e12-4ed4-b827-03c254e6a6a4 response_code = 200 uri = /vpc-routes
29852025-01-15T00:57:04.839ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 values = ExternalIpGatewayMap { mappings: {} }
29862025-01-15T00:57:04.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37617 req_id = 23e00491-6a15-4b22-8f10-4f566ae8ed07 response_code = 204 uri = /eip-gateways
29872025-01-15T00:57:04.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37617 req_id = 8f1ba378-1416-4794-82a2-6665f2c2032c response_code = 204 uri = /vpc-routes
29882025-01-15T00:57:06.065ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39741
29892025-01-15T00:57:06.065ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39741 req_id = a31a828a-a527-4b26-8b5c-6ab23d02417f response_code = 200 uri = /baseboard