Max level shown:
1 [ Jan 28 17:40:10 Enabled. ]
2 [ Jan 28 17:40:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 28 17:40:10 Method "start" exited with status 0. ]
4 [ Jan 28 17:40:10 Rereading configuration. ]
5 [ Jan 28 17:40:10 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-28T17:40:10.620ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-28T17:40:10.620ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-28T17:40:10.674ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-28T17:40:10.674ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-28T17:40:10.787ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-28T17:40:10.796ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-28T17:40:10.804ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-28T17:40:11.409ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-28T17:40:11.547ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-28T17:40:11.547ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-28T17:40:11.547ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-28T17:40:11.547ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-28T17:40:11.547ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-01-28T17:40:11.547ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-01-28T17:40:11.550ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-28T17:40:11.550ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-28T17:40:11.550ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-28T17:40:11.550ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-28T17:40:11.550ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-28T17:40:11.550ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-28T17:40:11.550ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-28T17:40:11.550ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-28T17:40:11.550ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-28T17:40:11.562ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-28T17:40:11.562ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool)
322025-01-28T17:40:11.661ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal }
332025-01-28T17:40:12.026ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-28T17:40:12.026ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-28T17:40:12.026ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-28T17:40:12.026ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-28T17:40:12.026ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-28T17:40:12.026ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-28T17:40:12.026ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-28T17:40:12.035ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-28T17:40:12.035ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool)
422025-01-28T17:40:12.125ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal }
432025-01-28T17:40:12.484ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-28T17:40:12.484ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-28T17:40:12.484ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
532025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542025-01-28T17:40:12.484ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-28T17:40:12.484ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-28T17:40:12.484ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-28T17:40:12.484ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-28T17:40:12.484ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-28T17:40:12.484ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-28T17:40:12.484ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-28T17:40:12.484ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-28T17:40:12.484ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-28T17:40:12.484ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-28T17:40:12.484ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-28T17:40:12.484ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882025-01-28T17:40:12.484ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-28T17:40:12.484ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942025-01-28T17:40:12.484ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-28T17:40:12.484ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-28T17:40:12.484ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1002025-01-28T17:40:12.484ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1012025-01-28T17:40:12.484ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022025-01-28T17:40:12.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-28T17:40:12.484ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-28T17:40:12.484ZINFOSledAgent (bootstore): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-28T17:40:12.484ZINFOSledAgent (bootstore): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-28T17:40:12.484ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-28T17:40:12.484ZINFOSledAgent (bootstore): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-28T17:40:12.484ZINFOSledAgent (bootstore): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-28T17:40:12.484ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-28T17:40:12.484ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-28T17:40:12.484ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-28T17:40:12.495ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-28T17:40:12.495ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2584, tv_nsec: 210215642 } time_to_next_cleanup = 599.999937888s
1142025-01-28T17:40:12.495ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-28T17:40:12.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-28T17:40:12.495ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-28T17:40:12.495ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-28T17:40:12.498ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-28T17:40:12.500ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-28T17:40:12.500ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1195
1212025-01-28T17:40:12.500ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-28T17:40:12.501ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-28T17:40:12.501ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-28T17:40:12.501ZINFOSledAgent (RSS): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-28T17:40:12.501ZINFOSledAgent (RSS): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-28T17:40:12.501ZINFOSledAgent (RSS): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-28T17:40:12.501ZINFOSledAgent (RSS): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-28T17:40:12.501ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1244
1292025-01-28T17:40:12.501ZINFOSledAgent (RSS): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-28T17:40:12.501ZINFOSledAgent (RSS): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-28T17:40:12.501ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1276
1322025-01-28T17:40:12.501ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-28T17:40:12.501ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-28T17:40:12.501ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1307
1352025-01-28T17:40:12.501ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-28T17:40:12.501ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-28T17:40:12.501ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-28T17:40:12.501ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-28T17:40:12.501ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 (sled), rack_id: 4d940752-63b5-4800-ba82-1a55ad8c1b47, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-28T17:40:12.502ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-28T17:40:12.502ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-28T17:40:12.507ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-28T17:40:12.512ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-28T17:40:12.512ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-28T17:40:12.517ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-28T17:40:12.518ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-28T17:40:12.518ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:57793
1482025-01-28T17:40:12.518ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 (sled), rack_id: 4d940752-63b5-4800-ba82-1a55ad8c1b47, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-28T17:40:12.518ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-28T17:40:12.518ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-28T17:40:12.518ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-28T17:40:12.518ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-28T17:40:12.518ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-28T17:40:12.518ZINFOSledAgent (StorageManager): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-28T17:40:12.518ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562025-01-28T17:40:12.518ZINFOSledAgent (StorageManager): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-28T17:40:12.518ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-28T17:40:12.518ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-28T17:40:12.518ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-28T17:40:12.518ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-28T17:40:12.518ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-28T17:40:12.534ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-28T17:40:12.556ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-28T17:40:12.573ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-28T17:40:12.582ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1662025-01-28T17:40:12.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-28T17:40:12.582ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1682025-01-28T17:40:12.582ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-28T17:40:12.585ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 139.742757ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f8211278-9249-4598-889c-e4f4e4aceb69", "content-length": "124", "date": "Tue, 28 Jan 2025 17:40:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f8211278-9249-4598-889c-e4f4e4aceb69" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-28T17:40:12.596ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_d6f75b00-8f28-4662-bf32-9c3356765a1d/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-28T17:40:12.619ZINFOSledAgent: successfully created encrypted zvol: name="oxi_d6f75b00-8f28-4662-bf32-9c3356765a1d/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-28T17:40:12.619ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_d6f75b00-8f28-4662-bf32-9c3356765a1d/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-28T17:40:12.624ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1742025-01-28T17:40:12.624ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-28T17:40:12.624ZINFOSledAgent (BackingFs): Ensuring dataset oxi_d6f75b00-8f28-4662-bf32-9c3356765a1d/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-28T17:40:12.696ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-01-28T17:40:12.726ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782025-01-28T17:40:12.726ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 136.741089ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b9ff80cf-fc89-4004-ace2-0b6b82560a02", "content-length": "124", "date": "Tue, 28 Jan 2025 17:40:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b9ff80cf-fc89-4004-ace2-0b6b82560a02" } file = clients/ddm-admin-client/src/lib.rs:177
1792025-01-28T17:40:12.864ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-28T17:40:12.864ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 186.275486ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "be2b57b0-7747-4d0c-b589-59309c1fba2c", "content-length": "124", "date": "Tue, 28 Jan 2025 17:40:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "be2b57b0-7747-4d0c-b589-59309c1fba2c" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-28T17:40:12.915ZINFOSledAgent (BackingFs): Mounting oxi_d6f75b00-8f28-4662-bf32-9c3356765a1d/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-28T17:40:12.928ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-28T17:40:12.928ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-28T17:40:12.928ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-28T17:40:12.928ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-28T17:40:13.052ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-28T17:40:13.052ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 217.908758ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7d2c3699-91c3-4db4-8a4f-127eed2f285b", "content-length": "124", "date": "Tue, 28 Jan 2025 17:40:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7d2c3699-91c3-4db4-8a4f-127eed2f285b" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-28T17:40:13.272ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-28T17:40:13.272ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 286.19616ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d94324dd-de98-4af8-83bc-cfaab6f70adf", "content-length": "124", "date": "Tue, 28 Jan 2025 17:40:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d94324dd-de98-4af8-83bc-cfaab6f70adf" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-28T17:40:13.559ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-28T17:40:13.560ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 258.187949ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6e257b16-59ad-4ed9-9c0e-c013399fef3f", "content-length": "124", "date": "Tue, 28 Jan 2025 17:40:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6e257b16-59ad-4ed9-9c0e-c013399fef3f" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-28T17:40:13.680ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1932025-01-28T17:40:13.685ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:39712 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1942025-01-28T17:40:13.685ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1952025-01-28T17:40:13.685ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:39712 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1962025-01-28T17:40:13.687ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 169.970834ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1972025-01-28T17:40:13.688ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1982025-01-28T17:40:13.688ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
1992025-01-28T17:40:13.688ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2002025-01-28T17:40:13.688ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012025-01-28T17:40:13.820ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022025-01-28T17:40:13.858ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 589.348954ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2032025-01-28T17:40:14.449ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 984.057649ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2042025-01-28T17:40:15.435ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.980879435s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2052025-01-28T17:40:16.290ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2062025-01-28T17:40:16.290ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2072025-01-28T17:40:16.290ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2082025-01-28T17:40:16.290ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2092025-01-28T17:40:16.290ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2102025-01-28T17:40:16.290ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2112025-01-28T17:40:16.292ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2122025-01-28T17:40:16.294ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2132025-01-28T17:40:16.294ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='00007525-634f-41c5-8ae6-743f86de9e0c'/> <propval type="astring" name="rack_id" value='4d940752-63b5-4800-ba82-1a55ad8c1b47'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe97:22f9'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='4d940752-63b5-4800-ba82-1a55ad8c1b47'/> <propval type="astring" name="sled_id" value='3f3bc5ca-5950-49d6-a443-b9f8f960dab0'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='3f3bc5ca-5950-49d6-a443-b9f8f960dab0'/> <propval type="astring" name="rack_uuid" value='4d940752-63b5-4800-ba82-1a55ad8c1b47'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='3f3bc5ca-5950-49d6-a443-b9f8f960dab0'/> <propval type="astring" name="rack_uuid" value='4d940752-63b5-4800-ba82-1a55ad8c1b47'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-01-28T17:40:16.294ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152025-01-28T17:40:16.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 57.693949ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-01-28T17:40:16.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 111.461883ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-01-28T17:40:17.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 207.241553ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-28T17:40:17.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 227.266506ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-28T17:40:17.508ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.235937648s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2202025-01-28T17:40:17.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 749.320515ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-28T17:40:18.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.088258022s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-28T17:40:19.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.129461262s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-01-28T17:40:20.746ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.116540255s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2242025-01-28T17:40:21.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.345458007s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-01-28T17:40:22.899ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/nexus.rs:527 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2262025-01-28T17:40:22.929ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272025-01-28T17:40:22.930ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2282025-01-28T17:40:22.931ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2292025-01-28T17:40:22.931ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302025-01-28T17:40:22.931ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312025-01-28T17:40:22.931ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-01-28T17:40:22.931ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-01-28T17:40:22.931ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342025-01-28T17:40:22.931ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352025-01-28T17:40:22.932ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2362025-01-28T17:40:22.932ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:57793
2372025-01-28T17:40:23.139ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2382025-01-28T17:40:23.139ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2392025-01-28T17:40:23.144ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402025-01-28T17:40:23.144ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2412025-01-28T17:40:23.144ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2422025-01-28T17:40:23.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34579
2432025-01-28T17:40:23.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442025-01-28T17:40:23.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-01-28T17:40:23.389ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:188
2462025-01-28T17:40:23.389ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-01-28T17:40:23.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34579 req_id = 7d6ac963-5070-4d24-92f9-fbff57e575b3 response_code = 200 uri = /inventory
2482025-01-28T17:40:23.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58548
2492025-01-28T17:40:23.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58548 req_id = 395747e6-ddfd-4534-8f23-cf56718537e8 response_code = 200 uri = /sled-role
2502025-01-28T17:40:23.451ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 057f5271-9402-455c-9c68-b9179e56b02a (physical_disk), pool_id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 23a663b7-2b5c-4d0a-bec8-47d9887567f4 (physical_disk), pool_id: d69f461c-d55e-48a5-9816-173eae69537e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7f45924c-b9ab-463a-a396-570020b9c4fd (physical_disk), pool_id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 89efdbea-927c-48ad-9076-ef6d2b83ca49 (physical_disk), pool_id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 9c1537ad-a17e-4608-b221-18f8e7da3f46 (physical_disk), pool_id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: a883b463-a6e1-4fe4-8679-da86d48dae64 (physical_disk), pool_id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: adc99383-058a-41a4-8030-925b8c966337 (physical_disk), pool_id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: e7887ca9-ded2-4bd9-985b-4e0ef9c09948 (physical_disk), pool_id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: f0978563-8ab7-44cc-85fb-19de138432a1 (physical_disk), pool_id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2512025-01-28T17:40:23.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39639
2522025-01-28T17:40:23.452ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2532025-01-28T17:40:23.452ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 057f5271-9402-455c-9c68-b9179e56b02a (physical_disk), pool_id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 23a663b7-2b5c-4d0a-bec8-47d9887567f4 (physical_disk), pool_id: d69f461c-d55e-48a5-9816-173eae69537e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7f45924c-b9ab-463a-a396-570020b9c4fd (physical_disk), pool_id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 89efdbea-927c-48ad-9076-ef6d2b83ca49 (physical_disk), pool_id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 9c1537ad-a17e-4608-b221-18f8e7da3f46 (physical_disk), pool_id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: a883b463-a6e1-4fe4-8679-da86d48dae64 (physical_disk), pool_id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: adc99383-058a-41a4-8030-925b8c966337 (physical_disk), pool_id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: e7887ca9-ded2-4bd9-985b-4e0ef9c09948 (physical_disk), pool_id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: f0978563-8ab7-44cc-85fb-19de138432a1 (physical_disk), pool_id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2542025-01-28T17:40:23.452ZINFOSledAgent (StorageManager): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552025-01-28T17:40:23.452ZINFOSledAgent (StorageManager): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562025-01-28T17:40:23.452ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2572025-01-28T17:40:23.452ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2582025-01-28T17:40:23.452ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2592025-01-28T17:40:23.452ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2602025-01-28T17:40:23.452ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2612025-01-28T17:40:23.583ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2622025-01-28T17:40:23.583ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool)
2632025-01-28T17:40:23.813ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6530076140719808323 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2642025-01-28T17:40:23.813ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7874697038161195497 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2652025-01-28T17:40:24.022ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2662025-01-28T17:40:24.023ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/probe_manager.rs:231 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
2672025-01-28T17:40:24.084ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }
2682025-01-28T17:40:24.091ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2692025-01-28T17:40:24.091ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2702025-01-28T17:40:24.091ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2712025-01-28T17:40:24.091ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2722025-01-28T17:40:24.091ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-01-28T17:40:24.091ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742025-01-28T17:40:24.091ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2752025-01-28T17:40:24.126ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762025-01-28T17:40:24.133ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone file = sled-storage/src/dataset.rs:302
2772025-01-28T17:40:24.265ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 file = sled-storage/src/dataset.rs:388
2782025-01-28T17:40:24.272ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792025-01-28T17:40:24.272ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802025-01-28T17:40:24.272ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812025-01-28T17:40:24.272ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822025-01-28T17:40:24.272ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832025-01-28T17:40:24.284ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842025-01-28T17:40:24.284ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d033c793-1184-4faf-a379-2f30181b8b7f (zpool)
2852025-01-28T17:40:24.382ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }
2862025-01-28T17:40:24.389ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2872025-01-28T17:40:24.389ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2882025-01-28T17:40:24.389ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2892025-01-28T17:40:24.390ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2902025-01-28T17:40:24.390ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-01-28T17:40:24.390ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-01-28T17:40:24.390ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2932025-01-28T17:40:24.425ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942025-01-28T17:40:24.433ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d033c793-1184-4faf-a379-2f30181b8b7f/crypt/zone file = sled-storage/src/dataset.rs:302
2952025-01-28T17:40:24.571ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d033c793-1184-4faf-a379-2f30181b8b7f file = sled-storage/src/dataset.rs:388
2962025-01-28T17:40:24.579ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972025-01-28T17:40:24.579ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982025-01-28T17:40:24.579ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992025-01-28T17:40:24.579ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002025-01-28T17:40:24.579ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012025-01-28T17:40:24.588ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022025-01-28T17:40:24.588ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool)
3032025-01-28T17:40:24.677ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }
3042025-01-28T17:40:24.684ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052025-01-28T17:40:24.684ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062025-01-28T17:40:24.684ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072025-01-28T17:40:24.684ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082025-01-28T17:40:24.684ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-01-28T17:40:24.684ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-01-28T17:40:24.684ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112025-01-28T17:40:24.715ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122025-01-28T17:40:24.721ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_94f0d539-6272-43cf-85f5-da15e180f2ad/crypt/zone file = sled-storage/src/dataset.rs:302
3132025-01-28T17:40:24.845ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_94f0d539-6272-43cf-85f5-da15e180f2ad file = sled-storage/src/dataset.rs:388
3142025-01-28T17:40:24.851ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152025-01-28T17:40:24.851ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162025-01-28T17:40:24.851ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172025-01-28T17:40:24.851ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182025-01-28T17:40:24.852ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192025-01-28T17:40:24.861ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202025-01-28T17:40:24.861ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool)
3212025-01-28T17:40:24.956ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }
3222025-01-28T17:40:24.964ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3232025-01-28T17:40:24.964ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3242025-01-28T17:40:24.964ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3252025-01-28T17:40:24.964ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3262025-01-28T17:40:24.964ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272025-01-28T17:40:24.964ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-01-28T17:40:24.964ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3292025-01-28T17:40:25.000ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302025-01-28T17:40:25.009ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/zone file = sled-storage/src/dataset.rs:302
3312025-01-28T17:40:25.029ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/probe_manager.rs:231 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
3322025-01-28T17:40:25.150ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7 file = sled-storage/src/dataset.rs:388
3332025-01-28T17:40:25.158ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342025-01-28T17:40:25.158ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352025-01-28T17:40:25.158ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362025-01-28T17:40:25.158ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372025-01-28T17:40:25.158ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382025-01-28T17:40:25.169ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392025-01-28T17:40:25.169ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d69f461c-d55e-48a5-9816-173eae69537e (zpool)
3402025-01-28T17:40:25.270ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }
3412025-01-28T17:40:25.279ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3422025-01-28T17:40:25.279ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3432025-01-28T17:40:25.279ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3442025-01-28T17:40:25.279ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3452025-01-28T17:40:25.279ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-01-28T17:40:25.279ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-01-28T17:40:25.279ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3482025-01-28T17:40:25.314ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492025-01-28T17:40:25.322ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone file = sled-storage/src/dataset.rs:302
3502025-01-28T17:40:25.462ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d69f461c-d55e-48a5-9816-173eae69537e file = sled-storage/src/dataset.rs:388
3512025-01-28T17:40:25.470ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522025-01-28T17:40:25.470ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532025-01-28T17:40:25.470ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542025-01-28T17:40:25.470ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552025-01-28T17:40:25.470ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562025-01-28T17:40:25.479ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572025-01-28T17:40:25.479ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool)
3582025-01-28T17:40:25.572ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }
3592025-01-28T17:40:25.579ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602025-01-28T17:40:25.579ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612025-01-28T17:40:25.579ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622025-01-28T17:40:25.579ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632025-01-28T17:40:25.579ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-01-28T17:40:25.579ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-01-28T17:40:25.579ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662025-01-28T17:40:25.614ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672025-01-28T17:40:25.622ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7d23e6c8-6805-4a21-bee4-ece464779811/crypt/zone file = sled-storage/src/dataset.rs:302
3682025-01-28T17:40:25.761ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7d23e6c8-6805-4a21-bee4-ece464779811 file = sled-storage/src/dataset.rs:388
3692025-01-28T17:40:25.769ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702025-01-28T17:40:25.769ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712025-01-28T17:40:25.769ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722025-01-28T17:40:25.769ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732025-01-28T17:40:25.769ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742025-01-28T17:40:25.778ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752025-01-28T17:40:25.778ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 37b8192c-9236-4941-bad3-2ab9840de50c (zpool)
3762025-01-28T17:40:25.871ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }
3772025-01-28T17:40:25.879ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782025-01-28T17:40:25.879ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792025-01-28T17:40:25.879ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802025-01-28T17:40:25.879ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812025-01-28T17:40:25.879ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-01-28T17:40:25.879ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-01-28T17:40:25.879ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842025-01-28T17:40:25.915ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3852025-01-28T17:40:25.923ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_37b8192c-9236-4941-bad3-2ab9840de50c/crypt/zone file = sled-storage/src/dataset.rs:302
3862025-01-28T17:40:26.031ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/probe_manager.rs:231 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
3872025-01-28T17:40:26.069ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_37b8192c-9236-4941-bad3-2ab9840de50c file = sled-storage/src/dataset.rs:388
3882025-01-28T17:40:26.077ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892025-01-28T17:40:26.077ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902025-01-28T17:40:26.077ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912025-01-28T17:40:26.077ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922025-01-28T17:40:26.077ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932025-01-28T17:40:26.086ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942025-01-28T17:40:26.087ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = da44c06d-1c73-487e-9c46-5eba2365be55 (zpool)
3952025-01-28T17:40:26.186ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }
3962025-01-28T17:40:26.194ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3972025-01-28T17:40:26.194ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3982025-01-28T17:40:26.194ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3992025-01-28T17:40:26.194ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4002025-01-28T17:40:26.194ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-01-28T17:40:26.195ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-01-28T17:40:26.195ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4032025-01-28T17:40:26.231ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042025-01-28T17:40:26.239ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone file = sled-storage/src/dataset.rs:302
4052025-01-28T17:40:26.385ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_da44c06d-1c73-487e-9c46-5eba2365be55 file = sled-storage/src/dataset.rs:388
4062025-01-28T17:40:26.394ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072025-01-28T17:40:26.394ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082025-01-28T17:40:26.394ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092025-01-28T17:40:26.394ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102025-01-28T17:40:26.394ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112025-01-28T17:40:26.404ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122025-01-28T17:40:26.404ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool)
4132025-01-28T17:40:26.500ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }
4142025-01-28T17:40:26.508ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4152025-01-28T17:40:26.508ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4162025-01-28T17:40:26.508ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4172025-01-28T17:40:26.508ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4182025-01-28T17:40:26.508ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-01-28T17:40:26.509ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-01-28T17:40:26.509ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4212025-01-28T17:40:26.546ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222025-01-28T17:40:26.554ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/zone file = sled-storage/src/dataset.rs:302
4232025-01-28T17:40:26.720ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 file = sled-storage/src/dataset.rs:388
4242025-01-28T17:40:26.728ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252025-01-28T17:40:26.728ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262025-01-28T17:40:26.728ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272025-01-28T17:40:26.728ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f75b00-8f28-4662-bf32-9c3356765a1d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b33f8e45-ef1c-4734-b801-0475dcb207f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282025-01-28T17:40:26.729ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292025-01-28T17:40:26.729ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302025-01-28T17:40:26.729ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-01-28T17:40:26.729ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
4322025-01-28T17:40:26.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4332025-01-28T17:40:26.729ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
4342025-01-28T17:40:26.729ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
4352025-01-28T17:40:26.729ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
4362025-01-28T17:40:26.729ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
4372025-01-28T17:40:26.729ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
4382025-01-28T17:40:26.729ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392025-01-28T17:40:26.729ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
4402025-01-28T17:40:26.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3277686 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39639 req_id = d8570fef-fe41-40f5-8f65-c6882d0c11ef response_code = 200 uri = /omicron-physical-disks
4412025-01-28T17:40:26.761ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {01527553-58f8-40f4-a088-d69ed06046f3 (dataset): DatasetConfig { id: 01527553-58f8-40f4-a088-d69ed06046f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0249f728-d792-4de8-b224-7696370d5900 (dataset): DatasetConfig { id: 0249f728-d792-4de8-b224-7696370d5900 (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 042de163-0438-42e4-a1a4-5d9c19d56e8f (dataset): DatasetConfig { id: 042de163-0438-42e4-a1a4-5d9c19d56e8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04d69cd0-3a97-4118-9e1b-e87d4320b58e (dataset): DatasetConfig { id: 04d69cd0-3a97-4118-9e1b-e87d4320b58e (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 050582b0-9151-46e9-af64-7a81687883b0 (dataset): DatasetConfig { id: 050582b0-9151-46e9-af64-7a81687883b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06d0b866-1b74-499c-bb9a-f1eee6977ca3 (dataset): DatasetConfig { id: 06d0b866-1b74-499c-bb9a-f1eee6977ca3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12350c68-b51e-4604-86bf-05f48bc9bf5b (dataset): DatasetConfig { id: 12350c68-b51e-4604-86bf-05f48bc9bf5b (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12495089-7490-44a2-91e6-821154d861d9 (dataset): DatasetConfig { id: 12495089-7490-44a2-91e6-821154d861d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16efd952-7a60-4af9-b434-f9a8b6a5825a (dataset): DatasetConfig { id: 16efd952-7a60-4af9-b434-f9a8b6a5825a (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 223d6049-258c-4ea5-bcef-62c03542f03c (dataset): DatasetConfig { id: 223d6049-258c-4ea5-bcef-62c03542f03c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 277e9b3c-5a51-4494-a4ba-538f7bf0771e (dataset): DatasetConfig { id: 277e9b3c-5a51-4494-a4ba-538f7bf0771e (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29329e06-a40d-4d7e-af4c-cc1685d1a875 (dataset): DatasetConfig { id: 29329e06-a40d-4d7e-af4c-cc1685d1a875 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c8ab184-c411-41d8-b488-d406ed15b218 (dataset): DatasetConfig { id: 2c8ab184-c411-41d8-b488-d406ed15b218 (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d2b47a2-6051-4633-af01-321ec3f50860 (dataset): DatasetConfig { id: 2d2b47a2-6051-4633-af01-321ec3f50860 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f57077f-1b62-454e-9d61-a36d240561a5 (dataset): DatasetConfig { id: 2f57077f-1b62-454e-9d61-a36d240561a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 323b9495-f62f-46f4-a531-bcfa1f8492a9 (dataset): DatasetConfig { id: 323b9495-f62f-46f4-a531-bcfa1f8492a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38e449f8-ed6f-493f-bc7a-f148c63e3010 (dataset): DatasetConfig { id: 38e449f8-ed6f-493f-bc7a-f148c63e3010 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ae5a45b-e02f-43de-85d8-44fdcc459639 (dataset): DatasetConfig { id: 3ae5a45b-e02f-43de-85d8-44fdcc459639 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b58019e-1d9d-42fe-aa1d-3cb5d05bf8e6 (dataset): DatasetConfig { id: 3b58019e-1d9d-42fe-aa1d-3cb5d05bf8e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f9590f0-083d-4220-945f-fd9cf9722204 (dataset): DatasetConfig { id: 3f9590f0-083d-4220-945f-fd9cf9722204 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47f1686f-ea25-42b1-a608-0fa68030c81f (dataset): DatasetConfig { id: 47f1686f-ea25-42b1-a608-0fa68030c81f (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 48abf44f-533d-4818-bb94-ac1257872793 (dataset): DatasetConfig { id: 48abf44f-533d-4818-bb94-ac1257872793 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 56113c7a-346d-4590-a371-56cb0cef8747 (dataset): DatasetConfig { id: 56113c7a-346d-4590-a371-56cb0cef8747 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 575a892f-dcb1-458a-8c95-42d2370c5b07 (dataset): DatasetConfig { id: 575a892f-dcb1-458a-8c95-42d2370c5b07 (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b07ff0d-2939-4a64-87dd-00e0ff85f53e (dataset): DatasetConfig { id: 5b07ff0d-2939-4a64-87dd-00e0ff85f53e (dataset), name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c2bc494-8fc0-46dc-b4ff-49196e30ab5c (dataset): DatasetConfig { id: 5c2bc494-8fc0-46dc-b4ff-49196e30ab5c (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 60fd9913-fa61-4916-b224-7db766da0252 (dataset): DatasetConfig { id: 60fd9913-fa61-4916-b224-7db766da0252 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 612014a2-50f6-4ffd-a06c-07a4bd560dcd (dataset): DatasetConfig { id: 612014a2-50f6-4ffd-a06c-07a4bd560dcd (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61a091bc-9488-4d89-8ac6-dea9ad656a63 (dataset): DatasetConfig { id: 61a091bc-9488-4d89-8ac6-dea9ad656a63 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61e3e518-0840-4b21-a00a-2f5d0931c54d (dataset): DatasetConfig { id: 61e3e518-0840-4b21-a00a-2f5d0931c54d (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 61e78e4f-dd2d-4908-9018-08556cfe3aa8 (dataset): DatasetConfig { id: 61e78e4f-dd2d-4908-9018-08556cfe3aa8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65209e23-924c-4ec6-a287-1c3b31138b17 (dataset): DatasetConfig { id: 65209e23-924c-4ec6-a287-1c3b31138b17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65da05a5-70d7-4907-be19-086ed84317b3 (dataset): DatasetConfig { id: 65da05a5-70d7-4907-be19-086ed84317b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65fa17fb-4623-4d72-a2d3-74b79a982e0b (dataset): DatasetConfig { id: 65fa17fb-4623-4d72-a2d3-74b79a982e0b (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 696378bf-53e8-4f82-b602-40bc1f25719a (dataset): DatasetConfig { id: 696378bf-53e8-4f82-b602-40bc1f25719a (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b8813af-5504-42c0-92d3-bc23b1d3297f (dataset): DatasetConfig { id: 6b8813af-5504-42c0-92d3-bc23b1d3297f (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c9099bb-ac31-4d39-91fe-e67fed2c4e18 (dataset): DatasetConfig { id: 6c9099bb-ac31-4d39-91fe-e67fed2c4e18 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80cdd679-af6b-4fc0-8ee2-7c9a786f3acf (dataset): DatasetConfig { id: 80cdd679-af6b-4fc0-8ee2-7c9a786f3acf (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 865a49c3-d0c3-442a-ad86-bc4957200e91 (dataset): DatasetConfig { id: 865a49c3-d0c3-442a-ad86-bc4957200e91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8750263c-e08b-49b4-93e0-f2a28f7853ce (dataset): DatasetConfig { id: 8750263c-e08b-49b4-93e0-f2a28f7853ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8825dfbf-9829-454c-86e0-7072a7572cf2 (dataset): DatasetConfig { id: 8825dfbf-9829-454c-86e0-7072a7572cf2 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d630b61-7b27-4507-a34e-8729b4dcfeb9 (dataset): DatasetConfig { id: 8d630b61-7b27-4507-a34e-8729b4dcfeb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 906e09c1-5c06-4016-83e0-26fbe52b2c2e (dataset): DatasetConfig { id: 906e09c1-5c06-4016-83e0-26fbe52b2c2e (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92496412-893a-494b-bd2c-0785edee4e65 (dataset): DatasetConfig { id: 92496412-893a-494b-bd2c-0785edee4e65 (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97cb9980-59a6-42a2-8b5b-12f3c5fcb745 (dataset): DatasetConfig { id: 97cb9980-59a6-42a2-8b5b-12f3c5fcb745 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c11cfee-438b-4dfd-b50a-dc55efc23208 (dataset): DatasetConfig { id: 9c11cfee-438b-4dfd-b50a-dc55efc23208 (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0694259-3054-406e-8681-b31da7e58485 (dataset): DatasetConfig { id: a0694259-3054-406e-8681-b31da7e58485 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a85e0557-a3e8-471e-b2e4-f92be8cc3402 (dataset): DatasetConfig { id: a85e0557-a3e8-471e-b2e4-f92be8cc3402 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adb2a699-5c04-4bec-a10a-b34949389f33 (dataset): DatasetConfig { id: adb2a699-5c04-4bec-a10a-b34949389f33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b10292c2-dd84-424e-9530-8a0deaeb38c1 (dataset): DatasetConfig { id: b10292c2-dd84-424e-9530-8a0deaeb38c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6046f7a-6de6-48b6-971a-bb2fba60d359 (dataset): DatasetConfig { id: c6046f7a-6de6-48b6-971a-bb2fba60d359 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7998311-2414-4f90-ad1f-ebc9ecd4a1ef (dataset): DatasetConfig { id: c7998311-2414-4f90-ad1f-ebc9ecd4a1ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce353594-a00f-46d3-af71-67d4e0994fb0 (dataset): DatasetConfig { id: ce353594-a00f-46d3-af71-67d4e0994fb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cfa3a7ed-d04f-4010-a786-31cee09bb2a0 (dataset): DatasetConfig { id: cfa3a7ed-d04f-4010-a786-31cee09bb2a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d03ca13b-8968-4a35-8db3-94ca688805ea (dataset): DatasetConfig { id: d03ca13b-8968-4a35-8db3-94ca688805ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d066577e-080f-4f42-b49d-971af38afa2e (dataset): DatasetConfig { id: d066577e-080f-4f42-b49d-971af38afa2e (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d53e9b48-5b48-4b15-90ee-938f26a645a5 (dataset): DatasetConfig { id: d53e9b48-5b48-4b15-90ee-938f26a645a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9b1bb77-4625-4bc4-8c6c-4de5326503ac (dataset): DatasetConfig { id: d9b1bb77-4625-4bc4-8c6c-4de5326503ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da01d5bc-ca35-4980-aed4-6a4ce3db3069 (dataset): DatasetConfig { id: da01d5bc-ca35-4980-aed4-6a4ce3db3069 (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddfdc65e-0722-48ae-ab3a-3cba6781c8d6 (dataset): DatasetConfig { id: ddfdc65e-0722-48ae-ab3a-3cba6781c8d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e3106e72-cc17-4d3b-9ca1-f1ed208402ff (dataset): DatasetConfig { id: e3106e72-cc17-4d3b-9ca1-f1ed208402ff (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e418f426-4c4f-4b77-93c7-2bb72b7548a0 (dataset): DatasetConfig { id: e418f426-4c4f-4b77-93c7-2bb72b7548a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f13821b1-60e2-4b6d-98f1-3e4de1122e23 (dataset): DatasetConfig { id: f13821b1-60e2-4b6d-98f1-3e4de1122e23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1f18544-f024-47de-8348-d08ed6e161ad (dataset): DatasetConfig { id: f1f18544-f024-47de-8348-d08ed6e161ad (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f399f0c9-189d-4255-b99e-d04b473ad032 (dataset): DatasetConfig { id: f399f0c9-189d-4255-b99e-d04b473ad032 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f56f3971-bbbc-4b47-ac73-991389369247 (dataset): DatasetConfig { id: f56f3971-bbbc-4b47-ac73-991389369247 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422025-01-28T17:40:26.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53627
4432025-01-28T17:40:26.762ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
4442025-01-28T17:40:26.762ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {01527553-58f8-40f4-a088-d69ed06046f3 (dataset): DatasetConfig { id: 01527553-58f8-40f4-a088-d69ed06046f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0249f728-d792-4de8-b224-7696370d5900 (dataset): DatasetConfig { id: 0249f728-d792-4de8-b224-7696370d5900 (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 042de163-0438-42e4-a1a4-5d9c19d56e8f (dataset): DatasetConfig { id: 042de163-0438-42e4-a1a4-5d9c19d56e8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04d69cd0-3a97-4118-9e1b-e87d4320b58e (dataset): DatasetConfig { id: 04d69cd0-3a97-4118-9e1b-e87d4320b58e (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 050582b0-9151-46e9-af64-7a81687883b0 (dataset): DatasetConfig { id: 050582b0-9151-46e9-af64-7a81687883b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06d0b866-1b74-499c-bb9a-f1eee6977ca3 (dataset): DatasetConfig { id: 06d0b866-1b74-499c-bb9a-f1eee6977ca3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12350c68-b51e-4604-86bf-05f48bc9bf5b (dataset): DatasetConfig { id: 12350c68-b51e-4604-86bf-05f48bc9bf5b (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12495089-7490-44a2-91e6-821154d861d9 (dataset): DatasetConfig { id: 12495089-7490-44a2-91e6-821154d861d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16efd952-7a60-4af9-b434-f9a8b6a5825a (dataset): DatasetConfig { id: 16efd952-7a60-4af9-b434-f9a8b6a5825a (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 223d6049-258c-4ea5-bcef-62c03542f03c (dataset): DatasetConfig { id: 223d6049-258c-4ea5-bcef-62c03542f03c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 277e9b3c-5a51-4494-a4ba-538f7bf0771e (dataset): DatasetConfig { id: 277e9b3c-5a51-4494-a4ba-538f7bf0771e (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29329e06-a40d-4d7e-af4c-cc1685d1a875 (dataset): DatasetConfig { id: 29329e06-a40d-4d7e-af4c-cc1685d1a875 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c8ab184-c411-41d8-b488-d406ed15b218 (dataset): DatasetConfig { id: 2c8ab184-c411-41d8-b488-d406ed15b218 (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d2b47a2-6051-4633-af01-321ec3f50860 (dataset): DatasetConfig { id: 2d2b47a2-6051-4633-af01-321ec3f50860 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f57077f-1b62-454e-9d61-a36d240561a5 (dataset): DatasetConfig { id: 2f57077f-1b62-454e-9d61-a36d240561a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 323b9495-f62f-46f4-a531-bcfa1f8492a9 (dataset): DatasetConfig { id: 323b9495-f62f-46f4-a531-bcfa1f8492a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38e449f8-ed6f-493f-bc7a-f148c63e3010 (dataset): DatasetConfig { id: 38e449f8-ed6f-493f-bc7a-f148c63e3010 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ae5a45b-e02f-43de-85d8-44fdcc459639 (dataset): DatasetConfig { id: 3ae5a45b-e02f-43de-85d8-44fdcc459639 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b58019e-1d9d-42fe-aa1d-3cb5d05bf8e6 (dataset): DatasetConfig { id: 3b58019e-1d9d-42fe-aa1d-3cb5d05bf8e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f9590f0-083d-4220-945f-fd9cf9722204 (dataset): DatasetConfig { id: 3f9590f0-083d-4220-945f-fd9cf9722204 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47f1686f-ea25-42b1-a608-0fa68030c81f (dataset): DatasetConfig { id: 47f1686f-ea25-42b1-a608-0fa68030c81f (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 48abf44f-533d-4818-bb94-ac1257872793 (dataset): DatasetConfig { id: 48abf44f-533d-4818-bb94-ac1257872793 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 56113c7a-346d-4590-a371-56cb0cef8747 (dataset): DatasetConfig { id: 56113c7a-346d-4590-a371-56cb0cef8747 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 575a892f-dcb1-458a-8c95-42d2370c5b07 (dataset): DatasetConfig { id: 575a892f-dcb1-458a-8c95-42d2370c5b07 (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b07ff0d-2939-4a64-87dd-00e0ff85f53e (dataset): DatasetConfig { id: 5b07ff0d-2939-4a64-87dd-00e0ff85f53e (dataset), name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c2bc494-8fc0-46dc-b4ff-49196e30ab5c (dataset): DatasetConfig { id: 5c2bc494-8fc0-46dc-b4ff-49196e30ab5c (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 60fd9913-fa61-4916-b224-7db766da0252 (dataset): DatasetConfig { id: 60fd9913-fa61-4916-b224-7db766da0252 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 612014a2-50f6-4ffd-a06c-07a4bd560dcd (dataset): DatasetConfig { id: 612014a2-50f6-4ffd-a06c-07a4bd560dcd (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61a091bc-9488-4d89-8ac6-dea9ad656a63 (dataset): DatasetConfig { id: 61a091bc-9488-4d89-8ac6-dea9ad656a63 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61e3e518-0840-4b21-a00a-2f5d0931c54d (dataset): DatasetConfig { id: 61e3e518-0840-4b21-a00a-2f5d0931c54d (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 61e78e4f-dd2d-4908-9018-08556cfe3aa8 (dataset): DatasetConfig { id: 61e78e4f-dd2d-4908-9018-08556cfe3aa8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65209e23-924c-4ec6-a287-1c3b31138b17 (dataset): DatasetConfig { id: 65209e23-924c-4ec6-a287-1c3b31138b17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 65da05a5-70d7-4907-be19-086ed84317b3 (dataset): DatasetConfig { id: 65da05a5-70d7-4907-be19-086ed84317b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65fa17fb-4623-4d72-a2d3-74b79a982e0b (dataset): DatasetConfig { id: 65fa17fb-4623-4d72-a2d3-74b79a982e0b (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 696378bf-53e8-4f82-b602-40bc1f25719a (dataset): DatasetConfig { id: 696378bf-53e8-4f82-b602-40bc1f25719a (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b8813af-5504-42c0-92d3-bc23b1d3297f (dataset): DatasetConfig { id: 6b8813af-5504-42c0-92d3-bc23b1d3297f (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c9099bb-ac31-4d39-91fe-e67fed2c4e18 (dataset): DatasetConfig { id: 6c9099bb-ac31-4d39-91fe-e67fed2c4e18 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80cdd679-af6b-4fc0-8ee2-7c9a786f3acf (dataset): DatasetConfig { id: 80cdd679-af6b-4fc0-8ee2-7c9a786f3acf (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 865a49c3-d0c3-442a-ad86-bc4957200e91 (dataset): DatasetConfig { id: 865a49c3-d0c3-442a-ad86-bc4957200e91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8750263c-e08b-49b4-93e0-f2a28f7853ce (dataset): DatasetConfig { id: 8750263c-e08b-49b4-93e0-f2a28f7853ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8825dfbf-9829-454c-86e0-7072a7572cf2 (dataset): DatasetConfig { id: 8825dfbf-9829-454c-86e0-7072a7572cf2 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d630b61-7b27-4507-a34e-8729b4dcfeb9 (dataset): DatasetConfig { id: 8d630b61-7b27-4507-a34e-8729b4dcfeb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 906e09c1-5c06-4016-83e0-26fbe52b2c2e (dataset): DatasetConfig { id: 906e09c1-5c06-4016-83e0-26fbe52b2c2e (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92496412-893a-494b-bd2c-0785edee4e65 (dataset): DatasetConfig { id: 92496412-893a-494b-bd2c-0785edee4e65 (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97cb9980-59a6-42a2-8b5b-12f3c5fcb745 (dataset): DatasetConfig { id: 97cb9980-59a6-42a2-8b5b-12f3c5fcb745 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c11cfee-438b-4dfd-b50a-dc55efc23208 (dataset): DatasetConfig { id: 9c11cfee-438b-4dfd-b50a-dc55efc23208 (dataset), name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0694259-3054-406e-8681-b31da7e58485 (dataset): DatasetConfig { id: a0694259-3054-406e-8681-b31da7e58485 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a85e0557-a3e8-471e-b2e4-f92be8cc3402 (dataset): DatasetConfig { id: a85e0557-a3e8-471e-b2e4-f92be8cc3402 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adb2a699-5c04-4bec-a10a-b34949389f33 (dataset): DatasetConfig { id: adb2a699-5c04-4bec-a10a-b34949389f33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b10292c2-dd84-424e-9530-8a0deaeb38c1 (dataset): DatasetConfig { id: b10292c2-dd84-424e-9530-8a0deaeb38c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6046f7a-6de6-48b6-971a-bb2fba60d359 (dataset): DatasetConfig { id: c6046f7a-6de6-48b6-971a-bb2fba60d359 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7998311-2414-4f90-ad1f-ebc9ecd4a1ef (dataset): DatasetConfig { id: c7998311-2414-4f90-ad1f-ebc9ecd4a1ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce353594-a00f-46d3-af71-67d4e0994fb0 (dataset): DatasetConfig { id: ce353594-a00f-46d3-af71-67d4e0994fb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cfa3a7ed-d04f-4010-a786-31cee09bb2a0 (dataset): DatasetConfig { id: cfa3a7ed-d04f-4010-a786-31cee09bb2a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d03ca13b-8968-4a35-8db3-94ca688805ea (dataset): DatasetConfig { id: d03ca13b-8968-4a35-8db3-94ca688805ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d066577e-080f-4f42-b49d-971af38afa2e (dataset): DatasetConfig { id: d066577e-080f-4f42-b49d-971af38afa2e (dataset), name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d53e9b48-5b48-4b15-90ee-938f26a645a5 (dataset): DatasetConfig { id: d53e9b48-5b48-4b15-90ee-938f26a645a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9b1bb77-4625-4bc4-8c6c-4de5326503ac (dataset): DatasetConfig { id: d9b1bb77-4625-4bc4-8c6c-4de5326503ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da01d5bc-ca35-4980-aed4-6a4ce3db3069 (dataset): DatasetConfig { id: da01d5bc-ca35-4980-aed4-6a4ce3db3069 (dataset), name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddfdc65e-0722-48ae-ab3a-3cba6781c8d6 (dataset): DatasetConfig { id: ddfdc65e-0722-48ae-ab3a-3cba6781c8d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e3106e72-cc17-4d3b-9ca1-f1ed208402ff (dataset): DatasetConfig { id: e3106e72-cc17-4d3b-9ca1-f1ed208402ff (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e418f426-4c4f-4b77-93c7-2bb72b7548a0 (dataset): DatasetConfig { id: e418f426-4c4f-4b77-93c7-2bb72b7548a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f13821b1-60e2-4b6d-98f1-3e4de1122e23 (dataset): DatasetConfig { id: f13821b1-60e2-4b6d-98f1-3e4de1122e23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1f18544-f024-47de-8348-d08ed6e161ad (dataset): DatasetConfig { id: f1f18544-f024-47de-8348-d08ed6e161ad (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f399f0c9-189d-4255-b99e-d04b473ad032 (dataset): DatasetConfig { id: f399f0c9-189d-4255-b99e-d04b473ad032 (dataset), name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f56f3971-bbbc-4b47-ac73-991389369247 (dataset): DatasetConfig { id: f56f3971-bbbc-4b47-ac73-991389369247 (dataset), name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4452025-01-28T17:40:26.762ZINFOSledAgent (StorageManager): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462025-01-28T17:40:26.762ZINFOSledAgent (StorageManager): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-01-28T17:40:26.762ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4482025-01-28T17:40:26.779ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4492025-01-28T17:40:26.779ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4502025-01-28T17:40:26.779ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609" } file = sled-storage/src/manager.rs:1431
4512025-01-28T17:40:26.843ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522025-01-28T17:40:26.843ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532025-01-28T17:40:26.843ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/zone/oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), full_name: "oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/zone/oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd" } file = sled-storage/src/manager.rs:1431
4542025-01-28T17:40:26.904ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-01-28T17:40:26.904ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4562025-01-28T17:40:26.904ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d23e6c8-6805-4a21-bee4-ece464779811/crypt/zone"), full_name: "oxp_7d23e6c8-6805-4a21-bee4-ece464779811/crypt/zone" } file = sled-storage/src/manager.rs:1431
4572025-01-28T17:40:26.934ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-01-28T17:40:26.934ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4592025-01-28T17:40:26.934ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/debug"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/debug" } file = sled-storage/src/manager.rs:1431
4602025-01-28T17:40:26.962ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-01-28T17:40:26.962ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4622025-01-28T17:40:26.962ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone" } file = sled-storage/src/manager.rs:1431
4632025-01-28T17:40:26.994ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-01-28T17:40:26.994ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652025-01-28T17:40:26.994ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4662025-01-28T17:40:27.033ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/probe_manager.rs:231 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
4672025-01-28T17:40:27.041ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-28T17:40:27.041ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-01-28T17:40:27.041ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_37b8192c-9236-4941-bad3-2ab9840de50c/crucible" } file = sled-storage/src/manager.rs:1431
4702025-01-28T17:40:27.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-28T17:40:27.090ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722025-01-28T17:40:27.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc" } file = sled-storage/src/manager.rs:1431
4732025-01-28T17:40:27.152ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-28T17:40:27.152ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752025-01-28T17:40:27.152ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4762025-01-28T17:40:27.203ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-28T17:40:27.203ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-01-28T17:40:27.203ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d23e6c8-6805-4a21-bee4-ece464779811/crypt/zone/oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073"), full_name: "oxp_7d23e6c8-6805-4a21-bee4-ece464779811/crypt/zone/oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073" } file = sled-storage/src/manager.rs:1431
4792025-01-28T17:40:27.262ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-01-28T17:40:27.262ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4812025-01-28T17:40:27.262ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/zone"), full_name: "oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/zone" } file = sled-storage/src/manager.rs:1431
4822025-01-28T17:40:27.291ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-01-28T17:40:27.291ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4842025-01-28T17:40:27.291ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone" } file = sled-storage/src/manager.rs:1431
4852025-01-28T17:40:27.320ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-01-28T17:40:27.320ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872025-01-28T17:40:27.320ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crucible" } file = sled-storage/src/manager.rs:1431
4882025-01-28T17:40:27.369ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-01-28T17:40:27.369ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902025-01-28T17:40:27.369ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93" } file = sled-storage/src/manager.rs:1431
4912025-01-28T17:40:27.430ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-01-28T17:40:27.430ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4932025-01-28T17:40:27.430ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_94f0d539-6272-43cf-85f5-da15e180f2ad/crucible" } file = sled-storage/src/manager.rs:1431
4942025-01-28T17:40:27.479ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-01-28T17:40:27.479ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-01-28T17:40:27.479ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f" } file = sled-storage/src/manager.rs:1431
4972025-01-28T17:40:27.541ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-01-28T17:40:27.541ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992025-01-28T17:40:27.541ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7d23e6c8-6805-4a21-bee4-ece464779811/crucible" } file = sled-storage/src/manager.rs:1431
5002025-01-28T17:40:27.589ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-01-28T17:40:27.589ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022025-01-28T17:40:27.589ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5032025-01-28T17:40:27.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-01-28T17:40:27.638ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052025-01-28T17:40:27.638ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d033c793-1184-4faf-a379-2f30181b8b7f/crucible" } file = sled-storage/src/manager.rs:1431
5062025-01-28T17:40:27.686ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-01-28T17:40:27.686ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-01-28T17:40:27.686ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d033c793-1184-4faf-a379-2f30181b8b7f/crypt/zone/oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af"), full_name: "oxp_d033c793-1184-4faf-a379-2f30181b8b7f/crypt/zone/oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af" } file = sled-storage/src/manager.rs:1431
5092025-01-28T17:40:27.747ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-01-28T17:40:27.747ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5112025-01-28T17:40:27.747ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/debug"), full_name: "oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/debug" } file = sled-storage/src/manager.rs:1431
5122025-01-28T17:40:27.778ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-01-28T17:40:27.778ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5142025-01-28T17:40:27.778ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d033c793-1184-4faf-a379-2f30181b8b7f/crypt/debug"), full_name: "oxp_d033c793-1184-4faf-a379-2f30181b8b7f/crypt/debug" } file = sled-storage/src/manager.rs:1431
5152025-01-28T17:40:27.808ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-01-28T17:40:27.808ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5172025-01-28T17:40:27.808ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3" } file = sled-storage/src/manager.rs:1431
5182025-01-28T17:40:27.868ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-01-28T17:40:27.868ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-01-28T17:40:27.868ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/zone/oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3"), full_name: "oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/zone/oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3" } file = sled-storage/src/manager.rs:1431
5212025-01-28T17:40:27.929ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-01-28T17:40:27.929ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5232025-01-28T17:40:27.929ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/94f0d539-6272-43cf-85f5-da15e180f2ad/crypt/zone"), full_name: "oxp_94f0d539-6272-43cf-85f5-da15e180f2ad/crypt/zone" } file = sled-storage/src/manager.rs:1431
5242025-01-28T17:40:27.959ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-01-28T17:40:27.959ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5262025-01-28T17:40:27.959ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/debug"), full_name: "oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/debug" } file = sled-storage/src/manager.rs:1431
5272025-01-28T17:40:27.990ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282025-01-28T17:40:27.990ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292025-01-28T17:40:27.990ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5302025-01-28T17:40:28.034ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/probe_manager.rs:231 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
5312025-01-28T17:40:28.041ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-01-28T17:40:28.041ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332025-01-28T17:40:28.041ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5342025-01-28T17:40:28.092ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-28T17:40:28.092ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-01-28T17:40:28.092ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d" } file = sled-storage/src/manager.rs:1431
5372025-01-28T17:40:28.152ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-28T17:40:28.153ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5392025-01-28T17:40:28.153ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d69f461c-d55e-48a5-9816-173eae69537e/crypt/debug"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/debug" } file = sled-storage/src/manager.rs:1431
5402025-01-28T17:40:28.181ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-28T17:40:28.181ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-01-28T17:40:28.181ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40" } file = sled-storage/src/manager.rs:1431
5432025-01-28T17:40:28.242ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-01-28T17:40:28.242ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5452025-01-28T17:40:28.242ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d23e6c8-6805-4a21-bee4-ece464779811/crypt/debug"), full_name: "oxp_7d23e6c8-6805-4a21-bee4-ece464779811/crypt/debug" } file = sled-storage/src/manager.rs:1431
5462025-01-28T17:40:28.271ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-01-28T17:40:28.271ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5482025-01-28T17:40:28.271ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c" } file = sled-storage/src/manager.rs:1431
5492025-01-28T17:40:28.333ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-01-28T17:40:28.333ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-01-28T17:40:28.333ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5522025-01-28T17:40:28.385ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-01-28T17:40:28.385ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542025-01-28T17:40:28.385ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d033c793-1184-4faf-a379-2f30181b8b7f/crypt/zone/oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d"), full_name: "oxp_d033c793-1184-4faf-a379-2f30181b8b7f/crypt/zone/oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d" } file = sled-storage/src/manager.rs:1431
5552025-01-28T17:40:28.445ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-01-28T17:40:28.445ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5572025-01-28T17:40:28.445ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6" } file = sled-storage/src/manager.rs:1431
5582025-01-28T17:40:28.505ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-01-28T17:40:28.505ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602025-01-28T17:40:28.505ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5612025-01-28T17:40:28.556ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-01-28T17:40:28.556ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632025-01-28T17:40:28.556ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5642025-01-28T17:40:28.607ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-01-28T17:40:28.607ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5662025-01-28T17:40:28.607ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/94f0d539-6272-43cf-85f5-da15e180f2ad/crypt/debug"), full_name: "oxp_94f0d539-6272-43cf-85f5-da15e180f2ad/crypt/debug" } file = sled-storage/src/manager.rs:1431
5672025-01-28T17:40:28.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-01-28T17:40:28.638ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692025-01-28T17:40:28.638ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614" } file = sled-storage/src/manager.rs:1431
5702025-01-28T17:40:28.697ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-01-28T17:40:28.697ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5722025-01-28T17:40:28.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1" } file = sled-storage/src/manager.rs:1431
5732025-01-28T17:40:28.759ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-01-28T17:40:28.759ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752025-01-28T17:40:28.759ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7/crucible" } file = sled-storage/src/manager.rs:1431
5762025-01-28T17:40:28.807ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-01-28T17:40:28.807ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782025-01-28T17:40:28.807ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37b8192c-9236-4941-bad3-2ab9840de50c/crypt/zone/oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53"), full_name: "oxp_37b8192c-9236-4941-bad3-2ab9840de50c/crypt/zone/oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53" } file = sled-storage/src/manager.rs:1431
5792025-01-28T17:40:28.865ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-01-28T17:40:28.865ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812025-01-28T17:40:28.865ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/zone/oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd"), full_name: "oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/zone/oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd" } file = sled-storage/src/manager.rs:1431
5822025-01-28T17:40:28.923ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-01-28T17:40:28.923ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5842025-01-28T17:40:28.923ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37b8192c-9236-4941-bad3-2ab9840de50c/crypt/zone"), full_name: "oxp_37b8192c-9236-4941-bad3-2ab9840de50c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5852025-01-28T17:40:28.953ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-01-28T17:40:28.953ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5872025-01-28T17:40:28.953ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/zone"), full_name: "oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/zone" } file = sled-storage/src/manager.rs:1431
5882025-01-28T17:40:28.982ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-01-28T17:40:28.982ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5902025-01-28T17:40:28.982ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37b8192c-9236-4941-bad3-2ab9840de50c/crypt/debug"), full_name: "oxp_37b8192c-9236-4941-bad3-2ab9840de50c/crypt/debug" } file = sled-storage/src/manager.rs:1431
5912025-01-28T17:40:29.011ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922025-01-28T17:40:29.011ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5932025-01-28T17:40:29.011ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5942025-01-28T17:40:29.035ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/probe_manager.rs:231 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
5952025-01-28T17:40:29.063ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-01-28T17:40:29.063ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-01-28T17:40:29.063ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/zone/oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279" } file = sled-storage/src/manager.rs:1431
5982025-01-28T17:40:29.124ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-01-28T17:40:29.124ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6002025-01-28T17:40:29.124ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone" } file = sled-storage/src/manager.rs:1431
6012025-01-28T17:40:29.153ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-28T17:40:29.153ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6032025-01-28T17:40:29.153ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/zone/oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df" } file = sled-storage/src/manager.rs:1431
6042025-01-28T17:40:29.214ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-28T17:40:29.214ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-01-28T17:40:29.214ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crucible" } file = sled-storage/src/manager.rs:1431
6072025-01-28T17:40:29.263ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-01-28T17:40:29.263ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6092025-01-28T17:40:29.263ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d033c793-1184-4faf-a379-2f30181b8b7f/crypt/zone"), full_name: "oxp_d033c793-1184-4faf-a379-2f30181b8b7f/crypt/zone" } file = sled-storage/src/manager.rs:1431
6102025-01-28T17:40:29.293ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-01-28T17:40:29.293ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-01-28T17:40:29.293ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d033c793-1184-4faf-a379-2f30181b8b7f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6132025-01-28T17:40:29.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-01-28T17:40:29.343ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-01-28T17:40:29.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37b8192c-9236-4941-bad3-2ab9840de50c/crypt/zone/oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b"), full_name: "oxp_37b8192c-9236-4941-bad3-2ab9840de50c/crypt/zone/oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b" } file = sled-storage/src/manager.rs:1431
6162025-01-28T17:40:29.404ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-01-28T17:40:29.404ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-01-28T17:40:29.404ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d033c793-1184-4faf-a379-2f30181b8b7f/crypt/zone/oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665"), full_name: "oxp_d033c793-1184-4faf-a379-2f30181b8b7f/crypt/zone/oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665" } file = sled-storage/src/manager.rs:1431
6192025-01-28T17:40:29.465ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-01-28T17:40:29.465ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212025-01-28T17:40:29.465ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d" } file = sled-storage/src/manager.rs:1431
6222025-01-28T17:40:29.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-01-28T17:40:29.524ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242025-01-28T17:40:29.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7d23e6c8-6805-4a21-bee4-ece464779811/crypt/zone/oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b"), full_name: "oxp_7d23e6c8-6805-4a21-bee4-ece464779811/crypt/zone/oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b" } file = sled-storage/src/manager.rs:1431
6252025-01-28T17:40:29.585ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-01-28T17:40:29.585ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272025-01-28T17:40:29.585ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/zone/oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad"), full_name: "oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/zone/oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad" } file = sled-storage/src/manager.rs:1431
6282025-01-28T17:40:29.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-01-28T17:40:29.645ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6302025-01-28T17:40:29.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da44c06d-1c73-487e-9c46-5eba2365be55/crypt/debug"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/debug" } file = sled-storage/src/manager.rs:1431
6312025-01-28T17:40:29.674ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-01-28T17:40:29.674ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332025-01-28T17:40:29.674ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crucible" } file = sled-storage/src/manager.rs:1431
6342025-01-28T17:40:29.723ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-01-28T17:40:29.723ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362025-01-28T17:40:29.723ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795" } file = sled-storage/src/manager.rs:1431
6372025-01-28T17:40:29.790ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-01-28T17:40:29.790ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-01-28T17:40:29.790ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/94f0d539-6272-43cf-85f5-da15e180f2ad/crypt/zone/oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae"), full_name: "oxp_94f0d539-6272-43cf-85f5-da15e180f2ad/crypt/zone/oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae" } file = sled-storage/src/manager.rs:1431
6402025-01-28T17:40:29.848ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-01-28T17:40:29.848ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-01-28T17:40:29.849ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6432025-01-28T17:40:29.864ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 14.597994432s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
6442025-01-28T17:40:29.900ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452025-01-28T17:40:29.900ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6462025-01-28T17:40:29.900ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d69f461c-d55e-48a5-9816-173eae69537e/crucible" } file = sled-storage/src/manager.rs:1431
6472025-01-28T17:40:29.949ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-01-28T17:40:29.949ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492025-01-28T17:40:29.949ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b"), full_name: "oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crypt/zone/oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b" } file = sled-storage/src/manager.rs:1431
6502025-01-28T17:40:30.009ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-01-28T17:40:30.009ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-01-28T17:40:30.010ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
6532025-01-28T17:40:30.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3248213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53627 req_id = 4da91d1e-dab2-4e5b-a28f-257013998321 response_code = 200 uri = /datasets
6542025-01-28T17:40:30.038ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/probe_manager.rs:231 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
6552025-01-28T17:40:30.042ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: ed169480-688a-44a6-9339-8eaa9fb66609 (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f1d0741b-2c53-4992-ac52-93d303f2c05f (service), filesystem_pool: Some(ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 146c20a0-b186-4142-b488-d27d3eeab795 (service), filesystem_pool: Some(ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6562025-01-28T17:40:30.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33558
6572025-01-28T17:40:30.043ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582025-01-28T17:40:30.043ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592025-01-28T17:40:30.052ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-01-28T17:40:30.052ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-01-28T17:40:30.061ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-01-28T17:40:30.061ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-01-28T17:40:30.069ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6642025-01-28T17:40:30.069ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-01-28T17:40:30.069ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:188
6662025-01-28T17:40:30.069ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-28T17:40:30.113ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-28T17:40:30.113ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-01-28T17:40:30.113ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-01-28T17:40:30.167ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609 file = illumos-utils/src/zone.rs:325
6712025-01-28T17:40:30.171ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795 file = illumos-utils/src/zone.rs:325
6722025-01-28T17:40:30.174ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f file = illumos-utils/src/zone.rs:325
6732025-01-28T17:40:30.187ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609 file = illumos-utils/src/zone.rs:363
6742025-01-28T17:40:30.192ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795 file = illumos-utils/src/zone.rs:363
6752025-01-28T17:40:30.196ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f file = illumos-utils/src/zone.rs:363
6762025-01-28T17:40:31.040ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/probe_manager.rs:231 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
6772025-01-28T17:40:31.742ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782025-01-28T17:40:31.742ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6792025-01-28T17:40:31.743ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
6802025-01-28T17:40:32.229ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812025-01-28T17:40:32.710ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6822025-01-28T17:40:32.710ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832025-01-28T17:40:32.710ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6842025-01-28T17:40:32.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609") failed: Property not found. retry in 61.625367ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
6852025-01-28T17:40:32.719ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
6862025-01-28T17:40:32.723ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
6872025-01-28T17:40:32.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609") failed: Property not found. retry in 59.735154ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
6882025-01-28T17:40:32.836ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6892025-01-28T17:40:32.836ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6902025-01-28T17:40:32.843ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6912025-01-28T17:40:32.843ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6922025-01-28T17:40:32.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795") failed: Property not found. retry in 71.661347ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
6932025-01-28T17:40:32.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609") failed: Property not found. retry in 201.130176ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
6942025-01-28T17:40:32.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f") failed: Property not found. retry in 37.994423ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
6952025-01-28T17:40:32.901ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4152539053004605364 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
6962025-01-28T17:40:32.901ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12886795118483241651 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
6972025-01-28T17:40:33.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f") failed: Property not found. retry in 131.606832ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
6982025-01-28T17:40:33.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795") failed: Property not found. retry in 113.34244ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
6992025-01-28T17:40:33.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f") failed: Property not found. retry in 258.344432ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
7002025-01-28T17:40:33.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609") failed: Property not found. retry in 301.90812ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
7012025-01-28T17:40:33.356ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
7022025-01-28T17:40:33.357ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
7032025-01-28T17:40:33.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795") failed: Property not found. retry in 104.604496ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
7042025-01-28T17:40:33.437ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
7052025-01-28T17:40:33.437ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
7062025-01-28T17:40:33.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795") failed: Property not found. retry in 450.214929ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
7072025-01-28T17:40:33.503ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
7082025-01-28T17:40:33.503ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
7092025-01-28T17:40:33.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f") failed: Property not found. retry in 380.961884ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
7102025-01-28T17:40:33.528ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
7112025-01-28T17:40:33.528ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
7122025-01-28T17:40:33.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609") failed: Property not found. retry in 663.41302ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
7132025-01-28T17:40:33.623ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
7142025-01-28T17:40:33.623ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
7152025-01-28T17:40:33.721ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7162025-01-28T17:40:33.721ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7172025-01-28T17:40:33.756ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7182025-01-28T17:40:33.789ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7192025-01-28T17:40:33.789ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7202025-01-28T17:40:33.789ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7212025-01-28T17:40:33.789ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7222025-01-28T17:40:33.824ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6530076140719808323 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
7232025-01-28T17:40:33.824ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7874697038161195497 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
7242025-01-28T17:40:33.827ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7252025-01-28T17:40:33.884ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7262025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7272025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7282025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7302025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7322025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7342025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7362025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7382025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7402025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7422025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7442025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7462025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472025-01-28T17:40:33.884ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7482025-01-28T17:40:33.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f") failed: Property not found. retry in 808.251453ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
7492025-01-28T17:40:33.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795") failed: Property not found. retry in 975.150696ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
7502025-01-28T17:40:34.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609") failed: Property not found. retry in 1.20915621s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
7512025-01-28T17:40:34.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f") failed: Property not found. retry in 1.174376746s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
7522025-01-28T17:40:34.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795") failed: Property not found. retry in 876.828332ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
7532025-01-28T17:40:35.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609") failed: Property not found. retry in 881.018357ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
7542025-01-28T17:40:35.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795") failed: Property not found. retry in 1.297257581s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
7552025-01-28T17:40:35.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f") failed: Property not found. retry in 576.823709ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
7562025-01-28T17:40:36.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609") failed: Property not found. retry in 630.721493ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
7572025-01-28T17:40:36.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f") failed: Property not found. retry in 734.197421ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
7582025-01-28T17:40:36.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609") failed: Property not found. retry in 1.03646051s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
7592025-01-28T17:40:37.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795") failed: Property not found. retry in 1.137245997s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
7602025-01-28T17:40:37.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f") failed: Property not found. retry in 1.477531435s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
7612025-01-28T17:40:38.730ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_ed169480-688a-44a6-9339-8eaa9fb66609
7622025-01-28T17:40:38.730ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_146c20a0-b186-4142-b488-d27d3eeab795
7632025-01-28T17:40:38.730ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_f1d0741b-2c53-4992-ac52-93d303f2c05f
7642025-01-28T17:40:38.730ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7652025-01-28T17:40:38.730ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7662025-01-28T17:40:38.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8688035 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33558 req_id = 11c7ba36-474d-40c6-9201-371d5680fb72 response_code = 204 uri = /omicron-zones
7672025-01-28T17:40:38.733ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7682025-01-28T17:40:38.787ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7692025-01-28T17:40:38.968ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 149.214239ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7702025-01-28T17:40:39.136ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712025-01-28T17:40:39.185ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7722025-01-28T17:40:39.185ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7732025-01-28T17:40:39.217ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7742025-01-28T17:40:39.218ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7752025-01-28T17:40:39.218ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7762025-01-28T17:40:39.248ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: ed169480-688a-44a6-9339-8eaa9fb66609 (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f1d0741b-2c53-4992-ac52-93d303f2c05f (service), filesystem_pool: Some(ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 146c20a0-b186-4142-b488-d27d3eeab795 (service), filesystem_pool: Some(ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ddf901f2-a379-462f-8489-130ec01e2b2d (service), filesystem_pool: Some(ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 59b799f8-7bb5-4716-a011-e3d4eff44ddb, kind: Service { id: ddf901f2-a379-462f-8489-130ec01e2b2d }, name: Name("ntp-ddf901f2-a379-462f-8489-130ec01e2b2d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 212])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7772025-01-28T17:40:39.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45330
7782025-01-28T17:40:39.248ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7792025-01-28T17:40:39.248ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7802025-01-28T17:40:39.259ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-01-28T17:40:39.259ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-01-28T17:40:39.269ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-01-28T17:40:39.269ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-01-28T17:40:39.277ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7852025-01-28T17:40:39.277ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:177
7862025-01-28T17:40:39.278ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:177
7872025-01-28T17:40:39.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7882025-01-28T17:40:39.289ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7892025-01-28T17:40:39.322ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7902025-01-28T17:40:39.322ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7912025-01-28T17:40:39.322ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7922025-01-28T17:40:39.352ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 216, 212]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7932025-01-28T17:40:39.352ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7942025-01-28T17:40:39.352ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7952025-01-28T17:40:39.353ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7962025-01-28T17:40:39.353ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7972025-01-28T17:40:39.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7982025-01-28T17:40:39.377ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d file = illumos-utils/src/zone.rs:325
7992025-01-28T17:40:39.395ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d file = illumos-utils/src/zone.rs:363
8002025-01-28T17:40:40.024ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8012025-01-28T17:40:40.024ZINFOSledAgent (ServiceManager): Booting oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8022025-01-28T17:40:40.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d") failed: Property not found. retry in 46.607676ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8032025-01-28T17:40:40.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d") failed: Property not found. retry in 107.625466ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8042025-01-28T17:40:40.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d") failed: Property not found. retry in 259.186388ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8052025-01-28T17:40:40.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d") failed: Property not found. retry in 237.004697ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8062025-01-28T17:40:40.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d") failed: Property not found. retry in 1.093952828s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8072025-01-28T17:40:41.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d") failed: Property not found. retry in 1.437033813s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8082025-01-28T17:40:42.903ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4152539053004605364 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8092025-01-28T17:40:42.903ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12886795118483241651 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8102025-01-28T17:40:43.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d") failed: Property not found. retry in 777.357452ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8112025-01-28T17:40:43.759ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3f3bc5ca-5950-49d6-a443-b9f8f960dab0) file = sled-agent/src/nexus.rs:527 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8122025-01-28T17:40:43.825ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6530076140719808323 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8132025-01-28T17:40:43.826ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7874697038161195497 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8142025-01-28T17:40:44.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d") failed: Property not found. retry in 728.416377ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8152025-01-28T17:40:44.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d") failed: Property not found. retry in 682.984623ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8162025-01-28T17:40:45.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d
8172025-01-28T17:40:45.634ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182025-01-28T17:40:45.635ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8192025-01-28T17:40:45.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6387242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45330 req_id = b465e3b7-8596-4136-8000-e8c9c5d43669 response_code = 204 uri = /omicron-zones
8202025-01-28T17:40:45.638ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8212025-01-28T17:40:45.669ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8222025-01-28T17:40:45.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44713
8232025-01-28T17:40:45.678ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8242025-01-28T17:40:45.678ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8530 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44713 req_id = 91814890-704e-47e1-b237-dd288141215f response_code = 500 uri = /timesync
8252025-01-28T17:40:45.681ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8262025-01-28T17:40:45.811ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272025-01-28T17:40:45.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55716
8282025-01-28T17:40:48.053ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 470525902257965630 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8292025-01-28T17:40:48.292ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1253551860448830420 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8302025-01-28T17:40:48.733ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17569239669023068991 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8312025-01-28T17:40:49.820ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8322025-01-28T17:40:49.820ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55716 req_id = 8c537eb9-90cd-4d22-9df5-b236cdd0416f response_code = 500 uri = /timesync
8332025-01-28T17:40:49.823ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8342025-01-28T17:40:49.973ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8352025-01-28T17:40:49.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58091
8362025-01-28T17:40:49.981ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8372025-01-28T17:40:49.981ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8410 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58091 req_id = 2b364025-f6de-4643-8b8a-6de09d093a4b response_code = 500 uri = /timesync
8382025-01-28T17:40:49.985ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8392025-01-28T17:40:50.123ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402025-01-28T17:40:50.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51579
8412025-01-28T17:40:53.458ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4152539053004605364 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8422025-01-28T17:40:53.458ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12886795118483241651 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8432025-01-28T17:40:54.509ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6530076140719808323 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8442025-01-28T17:40:54.509ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7874697038161195497 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8452025-01-28T17:40:54.814ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ddf901f2-a379-462f-8489-130ec01e2b2d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8462025-01-28T17:40:54.814ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008623 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51579 req_id = 6d892616-079d-4e92-b2df-cf72bc1af98a response_code = 500 uri = /timesync
8472025-01-28T17:40:54.817ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8482025-01-28T17:40:55.052ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492025-01-28T17:40:55.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54257
8502025-01-28T17:40:55.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54257 req_id = 6ff1181c-df7b-477d-94ea-5956c0873102 response_code = 200 uri = /timesync
8512025-01-28T17:40:55.062ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738086051.07135, correction: 0.013371004 } file = sled-agent/src/rack_setup/service.rs:743
8522025-01-28T17:40:55.062ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-01-28T17:40:55.205ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542025-01-28T17:40:55.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35610
8552025-01-28T17:40:55.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8683 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35610 req_id = 8cc4d9f2-3849-45ee-97c8-89d1fa6818d9 response_code = 200 uri = /timesync
8562025-01-28T17:40:55.218ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738086051.07135, correction: 0.012954576 } file = sled-agent/src/rack_setup/service.rs:743
8572025-01-28T17:40:55.218ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-01-28T17:40:55.385ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592025-01-28T17:40:55.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49928
8602025-01-28T17:40:55.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8033 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49928 req_id = e6c64697-2c00-4320-9faa-207841bad640 response_code = 200 uri = /timesync
8612025-01-28T17:40:55.395ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738086051.07135, correction: 0.012471713 } file = sled-agent/src/rack_setup/service.rs:743
8622025-01-28T17:40:55.395ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632025-01-28T17:40:55.579ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642025-01-28T17:40:55.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48177
8652025-01-28T17:40:55.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8535 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48177 req_id = 4445d06d-82b2-4cc3-b714-12235494e520 response_code = 200 uri = /timesync
8662025-01-28T17:40:55.590ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738086051.07135, correction: 0.011946361 } file = sled-agent/src/rack_setup/service.rs:743
8672025-01-28T17:40:55.590ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682025-01-28T17:40:56.097ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692025-01-28T17:40:56.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41640
8702025-01-28T17:40:56.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41640 req_id = 48259964-fba0-41ef-a19a-12edf7b616ef response_code = 200 uri = /timesync
8712025-01-28T17:40:56.109ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738086051.07135, correction: 0.010855809 } file = sled-agent/src/rack_setup/service.rs:743
8722025-01-28T17:40:56.109ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732025-01-28T17:40:56.320ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 298070140211097119 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8742025-01-28T17:40:56.320ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6994457643432452003 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
8752025-01-28T17:40:56.517ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762025-01-28T17:40:56.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47671
8772025-01-28T17:40:56.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47671 req_id = 6530f370-19ed-48b5-8285-278d0fa444b5 response_code = 200 uri = /timesync
8782025-01-28T17:40:56.528ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738086051.07135, correction: 0.009721314 } file = sled-agent/src/rack_setup/service.rs:743
8792025-01-28T17:40:56.528ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802025-01-28T17:40:57.015ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812025-01-28T17:40:57.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56381
8822025-01-28T17:40:57.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 21055 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56381 req_id = 54172106-c01a-44b8-80e9-a35d967991d7 response_code = 200 uri = /timesync
8832025-01-28T17:40:57.040ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3638886450, ip_addr: 216.229.0.50, stratum: 3, ref_time: 1738086056.8829482, correction: 0.008463116 } file = sled-agent/src/rack_setup/service.rs:743
8842025-01-28T17:40:57.040ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1383
8852025-01-28T17:40:57.070ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: ed169480-688a-44a6-9339-8eaa9fb66609 (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f1d0741b-2c53-4992-ac52-93d303f2c05f (service), filesystem_pool: Some(ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 146c20a0-b186-4142-b488-d27d3eeab795 (service), filesystem_pool: Some(ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ddf901f2-a379-462f-8489-130ec01e2b2d (service), filesystem_pool: Some(ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 59b799f8-7bb5-4716-a011-e3d4eff44ddb, kind: Service { id: ddf901f2-a379-462f-8489-130ec01e2b2d }, name: Name("ntp-ddf901f2-a379-462f-8489-130ec01e2b2d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 212])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: f19652e1-74fc-4b40-91b5-544976193279 (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: b33b2fde-0c94-4308-9045-1217315c89df (service), filesystem_pool: Some(ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External } } } }, OmicronZoneConfig { id: 463f6585-f43d-4859-8d7f-33eec6b9440d (service), filesystem_pool: Some(ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External } } } }, OmicronZoneConfig { id: 50538171-4049-4c74-bd82-1a2a2f0724bd (service), filesystem_pool: Some(ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0ec2531d-9711-44fe-b851-20880a79e3af (service), filesystem_pool: Some(ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8862025-01-28T17:40:57.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35109
8872025-01-28T17:40:57.070ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8882025-01-28T17:40:57.070ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8892025-01-28T17:40:57.080ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8902025-01-28T17:40:57.080ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, responder: ... }
8912025-01-28T17:40:57.090ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8922025-01-28T17:40:57.090ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8932025-01-28T17:40:57.099ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8942025-01-28T17:40:57.099ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8952025-01-28T17:40:57.108ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8962025-01-28T17:40:57.108ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8972025-01-28T17:40:57.116ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8982025-01-28T17:40:57.116ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8992025-01-28T17:40:57.124ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9002025-01-28T17:40:57.124ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9012025-01-28T17:40:57.131ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9022025-01-28T17:40:57.131ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9032025-01-28T17:40:57.139ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9042025-01-28T17:40:57.139ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:177
9052025-01-28T17:40:57.140ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:177
9062025-01-28T17:40:57.140ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9072025-01-28T17:40:57.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9082025-01-28T17:40:57.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9092025-01-28T17:40:57.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9102025-01-28T17:40:57.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9112025-01-28T17:40:57.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9122025-01-28T17:40:57.309ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd file = illumos-utils/src/zone.rs:325
9132025-01-28T17:40:57.314ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df file = illumos-utils/src/zone.rs:325
9142025-01-28T17:40:57.318ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d file = illumos-utils/src/zone.rs:325
9152025-01-28T17:40:57.322ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af file = illumos-utils/src/zone.rs:325
9162025-01-28T17:40:57.327ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279 file = illumos-utils/src/zone.rs:325
9172025-01-28T17:40:57.332ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd file = illumos-utils/src/zone.rs:363
9182025-01-28T17:40:57.337ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df file = illumos-utils/src/zone.rs:363
9192025-01-28T17:40:57.341ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d file = illumos-utils/src/zone.rs:363
9202025-01-28T17:40:57.346ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af file = illumos-utils/src/zone.rs:363
9212025-01-28T17:40:57.351ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279 file = illumos-utils/src/zone.rs:363
9222025-01-28T17:41:00.226ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 341.663545ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
9232025-01-28T17:41:01.132ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='463f6585-f43d-4859-8d7f-33eec6b9440d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9242025-01-28T17:41:01.132ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9252025-01-28T17:41:01.206ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f19652e1-74fc-4b40-91b5-544976193279'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9262025-01-28T17:41:01.206ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9272025-01-28T17:41:01.303ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='0ec2531d-9711-44fe-b851-20880a79e3af'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9282025-01-28T17:41:01.304ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9292025-01-28T17:41:01.320ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='50538171-4049-4c74-bd82-1a2a2f0724bd'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9302025-01-28T17:41:01.320ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9312025-01-28T17:41:01.388ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b33b2fde-0c94-4308-9045-1217315c89df'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9322025-01-28T17:41:01.388ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9332025-01-28T17:41:01.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 49.349589ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9342025-01-28T17:41:01.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 74.519616ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9352025-01-28T17:41:01.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 114.524351ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9362025-01-28T17:41:01.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 44.819436ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9372025-01-28T17:41:01.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 65.083574ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9382025-01-28T17:41:01.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 148.252057ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9392025-01-28T17:41:01.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 121.590296ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9402025-01-28T17:41:01.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 36.998331ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9412025-01-28T17:41:01.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 156.94435ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9422025-01-28T17:41:01.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 136.514324ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9432025-01-28T17:41:01.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 58.098015ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9442025-01-28T17:41:01.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 283.869964ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9452025-01-28T17:41:01.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 152.352729ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9462025-01-28T17:41:01.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 272.731643ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9472025-01-28T17:41:01.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 256.12918ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9482025-01-28T17:41:01.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 430.4638ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9492025-01-28T17:41:01.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 342.119774ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9502025-01-28T17:41:02.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 221.8107ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9512025-01-28T17:41:02.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 406.586011ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9522025-01-28T17:41:02.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 529.581952ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9532025-01-28T17:41:02.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 701.289805ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9542025-01-28T17:41:02.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 607.575872ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9552025-01-28T17:41:02.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 728.802499ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9562025-01-28T17:41:02.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 855.783654ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9572025-01-28T17:41:02.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 781.945735ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9582025-01-28T17:41:02.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 1.030917342s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9592025-01-28T17:41:03.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 948.520233ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9602025-01-28T17:41:03.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 1.22076477s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9612025-01-28T17:41:03.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 526.629381ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9622025-01-28T17:41:03.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 801.167999ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9632025-01-28T17:41:03.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 1.114831885s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9642025-01-28T17:41:03.937ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60031
9652025-01-28T17:41:03.937ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60031 req_id = dc83f3b2-50ae-43a7-9e15-d0aafa323aac response_code = 200 uri = /baseboard
9662025-01-28T17:41:03.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 1.396702625s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9672025-01-28T17:41:03.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 569.191348ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9682025-01-28T17:41:04.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 1.218064212s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9692025-01-28T17:41:04.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 658.628887ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9702025-01-28T17:41:04.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 936.614661ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9712025-01-28T17:41:04.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 955.56123ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9722025-01-28T17:41:05.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 1.314447428s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9732025-01-28T17:41:05.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 536.841497ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9742025-01-28T17:41:05.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 877.890642ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9752025-01-28T17:41:05.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 590.683736ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9762025-01-28T17:41:05.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 1.395347394s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9772025-01-28T17:41:05.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 907.983524ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9782025-01-28T17:41:06.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 1.206686694s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9792025-01-28T17:41:06.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 1.354086992s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9802025-01-28T17:41:06.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 1.260673123s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9812025-01-28T17:41:06.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 1.397604427s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9822025-01-28T17:41:07.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 1.311613686s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9832025-01-28T17:41:07.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 1.203051136s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9842025-01-28T17:41:07.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 1.383341899s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9852025-01-28T17:41:07.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 612.508013ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9862025-01-28T17:41:08.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 988.797078ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9872025-01-28T17:41:08.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 511.12228ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9882025-01-28T17:41:08.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 875.381238ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9892025-01-28T17:41:08.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 674.897757ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9902025-01-28T17:41:08.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 751.886932ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9912025-01-28T17:41:09.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 847.562781ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9922025-01-28T17:41:09.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 709.258796ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9932025-01-28T17:41:09.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 843.04272ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9942025-01-28T17:41:09.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 1.409527081s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
9952025-01-28T17:41:09.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 912.234621ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
9962025-01-28T17:41:09.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 1.064716995s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
9972025-01-28T17:41:09.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 1.003235377s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
9982025-01-28T17:41:10.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 908.371317ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
9992025-01-28T17:41:10.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 817.801041ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
10002025-01-28T17:41:10.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 511.890628ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
10012025-01-28T17:41:10.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 565.082358ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
10022025-01-28T17:41:10.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 1.198380386s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
10032025-01-28T17:41:11.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 1.225261096s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
10042025-01-28T17:41:11.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 1.301037647s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
10052025-01-28T17:41:11.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 722.142037ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
10062025-01-28T17:41:11.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 569.659872ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
10072025-01-28T17:41:12.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279") failed: Property not found. retry in 1.25234252s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
10082025-01-28T17:41:12.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af") failed: Property not found. retry in 944.792984ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
10092025-01-28T17:41:12.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 599.051489ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
10102025-01-28T17:41:12.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d") failed: Property not found. retry in 1.354679439s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
10112025-01-28T17:41:12.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df") failed: Property not found. retry in 907.508997ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
10122025-01-28T17:41:12.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd") failed: Property not found. retry in 1.357259606s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
10132025-01-28T17:41:14.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_50538171-4049-4c74-bd82-1a2a2f0724bd
10142025-01-28T17:41:14.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_b33b2fde-0c94-4308-9045-1217315c89df
10152025-01-28T17:41:14.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_463f6585-f43d-4859-8d7f-33eec6b9440d
10162025-01-28T17:41:14.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af
10172025-01-28T17:41:14.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_f19652e1-74fc-4b40-91b5-544976193279
10182025-01-28T17:41:14.175ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10192025-01-28T17:41:14.175ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10202025-01-28T17:41:14.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 17094695 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35109 req_id = 44a58046-fff3-4fd7-bdf1-2514faa18b77 response_code = 204 uri = /omicron-zones
10212025-01-28T17:41:14.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63187
10222025-01-28T17:41:14.240ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 31077 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63187 req_id = 2ddcd82a-270d-4c83-a3fe-1060d98b728e response_code = 500 uri = /cockroachdb
10232025-01-28T17:41:14.241ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2ddcd82a-270d-4c83-a3fe-1060d98b728e", "content-length": "124", "date": "Tue, 28 Jan 2025 17:41:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2ddcd82a-270d-4c83-a3fe-1060d98b728e" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 149.849842ms
10242025-01-28T17:41:14.420ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63187 req_id = 64192706-d7a2-43a0-8566-94441e4bcb70 response_code = 500 uri = /cockroachdb
10252025-01-28T17:41:14.420ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "64192706-d7a2-43a0-8566-94441e4bcb70", "content-length": "124", "date": "Tue, 28 Jan 2025 17:41:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "64192706-d7a2-43a0-8566-94441e4bcb70" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 168.74177ms
10262025-01-28T17:41:14.617ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27277 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63187 req_id = 7d917ac8-d97b-45bd-b99a-7d54a8c18a3f response_code = 500 uri = /cockroachdb
10272025-01-28T17:41:14.617ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7d917ac8-d97b-45bd-b99a-7d54a8c18a3f", "content-length": "124", "date": "Tue, 28 Jan 2025 17:41:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7d917ac8-d97b-45bd-b99a-7d54a8c18a3f" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 186.974939ms
10282025-01-28T17:41:14.832ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27022 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63187 req_id = 31fe39c7-dfe9-4484-a392-9c8fcbb4efb4 response_code = 500 uri = /cockroachdb
10292025-01-28T17:41:14.833ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "31fe39c7-dfe9-4484-a392-9c8fcbb4efb4", "content-length": "124", "date": "Tue, 28 Jan 2025 17:41:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "31fe39c7-dfe9-4484-a392-9c8fcbb4efb4" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 252.982092ms
10302025-01-28T17:41:15.114ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27417 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63187 req_id = 59307cf5-359d-42d2-9f2b-072025c96b5f response_code = 500 uri = /cockroachdb
10312025-01-28T17:41:15.114ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "59307cf5-359d-42d2-9f2b-072025c96b5f", "content-length": "124", "date": "Tue, 28 Jan 2025 17:41:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "59307cf5-359d-42d2-9f2b-072025c96b5f" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 235.325753ms
10322025-01-28T17:41:15.380ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28607 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63187 req_id = 172141c3-4133-4c5b-a102-67571bd46d42 response_code = 500 uri = /cockroachdb
10332025-01-28T17:41:15.381ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "172141c3-4133-4c5b-a102-67571bd46d42", "content-length": "124", "date": "Tue, 28 Jan 2025 17:41:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "172141c3-4133-4c5b-a102-67571bd46d42" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 234.645708ms
10342025-01-28T17:41:15.642ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63187 req_id = 90ca50b9-0d43-448d-9995-f907ca1cdee6 response_code = 500 uri = /cockroachdb
10352025-01-28T17:41:15.643ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "90ca50b9-0d43-448d-9995-f907ca1cdee6", "content-length": "124", "date": "Tue, 28 Jan 2025 17:41:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "90ca50b9-0d43-448d-9995-f907ca1cdee6" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 180.642594ms
10362025-01-28T17:41:15.645ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 452.693159ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
10372025-01-28T17:41:15.851ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0ec2531d-9711-44fe-b851-20880a79e3af /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63187 req_id = 15fd4f9b-7595-4768-afef-eb0d96895bbc response_code = 500 uri = /cockroachdb
10382025-01-28T17:41:15.851ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "15fd4f9b-7595-4768-afef-eb0d96895bbc", "content-length": "124", "date": "Tue, 28 Jan 2025 17:41:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "15fd4f9b-7595-4768-afef-eb0d96895bbc" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 415.169931ms
10392025-01-28T17:41:16.300ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3752
10402025-01-28T17:41:35.553ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10412025-01-28T17:41:39.585ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10422025-01-28T17:41:39.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 23319539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63187 req_id = d2ccfde3-4517-4a68-a485-9f5cbd4553d5 response_code = 204 uri = /cockroachdb
10432025-01-28T17:41:39.589ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42087
10442025-01-28T17:41:39.591ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 233 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42087 req_id = d876850c-6ced-43fd-9495-df526a0451c3 response_code = 200 uri = /baseboard
10452025-01-28T17:41:39.596ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.435171886s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
10462025-01-28T17:41:39.630ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: ed169480-688a-44a6-9339-8eaa9fb66609 (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f1d0741b-2c53-4992-ac52-93d303f2c05f (service), filesystem_pool: Some(ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 146c20a0-b186-4142-b488-d27d3eeab795 (service), filesystem_pool: Some(ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ddf901f2-a379-462f-8489-130ec01e2b2d (service), filesystem_pool: Some(ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 59b799f8-7bb5-4716-a011-e3d4eff44ddb, kind: Service { id: ddf901f2-a379-462f-8489-130ec01e2b2d }, name: Name("ntp-ddf901f2-a379-462f-8489-130ec01e2b2d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 216, 212])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: f19652e1-74fc-4b40-91b5-544976193279 (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: b33b2fde-0c94-4308-9045-1217315c89df (service), filesystem_pool: Some(ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External } } } }, OmicronZoneConfig { id: 463f6585-f43d-4859-8d7f-33eec6b9440d (service), filesystem_pool: Some(ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External } } } }, OmicronZoneConfig { id: 50538171-4049-4c74-bd82-1a2a2f0724bd (service), filesystem_pool: Some(ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0ec2531d-9711-44fe-b851-20880a79e3af (service), filesystem_pool: Some(ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External } } } }, OmicronZoneConfig { id: bcae8c4d-613c-4240-a5a7-639225fc1614 (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc (service), filesystem_pool: Some(ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd (service), filesystem_pool: Some(ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 (service), filesystem_pool: Some(ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 (service), filesystem_pool: Some(ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 57b6be0d-6f3c-4ca6-bbac-86a2157bff40 (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: fdf32984-9b0d-4cc9-b41a-a0d09f089fe6 (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8174f977-22ad-4b55-b974-5ecdb6f0605b (service), filesystem_pool: Some(ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 6a313ae0-11ba-46f5-9627-382979d2836b (service), filesystem_pool: Some(ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 4c63fb2b-5c1c-4922-bb74-19a36d01376c (service), filesystem_pool: Some(ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 24537f26-e37f-4161-ac28-a1c33767471d (service), filesystem_pool: Some(ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: d80025ac-5fb7-4ef1-a93e-292fc018b6d3 (service), filesystem_pool: Some(ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External } } } }, OmicronZoneConfig { id: cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1 (service), filesystem_pool: Some(ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External } } } }, OmicronZoneConfig { id: 78965ec8-9282-4d82-8658-6ba1f56434d3 (service), filesystem_pool: Some(ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External } } } }, OmicronZoneConfig { id: ea6cf83e-efc5-4bf1-8a68-77eb0d104665 (service), filesystem_pool: Some(ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External } } } }, OmicronZoneConfig { id: f493d09d-f078-4cb5-a2c0-eb63f288d9ad (service), filesystem_pool: Some(ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0fd43098-be15-4c8f-bb91-86d83102b8ae (service), filesystem_pool: Some(ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External } } } }, OmicronZoneConfig { id: a3df3b33-3624-4859-8edf-158e5ef0a073 (service), filesystem_pool: Some(ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External } } } }, OmicronZoneConfig { id: e722b36f-9495-468d-b1d3-32d570bba44b (service), filesystem_pool: Some(ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10472025-01-28T17:41:39.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44124
10482025-01-28T17:41:39.633ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10492025-01-28T17:41:39.633ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10502025-01-28T17:41:39.647ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10512025-01-28T17:41:39.647ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: InternalDns }, responder: ... }
10522025-01-28T17:41:39.659ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10532025-01-28T17:41:39.659ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10542025-01-28T17:41:39.669ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10552025-01-28T17:41:39.669ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10562025-01-28T17:41:39.679ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10572025-01-28T17:41:39.679ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10582025-01-28T17:41:39.688ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10592025-01-28T17:41:39.688ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10602025-01-28T17:41:39.698ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10612025-01-28T17:41:39.698ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10622025-01-28T17:41:39.707ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10632025-01-28T17:41:39.707ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10642025-01-28T17:41:39.716ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10652025-01-28T17:41:39.716ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10662025-01-28T17:41:39.726ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10672025-01-28T17:41:39.726ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10682025-01-28T17:41:39.735ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10692025-01-28T17:41:39.735ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10702025-01-28T17:41:39.745ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10712025-01-28T17:41:39.745ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, kind: Crucible }, responder: ... }
10722025-01-28T17:41:39.755ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10732025-01-28T17:41:39.755ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, kind: Crucible }, responder: ... }
10742025-01-28T17:41:39.765ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10752025-01-28T17:41:39.765ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, kind: Crucible }, responder: ... }
10762025-01-28T17:41:39.776ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10772025-01-28T17:41:39.776ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, kind: Crucible }, responder: ... }
10782025-01-28T17:41:39.787ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10792025-01-28T17:41:39.787ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, kind: Crucible }, responder: ... }
10802025-01-28T17:41:39.798ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10812025-01-28T17:41:39.798ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, kind: Crucible }, responder: ... }
10822025-01-28T17:41:39.810ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10832025-01-28T17:41:39.810ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, kind: Crucible }, responder: ... }
10842025-01-28T17:41:39.819ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10852025-01-28T17:41:39.819ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, kind: Crucible }, responder: ... }
10862025-01-28T17:41:39.829ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10872025-01-28T17:41:39.830ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, kind: Crucible }, responder: ... }
10882025-01-28T17:41:39.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10892025-01-28T17:41:39.840ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:177
10902025-01-28T17:41:39.840ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:177
10912025-01-28T17:41:39.841ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10922025-01-28T17:41:39.943ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10932025-01-28T17:41:39.994ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10942025-01-28T17:41:39.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952025-01-28T17:41:39.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10962025-01-28T17:41:39.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10972025-01-28T17:41:39.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10982025-01-28T17:41:40.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10992025-01-28T17:41:40.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11002025-01-28T17:41:40.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11012025-01-28T17:41:40.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11022025-01-28T17:41:40.199ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11032025-01-28T17:41:40.226ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11042025-01-28T17:41:40.226ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11052025-01-28T17:41:40.266ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11062025-01-28T17:41:40.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11072025-01-28T17:41:40.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11082025-01-28T17:41:40.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11092025-01-28T17:41:40.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11102025-01-28T17:41:40.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11112025-01-28T17:41:40.267ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1 file = illumos-utils/src/zone.rs:325
11122025-01-28T17:41:40.272ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073 file = illumos-utils/src/zone.rs:325
11132025-01-28T17:41:40.277ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665 file = illumos-utils/src/zone.rs:325
11142025-01-28T17:41:40.283ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae file = illumos-utils/src/zone.rs:325
11152025-01-28T17:41:40.289ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad file = illumos-utils/src/zone.rs:325
11162025-01-28T17:41:40.295ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c file = illumos-utils/src/zone.rs:325
11172025-01-28T17:41:40.299ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b file = illumos-utils/src/zone.rs:325
11182025-01-28T17:41:40.305ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3 file = illumos-utils/src/zone.rs:325
11192025-01-28T17:41:40.430ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1 file = illumos-utils/src/zone.rs:363
11202025-01-28T17:41:40.437ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073 file = illumos-utils/src/zone.rs:363
11212025-01-28T17:41:40.442ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665 file = illumos-utils/src/zone.rs:363
11222025-01-28T17:41:40.446ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae file = illumos-utils/src/zone.rs:363
11232025-01-28T17:41:40.451ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad file = illumos-utils/src/zone.rs:363
11242025-01-28T17:41:40.456ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c file = illumos-utils/src/zone.rs:363
11252025-01-28T17:41:40.461ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b file = illumos-utils/src/zone.rs:363
11262025-01-28T17:41:40.466ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3 file = illumos-utils/src/zone.rs:363
11272025-01-28T17:41:40.472ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3 file = illumos-utils/src/zone.rs:325
11282025-01-28T17:41:40.478ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d file = illumos-utils/src/zone.rs:325
11292025-01-28T17:41:40.483ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b file = illumos-utils/src/zone.rs:325
11302025-01-28T17:41:40.487ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6 file = illumos-utils/src/zone.rs:325
11312025-01-28T17:41:40.493ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b file = illumos-utils/src/zone.rs:325
11322025-01-28T17:41:40.498ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40 file = illumos-utils/src/zone.rs:325
11332025-01-28T17:41:40.505ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3 file = illumos-utils/src/zone.rs:363
11342025-01-28T17:41:40.512ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d file = illumos-utils/src/zone.rs:363
11352025-01-28T17:41:40.519ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b file = illumos-utils/src/zone.rs:363
11362025-01-28T17:41:40.526ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6 file = illumos-utils/src/zone.rs:363
11372025-01-28T17:41:40.536ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b file = illumos-utils/src/zone.rs:363
11382025-01-28T17:41:40.549ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40 file = illumos-utils/src/zone.rs:363
11392025-01-28T17:41:40.622ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11402025-01-28T17:41:40.682ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11412025-01-28T17:41:40.741ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11422025-01-28T17:41:40.801ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11432025-01-28T17:41:40.858ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11442025-01-28T17:41:40.867ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11452025-01-28T17:41:40.867ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11462025-01-28T17:41:40.923ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 171, 148]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11472025-01-28T17:41:40.923ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11482025-01-28T17:41:40.924ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11492025-01-28T17:41:40.924ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11502025-01-28T17:41:40.980ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 134, 254]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11512025-01-28T17:41:40.980ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11522025-01-28T17:41:40.982ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11532025-01-28T17:41:40.982ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11542025-01-28T17:41:41.042ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 128, 141]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11552025-01-28T17:41:41.042ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11562025-01-28T17:41:41.043ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11572025-01-28T17:41:41.043ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11582025-01-28T17:41:41.126ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 237, 253]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11592025-01-28T17:41:41.126ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11602025-01-28T17:41:41.127ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11612025-01-28T17:41:41.127ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11622025-01-28T17:41:41.248ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 234, 248]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11632025-01-28T17:41:41.248ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11642025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11652025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11662025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11672025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11682025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11692025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11702025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11712025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11722025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11732025-01-28T17:41:41.268ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11742025-01-28T17:41:41.284ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11752025-01-28T17:41:41.286ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11762025-01-28T17:41:41.293ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11772025-01-28T17:41:41.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11782025-01-28T17:41:41.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11792025-01-28T17:41:41.295ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11802025-01-28T17:41:41.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11812025-01-28T17:41:41.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11822025-01-28T17:41:41.298ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11832025-01-28T17:41:41.301ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11842025-01-28T17:41:41.565ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53 file = illumos-utils/src/zone.rs:325
11852025-01-28T17:41:41.575ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd file = illumos-utils/src/zone.rs:325
11862025-01-28T17:41:41.587ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93 file = illumos-utils/src/zone.rs:325
11872025-01-28T17:41:41.598ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614 file = illumos-utils/src/zone.rs:325
11882025-01-28T17:41:41.613ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc file = illumos-utils/src/zone.rs:325
11892025-01-28T17:41:41.622ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53 file = illumos-utils/src/zone.rs:363
11902025-01-28T17:41:41.635ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd file = illumos-utils/src/zone.rs:363
11912025-01-28T17:41:41.646ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93 file = illumos-utils/src/zone.rs:363
11922025-01-28T17:41:41.659ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614 file = illumos-utils/src/zone.rs:363
11932025-01-28T17:41:41.668ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc file = illumos-utils/src/zone.rs:363
11942025-01-28T17:41:43.907ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11952025-01-28T17:41:43.919ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
11962025-01-28T17:41:44.078ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2d260f58-bd81-45a2-9bbf-81f557964d1a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11972025-01-28T17:41:44.087ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_37b8192c-9236-4941-bad3-2ab9840de50c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='81497493-5ee1-43f6-a089-4372ab9a7c1f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982025-01-28T17:41:44.087ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dada65c8-54c0-45ac-b8b8-91c05516d842'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11992025-01-28T17:41:44.087ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d033c793-1184-4faf-a379-2f30181b8b7f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='54ad6e5f-a8c0-4a25-9338-f6cefcb40628'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12002025-01-28T17:41:44.087ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_94f0d539-6272-43cf-85f5-da15e180f2ad/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5d0b21d6-3c5c-4739-b6b8-02e9793329c4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12012025-01-28T17:41:44.087ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
12022025-01-28T17:41:44.096ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
12032025-01-28T17:41:44.103ZINFOSledAgent (ServiceManager): Booting oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
12042025-01-28T17:41:44.109ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7d23e6c8-6805-4a21-bee4-ece464779811/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ebfd4adc-6ef5-40e5-bfe5-5259a8600497'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12052025-01-28T17:41:44.110ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
12062025-01-28T17:41:44.115ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
12072025-01-28T17:41:44.123ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
12082025-01-28T17:41:44.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 47.202921ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
12092025-01-28T17:41:44.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 70.358476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
12102025-01-28T17:41:44.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 71.264216ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
12112025-01-28T17:41:44.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 59.761606ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
12122025-01-28T17:41:44.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 62.527493ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
12132025-01-28T17:41:44.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 40.017912ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
12142025-01-28T17:41:44.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 46.439209ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
12152025-01-28T17:41:44.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 98.849043ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
12162025-01-28T17:41:45.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 67.943171ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
12172025-01-28T17:41:45.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 68.676861ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
12182025-01-28T17:41:45.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 62.078525ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
12192025-01-28T17:41:45.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 136.373868ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
12202025-01-28T17:41:45.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 110.674372ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
12212025-01-28T17:41:45.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 57.020336ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
12222025-01-28T17:41:45.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 216.855597ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
12232025-01-28T17:41:45.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 273.437156ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
12242025-01-28T17:41:45.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 295.772882ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
12252025-01-28T17:41:45.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 172.46045ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
12262025-01-28T17:41:45.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 198.565781ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
12272025-01-28T17:41:46.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 295.628287ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
12282025-01-28T17:41:46.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 169.470673ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
12292025-01-28T17:41:46.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 237.771222ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
12302025-01-28T17:41:46.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 558.89968ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
12312025-01-28T17:41:46.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 303.124076ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
12322025-01-28T17:41:46.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 589.622622ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
12332025-01-28T17:41:46.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 519.435274ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
12342025-01-28T17:41:46.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 543.191978ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
12352025-01-28T17:41:46.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 815.544301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
12362025-01-28T17:41:46.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 584.047563ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
12372025-01-28T17:41:46.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 1.028682666s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
12382025-01-28T17:41:46.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 524.145193ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
12392025-01-28T17:41:46.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 675.744861ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
12402025-01-28T17:41:46.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 690.273959ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
12412025-01-28T17:41:46.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 711.78144ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
12422025-01-28T17:41:46.879ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12432025-01-28T17:41:46.915ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12442025-01-28T17:41:46.915ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
12452025-01-28T17:41:46.925ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
12462025-01-28T17:41:46.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 1.199081347s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
12472025-01-28T17:41:47.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 978.480966ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
12482025-01-28T17:41:47.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.136169781s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
12492025-01-28T17:41:47.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 70.96455ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
12502025-01-28T17:41:47.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 63.332205ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
12512025-01-28T17:41:47.341ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c3969d3f-3029-49ac-931c-10eeb0ff2fb2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12522025-01-28T17:41:47.341ZINFOSledAgent (ServiceManager): Booting oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
12532025-01-28T17:41:47.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 125.010929ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
12542025-01-28T17:41:47.388ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_da44c06d-1c73-487e-9c46-5eba2365be55/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e63f9923-b80e-4f1e-b12a-dba286a9da3d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12552025-01-28T17:41:47.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 118.410871ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
12562025-01-28T17:41:47.401ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
12572025-01-28T17:41:47.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.194348572s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
12582025-01-28T17:41:47.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 848.904637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
12592025-01-28T17:41:47.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 133.159367ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
12602025-01-28T17:41:47.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 1.073206179s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
12612025-01-28T17:41:47.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 266.367238ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
12622025-01-28T17:41:47.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 1.452065998s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
12632025-01-28T17:41:47.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 459.751821ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
12642025-01-28T17:41:47.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 58.929168ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
12652025-01-28T17:41:47.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 54.150084ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
12662025-01-28T17:41:47.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 472.357723ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
12672025-01-28T17:41:47.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 67.658388ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
12682025-01-28T17:41:47.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 71.15826ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
12692025-01-28T17:41:47.924ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12702025-01-28T17:41:47.925ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
12712025-01-28T17:41:47.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 117.104491ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
12722025-01-28T17:41:48.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 169.3509ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
12732025-01-28T17:41:48.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 481.968915ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
12742025-01-28T17:41:48.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 1.474832468s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
12752025-01-28T17:41:48.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 697.589703ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
12762025-01-28T17:41:48.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 817.875521ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
12772025-01-28T17:41:48.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 551.161756ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
12782025-01-28T17:41:48.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 627.502225ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
12792025-01-28T17:41:48.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 812.79447ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
12802025-01-28T17:41:48.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.065199349s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
12812025-01-28T17:41:48.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 466.506465ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
12822025-01-28T17:41:48.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 1.198752303s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
12832025-01-28T17:41:48.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.209559795s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
12842025-01-28T17:41:48.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 935.089326ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
12852025-01-28T17:41:48.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 1.100843355s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
12862025-01-28T17:41:49.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 700.046495ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
12872025-01-28T17:41:49.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 1.288305876s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
12882025-01-28T17:41:49.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 522.922274ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
12892025-01-28T17:41:49.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 764.572275ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
12902025-01-28T17:41:49.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 694.678289ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
12912025-01-28T17:41:49.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.295089923s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
12922025-01-28T17:41:49.544ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d69f461c-d55e-48a5-9816-173eae69537e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e3016e37-978b-4a41-9862-59f40b5b8023'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12932025-01-28T17:41:49.545ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
12942025-01-28T17:41:49.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 1.035475214s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
12952025-01-28T17:41:49.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 808.19609ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
12962025-01-28T17:41:49.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 962.156471ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
12972025-01-28T17:41:49.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 1.422848224s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
12982025-01-28T17:41:49.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 737.618606ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
12992025-01-28T17:41:49.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 953.759104ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
13002025-01-28T17:41:49.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 1.16125859s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
13012025-01-28T17:41:49.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.219449s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
13022025-01-28T17:41:49.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 28.218319ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
13032025-01-28T17:41:50.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 992.392183ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
13042025-01-28T17:41:50.034ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13052025-01-28T17:41:50.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 92.675294ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
13062025-01-28T17:41:50.048ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
13072025-01-28T17:41:50.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 236.989195ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
13082025-01-28T17:41:50.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 516.16692ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
13092025-01-28T17:41:50.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 559.111124ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
13102025-01-28T17:41:50.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 66.943999ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
13112025-01-28T17:41:50.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 84.575011ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
13122025-01-28T17:41:50.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 1.335078828s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
13132025-01-28T17:41:50.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 245.113338ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
13142025-01-28T17:41:50.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 1.413120361s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
13152025-01-28T17:41:50.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 789.646112ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
13162025-01-28T17:41:50.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 1.301076549s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
13172025-01-28T17:41:50.753ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13182025-01-28T17:41:50.754ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13192025-01-28T17:41:50.754ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
13202025-01-28T17:41:50.761ZINFOSledAgent (ServiceManager): Booting oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
13212025-01-28T17:41:50.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.192190945s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
13222025-01-28T17:41:50.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 888.261228ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
13232025-01-28T17:41:50.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 530.712866ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
13242025-01-28T17:41:50.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 1.302942709s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
13252025-01-28T17:41:50.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 587.655644ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
13262025-01-28T17:41:51.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 35.617083ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
13272025-01-28T17:41:51.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 879.543021ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
13282025-01-28T17:41:51.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 34.98274ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
13292025-01-28T17:41:51.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 50.632724ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
13302025-01-28T17:41:51.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 138.058125ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
13312025-01-28T17:41:51.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 223.748105ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
13322025-01-28T17:41:51.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 1.132706113s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
13332025-01-28T17:41:51.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 984.437344ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
13342025-01-28T17:41:51.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.107088677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
13352025-01-28T17:41:51.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 141.007548ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
13362025-01-28T17:41:51.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 289.698479ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
13372025-01-28T17:41:51.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 264.142489ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
13382025-01-28T17:41:51.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 564.03422ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
13392025-01-28T17:41:51.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 1.413312287s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
13402025-01-28T17:41:51.510ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412025-01-28T17:41:51.511ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
13422025-01-28T17:41:51.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 1.028252502s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
13432025-01-28T17:41:51.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 51.389805ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
13442025-01-28T17:41:51.631ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='57b6be0d-6f3c-4ca6-bbac-86a2157bff40'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13452025-01-28T17:41:51.631ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
13462025-01-28T17:41:51.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 431.692723ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
13472025-01-28T17:41:51.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 657.346634ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
13482025-01-28T17:41:51.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 123.062798ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
13492025-01-28T17:41:51.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 501.526238ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
13502025-01-28T17:41:51.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 60.219646ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
13512025-01-28T17:41:51.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 117.930149ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
13522025-01-28T17:41:51.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 113.602804ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
13532025-01-28T17:41:51.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 25.81488ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
13542025-01-28T17:41:51.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 1.496109939s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
13552025-01-28T17:41:51.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 1.323522886s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
13562025-01-28T17:41:51.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 104.334577ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
13572025-01-28T17:41:51.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 371.378946ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
13582025-01-28T17:41:51.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 276.043593ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
13592025-01-28T17:41:52.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 676.271979ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
13602025-01-28T17:41:52.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 765.304367ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
13612025-01-28T17:41:52.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 143.87283ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
13622025-01-28T17:41:52.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 1.419833393s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
13632025-01-28T17:41:52.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 682.424764ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
13642025-01-28T17:41:52.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 797.917876ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
13652025-01-28T17:41:52.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 613.015116ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
13662025-01-28T17:41:52.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 551.505889ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
13672025-01-28T17:41:52.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 936.655731ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
13682025-01-28T17:41:52.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 899.454461ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
13692025-01-28T17:41:52.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 448.123318ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
13702025-01-28T17:41:52.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 1.338145787s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
13712025-01-28T17:41:52.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 1.061996621s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
13722025-01-28T17:41:52.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 579.8305ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
13732025-01-28T17:41:52.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.335192308s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
13742025-01-28T17:41:52.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 806.939335ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
13752025-01-28T17:41:52.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 964.773334ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
13762025-01-28T17:41:52.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 616.211181ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
13772025-01-28T17:41:52.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 1.090654202s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
13782025-01-28T17:41:52.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 533.014192ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
13792025-01-28T17:41:52.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 982.15089ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
13802025-01-28T17:41:52.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 1.242878504s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
13812025-01-28T17:41:52.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 1.168277793s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
13822025-01-28T17:41:52.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 876.270789ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
13832025-01-28T17:41:52.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 946.374887ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
13842025-01-28T17:41:53.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 561.97337ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
13852025-01-28T17:41:53.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 562.453493ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
13862025-01-28T17:41:53.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 857.596711ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
13872025-01-28T17:41:53.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 584.28543ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
13882025-01-28T17:41:53.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 780.078994ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
13892025-01-28T17:41:53.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 1.118732023s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
13902025-01-28T17:41:53.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 848.395204ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
13912025-01-28T17:41:53.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 993.095357ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
13922025-01-28T17:41:53.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 1.244582819s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
13932025-01-28T17:41:53.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 1.253253895s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
13942025-01-28T17:41:53.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.467845789s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
13952025-01-28T17:41:53.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 983.226177ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
13962025-01-28T17:41:53.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 1.415495897s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
13972025-01-28T17:41:53.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 1.079503915s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
13982025-01-28T17:41:53.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 1.448974611s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
13992025-01-28T17:41:53.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 765.869891ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
14002025-01-28T17:41:53.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 669.225046ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
14012025-01-28T17:41:53.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 1.026236915s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
14022025-01-28T17:41:53.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 1.01516249s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
14032025-01-28T17:41:54.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 1.222351607s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
14042025-01-28T17:41:54.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 758.505404ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
14052025-01-28T17:41:54.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 1.422747287s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
14062025-01-28T17:41:54.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 604.86431ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
14072025-01-28T17:41:54.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 897.970575ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
14082025-01-28T17:41:54.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 993.578301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
14092025-01-28T17:41:54.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 1.206772654s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
14102025-01-28T17:41:54.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 716.015645ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
14112025-01-28T17:41:54.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 569.693551ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
14122025-01-28T17:41:54.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 504.395366ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
14132025-01-28T17:41:54.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 579.546165ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
14142025-01-28T17:41:54.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 675.173917ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
14152025-01-28T17:41:54.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 1.387677175s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
14162025-01-28T17:41:54.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 1.223925382s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
14172025-01-28T17:41:54.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 1.497068867s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
14182025-01-28T17:41:54.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 1.213379082s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
14192025-01-28T17:41:54.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 1.360485102s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
14202025-01-28T17:41:55.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.158684703s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
14212025-01-28T17:41:55.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 589.226998ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
14222025-01-28T17:41:55.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 1.11065117s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
14232025-01-28T17:41:55.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 1.320940206s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
14242025-01-28T17:41:55.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 837.232281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
14252025-01-28T17:41:55.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 884.680665ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
14262025-01-28T17:41:55.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 847.611718ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
14272025-01-28T17:41:55.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 642.190025ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
14282025-01-28T17:41:55.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 779.445614ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
14292025-01-28T17:41:55.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 991.15929ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
14302025-01-28T17:41:55.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 688.829678ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
14312025-01-28T17:41:55.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 1.209800186s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
14322025-01-28T17:41:55.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 679.331261ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
14332025-01-28T17:41:55.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 1.480509093s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
14342025-01-28T17:41:55.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 662.810001ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
14352025-01-28T17:41:56.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.390899231s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
14362025-01-28T17:41:56.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 1.064204226s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
14372025-01-28T17:41:56.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 984.829002ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
14382025-01-28T17:41:56.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 1.16104589s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
14392025-01-28T17:41:56.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 836.479998ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
14402025-01-28T17:41:56.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 1.46017673s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
14412025-01-28T17:41:56.186ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.214768869s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
14422025-01-28T17:41:56.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 1.185125902s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
14432025-01-28T17:41:56.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 1.236640566s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
14442025-01-28T17:41:56.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 547.98948ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
14452025-01-28T17:41:56.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 725.223124ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
14462025-01-28T17:41:56.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 940.784413ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
14472025-01-28T17:41:56.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 585.822305ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
14482025-01-28T17:41:56.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 808.332813ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
14492025-01-28T17:41:56.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 642.300945ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
14502025-01-28T17:41:56.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 1.392349604s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
14512025-01-28T17:41:56.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 1.057826765s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
14522025-01-28T17:41:56.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 716.395877ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
14532025-01-28T17:41:56.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 1.007007376s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
14542025-01-28T17:41:57.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 1.347294509s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
14552025-01-28T17:41:57.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 502.378613ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
14562025-01-28T17:41:57.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.217338711s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
14572025-01-28T17:41:57.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 790.394284ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
14582025-01-28T17:41:57.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 1.007299051s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
14592025-01-28T17:41:57.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 986.822284ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
14602025-01-28T17:41:57.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 1.275625036s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
14612025-01-28T17:41:57.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 875.653301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
14622025-01-28T17:41:57.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 1.271298646s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
14632025-01-28T17:41:57.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 1.219454261s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
14642025-01-28T17:41:57.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 853.762626ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
14652025-01-28T17:41:57.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 1.302041302s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
14662025-01-28T17:41:57.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.372074633s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
14672025-01-28T17:41:57.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 922.628988ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
14682025-01-28T17:41:57.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 1.279590472s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
14692025-01-28T17:41:57.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 593.502914ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
14702025-01-28T17:41:57.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 610.865477ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
14712025-01-28T17:41:57.743ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14722025-01-28T17:41:57.744ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
14732025-01-28T17:41:57.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 951.39298ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
14742025-01-28T17:41:57.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 1.364308865s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
14752025-01-28T17:41:57.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 1.438795546s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
14762025-01-28T17:41:57.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 61.449607ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
14772025-01-28T17:41:58.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 89.954382ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
14782025-01-28T17:41:58.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 1.489352798s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
14792025-01-28T17:41:58.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 144.298159ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
14802025-01-28T17:41:58.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 905.955092ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
14812025-01-28T17:41:58.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 1.154595268s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
14822025-01-28T17:41:58.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 941.103476ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
14832025-01-28T17:41:58.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 640.533566ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
14842025-01-28T17:41:58.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 595.663042ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
14852025-01-28T17:41:58.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 1.331880879s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
14862025-01-28T17:41:58.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 832.635421ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
14872025-01-28T17:41:58.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 634.037309ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
14882025-01-28T17:41:58.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 743.144208ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
14892025-01-28T17:41:58.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 1.395760125s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
14902025-01-28T17:41:58.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 951.553472ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
14912025-01-28T17:41:58.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 1.361254935s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
14922025-01-28T17:41:58.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 1.271510985s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
14932025-01-28T17:41:58.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 596.074894ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
14942025-01-28T17:41:58.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 645.596646ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
14952025-01-28T17:41:58.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 438.857127ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
14962025-01-28T17:41:58.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.190175868s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
14972025-01-28T17:41:58.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 636.405943ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
14982025-01-28T17:41:59.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 1.23141509s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
14992025-01-28T17:41:59.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 877.580686ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
15002025-01-28T17:41:59.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 1.142204129s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
15012025-01-28T17:41:59.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 1.308635785s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
15022025-01-28T17:41:59.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 1.070781886s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
15032025-01-28T17:41:59.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 1.326168429s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
15042025-01-28T17:41:59.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 1.484598649s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
15052025-01-28T17:41:59.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 584.851184ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15062025-01-28T17:41:59.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3") failed: Property not found. retry in 1.374576888s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
15072025-01-28T17:41:59.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 1.193463634s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
15082025-01-28T17:41:59.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 1.484173058s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
15092025-01-28T17:41:59.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.383844257s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
15102025-01-28T17:41:59.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 758.558071ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
15112025-01-28T17:41:59.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 1.467362828s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
15122025-01-28T17:41:59.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 776.193306ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
15132025-01-28T17:41:59.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 641.590022ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
15142025-01-28T17:42:00.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 764.149605ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
15152025-01-28T17:42:00.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 1.466933525s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15162025-01-28T17:42:00.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 1.321733982s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
15172025-01-28T17:42:00.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 1.059839484s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
15182025-01-28T17:42:00.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.452131353s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
15192025-01-28T17:42:00.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 1.296783344s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
15202025-01-28T17:42:00.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 1.046210481s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
15212025-01-28T17:42:00.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 555.193406ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
15222025-01-28T17:42:00.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 868.249378ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
15232025-01-28T17:42:00.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 1.362412032s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
15242025-01-28T17:42:00.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 1.417153073s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
15252025-01-28T17:42:00.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 658.398029ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
15262025-01-28T17:42:00.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 925.085611ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
15272025-01-28T17:42:00.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 909.980746ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
15282025-01-28T17:42:00.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 910.304437ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
15292025-01-28T17:42:00.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 993.265617ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
15302025-01-28T17:42:00.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c") failed: Property not found. retry in 1.183015796s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
15312025-01-28T17:42:01.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.373973895s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
15322025-01-28T17:42:01.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 656.416618ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
15332025-01-28T17:42:01.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 1.337261899s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
15342025-01-28T17:42:01.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1") failed: Property not found. retry in 1.287649873s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
15352025-01-28T17:42:01.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 1.03331115s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
15362025-01-28T17:42:01.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 725.355463ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
15372025-01-28T17:42:01.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b") failed: Property not found. retry in 1.405868937s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
15382025-01-28T17:42:01.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b") failed: Property not found. retry in 1.34908494s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
15392025-01-28T17:42:01.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 590.889885ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15402025-01-28T17:42:01.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93") failed: Property not found. retry in 1.118608321s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
15412025-01-28T17:42:01.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073") failed: Property not found. retry in 801.334995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
15422025-01-28T17:42:01.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614") failed: Property not found. retry in 1.439282806s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
15432025-01-28T17:42:01.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b") failed: Property not found. retry in 1.487195997s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
15442025-01-28T17:42:01.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd") failed: Property not found. retry in 1.135038626s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
15452025-01-28T17:42:01.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae") failed: Property not found. retry in 1.029681491s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
15462025-01-28T17:42:01.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d") failed: Property not found. retry in 1.05330907s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
15472025-01-28T17:42:01.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665") failed: Property not found. retry in 1.333134801s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
15482025-01-28T17:42:01.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53") failed: Property not found. retry in 738.253968ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
15492025-01-28T17:42:02.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3") failed: Property not found. retry in 848.18926ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
15502025-01-28T17:42:02.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 593.056981ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15512025-01-28T17:42:02.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40") failed: Property not found. retry in 1.309118898s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
15522025-01-28T17:42:02.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad") failed: Property not found. retry in 1.374467929s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
15532025-01-28T17:42:02.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc") failed: Property not found. retry in 1.092526144s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
15542025-01-28T17:42:02.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 633.95319ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15552025-01-28T17:42:03.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 541.959813ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15562025-01-28T17:42:03.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 1.195254036s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15572025-01-28T17:42:05.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 514.753366ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15582025-01-28T17:42:05.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 1.294305581s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15592025-01-28T17:42:06.425ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.767208705s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
15602025-01-28T17:42:07.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6") failed: Property not found. retry in 1.046553663s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15612025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_4ad358d0-bd51-49e0-b02e-9246fa3bca53
15622025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_cfc40aa8-35b1-4f5c-bf38-36c4b6497dc1
15632025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_a3df3b33-3624-4859-8edf-158e5ef0a073
15642025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_ea6cf83e-efc5-4bf1-8a68-77eb0d104665
15652025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_0fd43098-be15-4c8f-bb91-86d83102b8ae
15662025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd
15672025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_f493d09d-f078-4cb5-a2c0-eb63f288d9ad
15682025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_4c63fb2b-5c1c-4922-bb74-19a36d01376c
15692025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_e722b36f-9495-468d-b1d3-32d570bba44b
15702025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_78965ec8-9282-4d82-8658-6ba1f56434d3
15712025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_a3cdca35-19bc-4856-a3d7-072cc05bbb93
15722025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_d80025ac-5fb7-4ef1-a93e-292fc018b6d3
15732025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_bcae8c4d-613c-4240-a5a7-639225fc1614
15742025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_24537f26-e37f-4161-ac28-a1c33767471d
15752025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_8174f977-22ad-4b55-b974-5ecdb6f0605b
15762025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_fdf32984-9b0d-4cc9-b41a-a0d09f089fe6
15772025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_6a313ae0-11ba-46f5-9627-382979d2836b
15782025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_57b6be0d-6f3c-4ca6-bbac-86a2157bff40
15792025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_733cf09b-dc13-4827-8d0b-579ef784fbbc
15802025-01-28T17:42:08.090ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15812025-01-28T17:42:08.096ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15822025-01-28T17:42:08.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28473351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44124 req_id = 01c041a2-51fe-4f13-b4b0-8d29ad9da452 response_code = 204 uri = /omicron-zones
15832025-01-28T17:42:08.111ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1406
15842025-01-28T17:42:08.129ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
15852025-01-28T17:42:08.137ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
15862025-01-28T17:42:08.176ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1008
15872025-01-28T17:42:08.187ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15882025-01-28T17:42:08.301ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15892025-01-28T17:42:08.445ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15902025-01-28T17:42:08.617ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15912025-01-28T17:42:08.779ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15922025-01-28T17:42:09.035ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15932025-01-28T17:42:09.166ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15942025-01-28T17:42:09.599ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15952025-01-28T17:42:09.666ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51173
15962025-01-28T17:42:09.675ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8396 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51173 req_id = a1f27b67-f3e0-4930-ba6f-89627baa9b9f response_code = 200 uri = /baseboard
15972025-01-28T17:42:09.821ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15982025-01-28T17:42:10.227ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.382434319s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
15992025-01-28T17:42:10.276ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16002025-01-28T17:42:10.811ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4d940752-63b5-4800-ba82-1a55ad8c1b47/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16012025-01-28T17:42:12.613ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "311f9284-3abc-4f6a-8f3e-d67b780a1dd7", "content-length": "113", "date": "Tue, 28 Jan 2025 17:42:12 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "311f9284-3abc-4f6a-8f3e-d67b780a1dd7" } file = sled-agent/src/rack_setup/service.rs:1070
16022025-01-28T17:42:13.890ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "dde22103-657c-4d55-8731-48b57778cbbe", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"4d940752-63b5-4800-ba82-1a55ad8c1b47\"", request_id: "dde22103-657c-4d55-8731-48b57778cbbe" } file = sled-agent/src/rack_setup/service.rs:1070
16032025-01-28T17:42:14.693ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c5a4ed59-3d36-4a4c-934a-d89c96754535", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"4d940752-63b5-4800-ba82-1a55ad8c1b47\"", request_id: "c5a4ed59-3d36-4a4c-934a-d89c96754535" } file = sled-agent/src/rack_setup/service.rs:1070
16042025-01-28T17:42:17.068ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d39042c0-4259-4419-b1a4-069b961b0803", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "d39042c0-4259-4419-b1a4-069b961b0803" } file = sled-agent/src/rack_setup/service.rs:1070
16052025-01-28T17:42:18.883ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "75b81b73-bb8f-4435-82ad-3d7e3a67800a", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "75b81b73-bb8f-4435-82ad-3d7e3a67800a" } file = sled-agent/src/rack_setup/service.rs:1070
16062025-01-28T17:42:21.239ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "da9004d0-9d9c-4942-9ab1-12413b35e42b", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "da9004d0-9d9c-4942-9ab1-12413b35e42b" } file = sled-agent/src/rack_setup/service.rs:1070
16072025-01-28T17:42:23.728ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d30a1f72-bc73-47de-9f59-ec989a25f502", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "d30a1f72-bc73-47de-9f59-ec989a25f502" } file = sled-agent/src/rack_setup/service.rs:1070
16082025-01-28T17:42:27.073ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1e73e4f9-2f8c-4908-be08-1a34458f9cf7", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "1e73e4f9-2f8c-4908-be08-1a34458f9cf7" } file = sled-agent/src/rack_setup/service.rs:1070
16092025-01-28T17:42:29.266ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c30deb71-1258-417a-b873-321fe02c1ed6", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "c30deb71-1258-417a-b873-321fe02c1ed6" } file = sled-agent/src/rack_setup/service.rs:1070
16102025-01-28T17:42:33.930ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c289f6fe-6343-4e0e-b01e-5a94ca01fa58", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "c289f6fe-6343-4e0e-b01e-5a94ca01fa58" } file = sled-agent/src/rack_setup/service.rs:1070
16112025-01-28T17:42:36.428ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d96444ef-535f-4989-aa4c-e4aa45314e2c", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "d96444ef-535f-4989-aa4c-e4aa45314e2c" } file = sled-agent/src/rack_setup/service.rs:1070
16122025-01-28T17:42:39.715ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35432
16132025-01-28T17:42:39.716ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 25 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35432 req_id = 1692b10c-c649-4501-a932-758bcecddc2c response_code = 200 uri = /baseboard
16142025-01-28T17:42:42.775ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "26cca486-12c1-41f2-b09f-64ebbb9006b6", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "26cca486-12c1-41f2-b09f-64ebbb9006b6" } file = sled-agent/src/rack_setup/service.rs:1070
16152025-01-28T17:42:48.672ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "87d726af-9b83-47ed-8e16-beabc4106b10", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "87d726af-9b83-47ed-8e16-beabc4106b10" } file = sled-agent/src/rack_setup/service.rs:1070
16162025-01-28T17:42:53.791ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "93139cbb-dede-4951-a0ad-d8d66dad6416", "content-length": "173", "date": "Tue, 28 Jan 2025 17:42:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3f3bc5ca-5950-49d6-a443-b9f8f960dab0\"", request_id: "93139cbb-dede-4951-a0ad-d8d66dad6416" } file = sled-agent/src/rack_setup/service.rs:1070
16172025-01-28T17:42:56.614ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:39712 remote_addr = [fd00:1122:3344:101::d]:34912 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
16182025-01-28T17:42:56.635ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 20708 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 81912257-c193-44ec-bd60-da69613cd777 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
16192025-01-28T17:42:57.843ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
16202025-01-28T17:42:57.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40695
16212025-01-28T17:42:57.936ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16222025-01-28T17:42:57.936ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16232025-01-28T17:42:57.936ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:177
16242025-01-28T17:42:57.937ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:177
16252025-01-28T17:42:57.949ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16262025-01-28T17:42:57.949ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7
16272025-01-28T17:42:57.973ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16282025-01-28T17:42:57.973ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d033c793-1184-4faf-a379-2f30181b8b7f
16292025-01-28T17:42:57.994ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16302025-01-28T17:42:57.994ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_94f0d539-6272-43cf-85f5-da15e180f2ad
16312025-01-28T17:42:58.013ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16322025-01-28T17:42:58.014ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7
16332025-01-28T17:42:58.038ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16342025-01-28T17:42:58.038ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d69f461c-d55e-48a5-9816-173eae69537e
16352025-01-28T17:42:58.061ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16362025-01-28T17:42:58.061ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7d23e6c8-6805-4a21-bee4-ece464779811
16372025-01-28T17:42:58.082ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16382025-01-28T17:42:58.082ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_37b8192c-9236-4941-bad3-2ab9840de50c
16392025-01-28T17:42:58.101ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16402025-01-28T17:42:58.101ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_da44c06d-1c73-487e-9c46-5eba2365be55
16412025-01-28T17:42:58.122ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16422025-01-28T17:42:58.122ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04
16432025-01-28T17:42:58.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200992 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40695 req_id = ff0f92de-04aa-460b-be3c-9b3e6bbb3325 response_code = 200 uri = /inventory
16442025-01-28T17:43:02.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34394
16452025-01-28T17:43:02.075ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16462025-01-28T17:43:02.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16472025-01-28T17:43:02.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16482025-01-28T17:43:02.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16492025-01-28T17:43:02.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16502025-01-28T17:43:02.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16512025-01-28T17:43:02.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16522025-01-28T17:43:02.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2983 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34394 req_id = 1592cb0b-3a1b-427c-91a4-1a7c7f6d3da0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16532025-01-28T17:43:02.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42489
16542025-01-28T17:43:02.097ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16552025-01-28T17:43:02.097ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16562025-01-28T17:43:02.097ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16572025-01-28T17:43:02.097ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16582025-01-28T17:43:02.097ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16592025-01-28T17:43:02.097ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16602025-01-28T17:43:02.097ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16612025-01-28T17:43:02.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42489 req_id = b768cbe0-79eb-44d3-9144-ceab912fa518 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16622025-01-28T17:43:02.100ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1080
16632025-01-28T17:43:02.104ZINFOSledAgent (RSS): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16642025-01-28T17:43:02.105ZINFOSledAgent (RSS): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16652025-01-28T17:43:02.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65073
16662025-01-28T17:43:02.368ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16672025-01-28T17:43:02.368ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16682025-01-28T17:43:02.368ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:177
16692025-01-28T17:43:02.368ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:177
16702025-01-28T17:43:02.381ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16712025-01-28T17:43:02.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7
16722025-01-28T17:43:02.407ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16732025-01-28T17:43:02.407ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d033c793-1184-4faf-a379-2f30181b8b7f
16742025-01-28T17:43:02.429ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16752025-01-28T17:43:02.429ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_94f0d539-6272-43cf-85f5-da15e180f2ad
16762025-01-28T17:43:02.453ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16772025-01-28T17:43:02.453ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7
16782025-01-28T17:43:02.474ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16792025-01-28T17:43:02.474ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d69f461c-d55e-48a5-9816-173eae69537e
16802025-01-28T17:43:02.498ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16812025-01-28T17:43:02.498ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7d23e6c8-6805-4a21-bee4-ece464779811
16822025-01-28T17:43:02.519ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16832025-01-28T17:43:02.520ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_37b8192c-9236-4941-bad3-2ab9840de50c
16842025-01-28T17:43:02.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16852025-01-28T17:43:02.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_da44c06d-1c73-487e-9c46-5eba2365be55
16862025-01-28T17:43:02.565ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16872025-01-28T17:43:02.565ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04
16882025-01-28T17:43:02.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207654 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65073 req_id = a82b1c24-eb1a-458a-9cde-8b0c3cdaabd1 response_code = 200 uri = /inventory
16892025-01-28T17:43:03.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51787
16902025-01-28T17:43:03.690ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16912025-01-28T17:43:03.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16922025-01-28T17:43:03.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16932025-01-28T17:43:03.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16942025-01-28T17:43:03.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16952025-01-28T17:43:03.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16962025-01-28T17:43:03.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16972025-01-28T17:43:03.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51787 req_id = e07a5ce7-05c3-447d-98e2-83e8260486c1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16982025-01-28T17:43:03.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34980
16992025-01-28T17:43:03.719ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17002025-01-28T17:43:03.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17012025-01-28T17:43:03.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17022025-01-28T17:43:03.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17032025-01-28T17:43:03.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17042025-01-28T17:43:03.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17052025-01-28T17:43:03.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17062025-01-28T17:43:03.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34980 req_id = 732f3a35-27fa-428d-bb58-b1ade85f3037 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17072025-01-28T17:43:09.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56357
17082025-01-28T17:43:09.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 922 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56357 req_id = f935aa0c-7215-4719-b96e-2520e85311da response_code = 200 uri = /vpc-routes
17092025-01-28T17:43:09.261ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
17102025-01-28T17:43:09.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1985 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56357 req_id = 5b2198f0-1604-420b-a7b3-04704fea44a2 response_code = 204 uri = /eip-gateways
17112025-01-28T17:43:09.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1976 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56357 req_id = 2d5eae13-0f33-4560-a3a7-8bbf5b5fb974 response_code = 204 uri = /vpc-routes
17122025-01-28T17:43:09.749ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38544
17132025-01-28T17:43:09.749ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38544 req_id = 4e4e9d97-489e-4db5-b93a-0cb0eed1ba04 response_code = 200 uri = /baseboard
17142025-01-28T17:43:15.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64544
17152025-01-28T17:43:15.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64544 req_id = c934a7d5-06d9-41fc-a83a-457f5bf6d550 response_code = 200 uri = /vpc-routes
17162025-01-28T17:43:15.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51228
17172025-01-28T17:43:15.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51228 req_id = aae50e0e-c10e-4d87-a946-50bc0903c9f9 response_code = 200 uri = /vpc-routes
17182025-01-28T17:43:15.404ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
17192025-01-28T17:43:15.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51228 req_id = c1d66452-810d-49f9-a1b1-7da2bef18e7d response_code = 204 uri = /eip-gateways
17202025-01-28T17:43:15.412ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
17212025-01-28T17:43:15.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64544 req_id = 0b894296-a854-4777-a0c3-8ca4099f8a9e response_code = 204 uri = /eip-gateways
17222025-01-28T17:43:15.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51228 req_id = fd11596c-39fd-4372-8896-11401c49c6f5 response_code = 204 uri = /vpc-routes
17232025-01-28T17:43:15.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64544 req_id = a0568a54-d019-47db-b5e0-76a9a7e4cda9 response_code = 204 uri = /vpc-routes
17242025-01-28T17:43:15.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59568
17252025-01-28T17:43:15.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59568 req_id = 03376895-05be-4659-98cb-b6e5c294e429 response_code = 200 uri = /v2p
17262025-01-28T17:43:15.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43518
17272025-01-28T17:43:15.546ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17282025-01-28T17:43:15.630ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17292025-01-28T17:43:15.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149159 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43518 req_id = f32ab390-498d-4f48-8bd8-2eac5dbca9ae response_code = 204 uri = /switch-ports
17302025-01-28T17:43:15.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53791
17312025-01-28T17:43:15.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55491
17322025-01-28T17:43:15.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36145
17332025-01-28T17:43:15.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41104
17342025-01-28T17:43:15.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55491 req_id = 4d9e9876-29ac-438b-9bc0-6c011b33fb86 response_code = 200 uri = /vpc-routes
17352025-01-28T17:43:15.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53791 req_id = 3f315fc4-351e-4b1f-ad76-d8ca2fb0b68f response_code = 200 uri = /v2p
17362025-01-28T17:43:15.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41104 req_id = 7654e90f-123e-43e0-8f73-b42e90bbf792 response_code = 200 uri = /v2p
17372025-01-28T17:43:15.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17382025-01-28T17:43:15.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6018 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43518 req_id = d1eb8506-6f0f-4798-a2a3-c84d3d47e0b5 response_code = 200 uri = /network-bootstore-config
17392025-01-28T17:43:15.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17402025-01-28T17:43:15.751ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
17412025-01-28T17:43:15.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55491 req_id = 0e9f6f9a-6723-4e4d-a0a0-e23d662b1fff response_code = 204 uri = /eip-gateways
17422025-01-28T17:43:15.763ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17432025-01-28T17:43:15.763ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17442025-01-28T17:43:15.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55491 req_id = 7ccacbae-2537-4984-b845-13341111d4c8 response_code = 204 uri = /vpc-routes
17452025-01-28T17:43:15.764ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17462025-01-28T17:43:15.765ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17472025-01-28T17:43:15.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5724 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43518 req_id = 31388ec3-63a2-4ce5-9456-aa60bb9a37b4 response_code = 204 uri = /network-bootstore-config
17482025-01-28T17:43:15.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109981 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36145 req_id = 94e52aa1-3c17-436f-a56a-7a81c4a48459 response_code = 204 uri = /switch-ports
17492025-01-28T17:43:15.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 681 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36145 req_id = 3d450a58-2b32-4e6f-968c-b6eb76659f4b response_code = 200 uri = /network-bootstore-config
17502025-01-28T17:43:15.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39202
17512025-01-28T17:43:15.843ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17522025-01-28T17:43:15.879ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17532025-01-28T17:43:15.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83777 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39202 req_id = cd35648d-fc54-41ad-b698-22c74af9d834 response_code = 204 uri = /switch-ports
17542025-01-28T17:43:15.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39202 req_id = 570d0592-a643-40e7-b2d1-ef83eac11e14 response_code = 200 uri = /network-bootstore-config
17552025-01-28T17:43:26.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7325 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = d49ce5a1-a39b-498f-9ab5-4ad834f5f7ed response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
17562025-01-28T17:43:39.788ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39999
17572025-01-28T17:43:39.788ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39999 req_id = a121d5ed-6df9-48fc-aed0-f4491e71908f response_code = 200 uri = /baseboard
17582025-01-28T17:43:45.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50017
17592025-01-28T17:43:45.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50017 req_id = cd7be9ad-54cb-4c9b-9942-c86f53e46d98 response_code = 200 uri = /vpc-routes
17602025-01-28T17:43:45.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42042
17612025-01-28T17:43:45.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42042 req_id = aa7fda4b-6236-4376-9636-f46d03b96440 response_code = 200 uri = /vpc-routes
17622025-01-28T17:43:45.230ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
17632025-01-28T17:43:45.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50017 req_id = b9715fba-2b25-497e-b848-3ff5178fa80a response_code = 204 uri = /eip-gateways
17642025-01-28T17:43:45.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48775
17652025-01-28T17:43:45.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48775 req_id = 65ebc19c-9282-446b-8f8b-b3289d4dadc6 response_code = 200 uri = /v2p
17662025-01-28T17:43:45.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50017 req_id = 0f178676-5d85-4569-ae9c-34589f55f7d7 response_code = 204 uri = /vpc-routes
17672025-01-28T17:43:45.287ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
17682025-01-28T17:43:45.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42042 req_id = c001eb15-d7de-4803-ae26-9d39d228fe78 response_code = 204 uri = /eip-gateways
17692025-01-28T17:43:45.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42042 req_id = 7123cac7-eccf-486e-9175-3d58f297ed50 response_code = 204 uri = /vpc-routes
17702025-01-28T17:43:45.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61006
17712025-01-28T17:43:45.317ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17722025-01-28T17:43:45.358ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17732025-01-28T17:43:45.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61006 req_id = be8db8d0-c496-4f04-b7f1-58a1ccd975e3 response_code = 204 uri = /switch-ports
17742025-01-28T17:43:45.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51518
17752025-01-28T17:43:45.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61006 req_id = 64c9c134-b32a-4510-8bd2-75b94582bba7 response_code = 200 uri = /network-bootstore-config
17762025-01-28T17:43:45.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51518 req_id = 07a223d4-251f-4711-959f-5e74b9bf1c1e response_code = 200 uri = /v2p
17772025-01-28T17:43:45.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41689
17782025-01-28T17:43:45.434ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17792025-01-28T17:43:45.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17802025-01-28T17:43:45.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92830 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41689 req_id = d91e644e-e922-4e10-a908-b3626186f0ae response_code = 204 uri = /switch-ports
17812025-01-28T17:43:45.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48823
17822025-01-28T17:43:45.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48820
17832025-01-28T17:43:45.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48820 req_id = d915a332-3f29-4111-954e-9507ff8ab06d response_code = 200 uri = /vpc-routes
17842025-01-28T17:43:45.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41689 req_id = 4a0de693-28ad-4b91-b268-126c0e00e54e response_code = 200 uri = /network-bootstore-config
17852025-01-28T17:43:45.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48823 req_id = 014c028b-e776-450f-ad39-7f8e6362a941 response_code = 200 uri = /v2p
17862025-01-28T17:43:45.542ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
17872025-01-28T17:43:45.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48820 req_id = 88f77440-5565-4361-952d-60458f9c20e2 response_code = 204 uri = /eip-gateways
17882025-01-28T17:43:45.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48820 req_id = 8b496b6f-e1ee-4c20-84c5-61c76e719d32 response_code = 204 uri = /vpc-routes
17892025-01-28T17:43:45.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32898
17902025-01-28T17:43:45.642ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17912025-01-28T17:43:45.680ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17922025-01-28T17:43:45.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94507 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32898 req_id = bc6458ca-42a5-4805-8b77-3fd0ac821f3e response_code = 204 uri = /switch-ports
17932025-01-28T17:43:45.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32898 req_id = 6d382bf7-6a9e-45da-acb6-8c82684ec0df response_code = 200 uri = /network-bootstore-config
17942025-01-28T17:43:56.621ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7541 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 8fbbcf97-802e-4a0d-85d7-691fbfb26eff response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
17952025-01-28T17:44:09.823ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39779
17962025-01-28T17:44:09.823ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39779 req_id = 267a939b-9c44-47ef-bc33-9f9d32c61997 response_code = 200 uri = /baseboard
17972025-01-28T17:44:15.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36284
17982025-01-28T17:44:15.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36284 req_id = dea23da7-4522-4db2-806d-a31cbc4680fc response_code = 200 uri = /vpc-routes
17992025-01-28T17:44:15.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44512
18002025-01-28T17:44:15.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44512 req_id = cae7929b-5b4e-47ef-be4e-9a3c1e331eb4 response_code = 200 uri = /vpc-routes
18012025-01-28T17:44:15.347ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
18022025-01-28T17:44:15.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36284 req_id = 2ad7c639-f577-4e8a-9ae7-f25be308d6e2 response_code = 204 uri = /eip-gateways
18032025-01-28T17:44:15.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
18042025-01-28T17:44:15.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44512 req_id = 16ab00a8-1be9-4e1e-85ad-73ed57500c55 response_code = 204 uri = /eip-gateways
18052025-01-28T17:44:15.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36284 req_id = 1f1bd04c-4872-4ab5-9c39-3efefd9dc3d2 response_code = 204 uri = /vpc-routes
18062025-01-28T17:44:15.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44512 req_id = 5ab306db-59e9-43eb-8a79-cc2616950318 response_code = 204 uri = /vpc-routes
18072025-01-28T17:44:15.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34681
18082025-01-28T17:44:15.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34681 req_id = 49c7c272-0e08-479b-b897-44e5b6bdec12 response_code = 200 uri = /v2p
18092025-01-28T17:44:15.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51518
18102025-01-28T17:44:15.503ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18112025-01-28T17:44:15.539ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18122025-01-28T17:44:15.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88075 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51518 req_id = cbfaf4ef-726a-49e2-a8d9-627dec869a5d response_code = 204 uri = /switch-ports
18132025-01-28T17:44:15.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61611
18142025-01-28T17:44:15.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59458
18152025-01-28T17:44:15.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51518 req_id = b8168053-3e2a-441a-9f67-5857b710dcb7 response_code = 200 uri = /network-bootstore-config
18162025-01-28T17:44:15.591ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18172025-01-28T17:44:15.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61611 req_id = c2dfe5e5-d8ca-44b6-86b0-b9c52eea288c response_code = 200 uri = /v2p
18182025-01-28T17:44:15.629ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18192025-01-28T17:44:15.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91197 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59458 req_id = f8e32262-d5db-4740-ab78-7610a52e0127 response_code = 204 uri = /switch-ports
18202025-01-28T17:44:15.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59458 req_id = ef3b249c-dc8e-41c3-9f0d-3a7aaa6b7c7d response_code = 200 uri = /network-bootstore-config
18212025-01-28T17:44:15.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48160
18222025-01-28T17:44:15.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48160 req_id = 24ba7780-8ab2-494d-8112-f78d1c7fbdb9 response_code = 200 uri = /vpc-routes
18232025-01-28T17:44:15.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34044
18242025-01-28T17:44:15.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34044 req_id = f376212d-61d0-4351-befd-1e69ccc844f8 response_code = 200 uri = /v2p
18252025-01-28T17:44:15.817ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
18262025-01-28T17:44:15.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48160 req_id = a60748fc-3401-4e51-9843-667d3c522c2b response_code = 204 uri = /eip-gateways
18272025-01-28T17:44:15.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48160 req_id = 3cf229a4-2071-4745-ab2b-c48007c72423 response_code = 204 uri = /vpc-routes
18282025-01-28T17:44:16.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65224
18292025-01-28T17:44:16.044ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18302025-01-28T17:44:16.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18312025-01-28T17:44:16.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85465 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65224 req_id = 22eb9a1b-132e-48d3-869d-296dd96ee426 response_code = 204 uri = /switch-ports
18322025-01-28T17:44:16.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65224 req_id = e97a0bc2-72a3-4088-aa81-f845e27b2b13 response_code = 200 uri = /network-bootstore-config
18332025-01-28T17:44:26.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7193 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 3b26331a-5932-4b4f-81da-6dc13a7f90ae response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
18342025-01-28T17:44:39.858ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40268
18352025-01-28T17:44:39.859ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40268 req_id = 97fc0227-89a0-4785-b92b-aa3c4d8fb677 response_code = 200 uri = /baseboard
18362025-01-28T17:44:45.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44757
18372025-01-28T17:44:45.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44757 req_id = b2096354-26c9-4e5c-aa11-adc44ec41300 response_code = 200 uri = /vpc-routes
18382025-01-28T17:44:45.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46571
18392025-01-28T17:44:45.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46571 req_id = 042e9862-8586-4267-9626-5a5e191ffc67 response_code = 200 uri = /vpc-routes
18402025-01-28T17:44:45.188ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
18412025-01-28T17:44:45.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44757 req_id = 5aeeb95c-f526-42ab-92bd-63fb9cd382a3 response_code = 204 uri = /eip-gateways
18422025-01-28T17:44:45.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44757 req_id = 7bb727dc-b5e9-4e8f-bbcb-1e4020cfc5bf response_code = 204 uri = /vpc-routes
18432025-01-28T17:44:45.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
18442025-01-28T17:44:45.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46571 req_id = 9cc9c4cb-33f7-43fa-b87b-345581a4ce6b response_code = 204 uri = /eip-gateways
18452025-01-28T17:44:45.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46571 req_id = 94edb29a-c421-47df-98b6-78535145c74e response_code = 204 uri = /vpc-routes
18462025-01-28T17:44:45.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55537
18472025-01-28T17:44:45.334ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18482025-01-28T17:44:45.376ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18492025-01-28T17:44:45.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101159 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55537 req_id = 75434ff6-ac26-4d5d-be8b-8f61a10cc074 response_code = 204 uri = /switch-ports
18502025-01-28T17:44:45.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51816
18512025-01-28T17:44:45.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50057
18522025-01-28T17:44:45.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60189
18532025-01-28T17:44:45.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57699
18542025-01-28T17:44:45.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55537 req_id = 30b9ed00-991e-42a4-91c3-3d5376da92ca response_code = 200 uri = /network-bootstore-config
18552025-01-28T17:44:45.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50057 req_id = 722bac65-76cb-4b21-a554-1a837d20e156 response_code = 200 uri = /vpc-routes
18562025-01-28T17:44:45.436ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18572025-01-28T17:44:45.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57699 req_id = 5a35405d-c9a1-4384-8b1c-1f297c82e0c1 response_code = 200 uri = /v2p
18582025-01-28T17:44:45.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3616 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60189 req_id = aa420697-1323-4569-a02d-7b9d624f8648 response_code = 200 uri = /v2p
18592025-01-28T17:44:45.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35233
18602025-01-28T17:44:45.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35233 req_id = ae02830b-0ccd-4b42-ae45-65ab01556404 response_code = 200 uri = /v2p
18612025-01-28T17:44:45.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60888
18622025-01-28T17:44:45.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18632025-01-28T17:44:45.483ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
18642025-01-28T17:44:45.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50057 req_id = 8bb94622-db4d-4d1c-ac2c-4b0c8c3041e6 response_code = 204 uri = /eip-gateways
18652025-01-28T17:44:45.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 979 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50057 req_id = ae9463a8-37cc-4d03-89c5-6e16fd3ea5f8 response_code = 204 uri = /vpc-routes
18662025-01-28T17:44:45.535ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18672025-01-28T17:44:45.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99176 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51816 req_id = ebaa6c8d-94e0-444d-9afa-a6df1704de22 response_code = 204 uri = /switch-ports
18682025-01-28T17:44:45.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 753 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51816 req_id = da6614e6-1fb8-4550-b716-5919852ed4af response_code = 200 uri = /network-bootstore-config
18692025-01-28T17:44:45.569ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18702025-01-28T17:44:45.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60888 req_id = cd59f2b7-0e82-4f61-b9dc-0248c6eabae1 response_code = 204 uri = /switch-ports
18712025-01-28T17:44:45.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60888 req_id = cf39a6ec-2b78-449a-8f5c-664c67a384c3 response_code = 200 uri = /network-bootstore-config
18722025-01-28T17:44:56.621ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8280 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 84a2b851-d183-4a17-bd44-154414f7e03c response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
18732025-01-28T17:45:09.891ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37286
18742025-01-28T17:45:09.891ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37286 req_id = 22ea343e-75c6-4822-9c88-17b153c34b72 response_code = 200 uri = /baseboard
18752025-01-28T17:45:15.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33201
18762025-01-28T17:45:15.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33201 req_id = 19a8962f-0bfb-406c-9c2e-99f9f5e17720 response_code = 200 uri = /vpc-routes
18772025-01-28T17:45:15.352ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
18782025-01-28T17:45:15.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33201 req_id = 96f136b7-1e37-4f83-a6eb-796ff1fdd289 response_code = 204 uri = /eip-gateways
18792025-01-28T17:45:15.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33201 req_id = e8c6c8d0-e150-46d5-a525-2b64f89e1719 response_code = 204 uri = /vpc-routes
18802025-01-28T17:45:15.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42144
18812025-01-28T17:45:15.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42144 req_id = cc4189e1-44c1-4566-a4d6-3d80af108405 response_code = 200 uri = /vpc-routes
18822025-01-28T17:45:15.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52200
18832025-01-28T17:45:15.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52200 req_id = c6315dbd-cb64-4cda-98b7-44e99c614b28 response_code = 200 uri = /v2p
18842025-01-28T17:45:15.421ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
18852025-01-28T17:45:15.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42144 req_id = 6e95e5c3-15c6-44f9-94a3-5c4252e5cb55 response_code = 204 uri = /eip-gateways
18862025-01-28T17:45:15.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42144 req_id = 0146d581-720f-44f9-87fc-c11e6c37668b response_code = 204 uri = /vpc-routes
18872025-01-28T17:45:15.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42884
18882025-01-28T17:45:15.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42884 req_id = 1da4664e-a761-4740-8adb-07c334b52154 response_code = 200 uri = /v2p
18892025-01-28T17:45:15.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57592
18902025-01-28T17:45:15.457ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18912025-01-28T17:45:15.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18922025-01-28T17:45:15.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97460 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57592 req_id = f7bfd777-95c1-4f82-8070-52e29d52c671 response_code = 204 uri = /switch-ports
18932025-01-28T17:45:15.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57592 req_id = b345a391-9ebc-4ba0-82f7-f5de3175274b response_code = 200 uri = /network-bootstore-config
18942025-01-28T17:45:15.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43963
18952025-01-28T17:45:15.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43963 req_id = 0f11d841-c352-4f60-99cc-4828d44e331b response_code = 200 uri = /vpc-routes
18962025-01-28T17:45:15.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
18972025-01-28T17:45:15.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43963 req_id = 167b66c7-feb5-4402-a8cc-2c70e2926571 response_code = 204 uri = /eip-gateways
18982025-01-28T17:45:15.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43963 req_id = 4666e63a-5f1a-45f2-be20-863ebf905427 response_code = 204 uri = /vpc-routes
18992025-01-28T17:45:15.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48358
19002025-01-28T17:45:15.668ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19012025-01-28T17:45:15.707ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19022025-01-28T17:45:15.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48358 req_id = 8998fc5f-a483-4672-9f55-654829229ad3 response_code = 204 uri = /switch-ports
19032025-01-28T17:45:15.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65469
19042025-01-28T17:45:15.765ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19052025-01-28T17:45:15.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48358 req_id = 7d0d0e8f-3001-4adc-8dae-35a0f04f3456 response_code = 200 uri = /network-bootstore-config
19062025-01-28T17:45:15.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43977
19072025-01-28T17:45:15.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43977 req_id = ddb7a4fe-7dfb-481a-ae7c-52f751bc40e4 response_code = 200 uri = /v2p
19082025-01-28T17:45:15.800ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19092025-01-28T17:45:15.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94422 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65469 req_id = 3b717f88-28a4-4b16-9bc4-c4515b3fcf75 response_code = 204 uri = /switch-ports
19102025-01-28T17:45:15.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65469 req_id = 3cca206f-7f7f-4814-b740-6694e197c5ec response_code = 200 uri = /network-bootstore-config
19112025-01-28T17:45:26.621ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7714 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 7d9e0e38-3ec4-4674-a9d5-d7333dd144bd response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
19122025-01-28T17:45:27.426ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19132025-01-28T17:45:39.926ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36587
19142025-01-28T17:45:39.926ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36587 req_id = 90323245-5710-4879-a0e3-67a349e9e280 response_code = 200 uri = /baseboard
19152025-01-28T17:45:45.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60313
19162025-01-28T17:45:45.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60313 req_id = 4b6d3ea3-6f64-4fa1-b84c-e5afda59ca22 response_code = 200 uri = /vpc-routes
19172025-01-28T17:45:45.147ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
19182025-01-28T17:45:45.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60313 req_id = 7f31e9ef-fccd-4e10-bccf-68558b838b03 response_code = 204 uri = /eip-gateways
19192025-01-28T17:45:45.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60313 req_id = cf0bdd8b-0f07-433f-ab73-a05aefd3f689 response_code = 204 uri = /vpc-routes
19202025-01-28T17:45:45.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45677
19212025-01-28T17:45:45.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45677 req_id = 6466a0a0-0f0f-447a-b4eb-7d01c3f3715f response_code = 200 uri = /vpc-routes
19222025-01-28T17:45:45.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47672
19232025-01-28T17:45:45.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47672 req_id = 71e898d2-4a9c-42a6-8798-55e04c7e88a8 response_code = 200 uri = /v2p
19242025-01-28T17:45:45.232ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
19252025-01-28T17:45:45.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45677 req_id = f48f880e-b5e9-4066-b14d-9f39f31799af response_code = 204 uri = /eip-gateways
19262025-01-28T17:45:45.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40121
19272025-01-28T17:45:45.265ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19282025-01-28T17:45:45.323ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19292025-01-28T17:45:45.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40121 req_id = 6d1a746f-779c-49b4-afbf-bdb057233085 response_code = 204 uri = /switch-ports
19302025-01-28T17:45:45.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60460
19312025-01-28T17:45:45.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61415
19322025-01-28T17:45:45.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33322
19332025-01-28T17:45:45.387ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19342025-01-28T17:45:45.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60460 req_id = 92220fad-cfc0-41df-ba9b-a1772cdc71af response_code = 200 uri = /vpc-routes
19352025-01-28T17:45:45.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40121 req_id = a7894169-02d9-4441-a3da-adf20d9b0ac0 response_code = 200 uri = /network-bootstore-config
19362025-01-28T17:45:45.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45677 req_id = d84a0e30-6414-4f6e-96ca-976ab4f183cb response_code = 204 uri = /vpc-routes
19372025-01-28T17:45:45.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61415 req_id = f3bb5abb-aa86-48c2-a7d5-86cd58e3cede response_code = 200 uri = /v2p
19382025-01-28T17:45:45.424ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19392025-01-28T17:45:45.429ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
19402025-01-28T17:45:45.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60460 req_id = a9e9194d-b424-4d2a-87cf-a5901ff37a51 response_code = 204 uri = /eip-gateways
19412025-01-28T17:45:45.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46558
19422025-01-28T17:45:45.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46558 req_id = 58a22410-45a8-4bb7-abe9-dabd6572f57f response_code = 200 uri = /v2p
19432025-01-28T17:45:45.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 863 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60460 req_id = 8f97eb56-9216-463f-99ee-886f5e66f832 response_code = 204 uri = /vpc-routes
19442025-01-28T17:45:45.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63453
19452025-01-28T17:45:45.480ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19462025-01-28T17:45:45.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33322 req_id = 518ee26c-25dd-4a9f-b48f-6dc76c7b6f10 response_code = 204 uri = /switch-ports
19472025-01-28T17:45:45.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 752 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33322 req_id = a56c5dae-9ce4-4b3c-ac14-47bd402b74bf response_code = 200 uri = /network-bootstore-config
19482025-01-28T17:45:45.517ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19492025-01-28T17:45:45.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63453 req_id = b5d383f4-e593-494e-bbb8-413bc656fd4b response_code = 204 uri = /switch-ports
19502025-01-28T17:45:45.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63453 req_id = 4b9d5254-8165-4a2d-8971-1ae9920b8061 response_code = 200 uri = /network-bootstore-config
19512025-01-28T17:45:56.621ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7467 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = ade54ef2-dad2-4c6e-b3f9-b465cc0ad326 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
19522025-01-28T17:46:09.960ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55372
19532025-01-28T17:46:09.960ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55372 req_id = 09ae90be-fce8-4fe5-9858-efe22d44c248 response_code = 200 uri = /baseboard
19542025-01-28T17:46:15.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41200
19552025-01-28T17:46:15.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41200 req_id = 90971261-cac6-4695-8d18-a1a2fef7e3dc response_code = 200 uri = /vpc-routes
19562025-01-28T17:46:15.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53244
19572025-01-28T17:46:15.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53244 req_id = c0ba7170-a404-404f-898c-2d0111d4a860 response_code = 200 uri = /vpc-routes
19582025-01-28T17:46:15.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63033
19592025-01-28T17:46:15.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63033 req_id = e4d95e1c-045f-4513-88de-cb9e45cd370b response_code = 200 uri = /v2p
19602025-01-28T17:46:15.390ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
19612025-01-28T17:46:15.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41200 req_id = 6bd86cad-1880-4d4b-80b8-1eccc242fd3f response_code = 204 uri = /eip-gateways
19622025-01-28T17:46:15.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41200 req_id = f10732cd-138f-4b2e-96f4-af340a5d1f70 response_code = 204 uri = /vpc-routes
19632025-01-28T17:46:15.433ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
19642025-01-28T17:46:15.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53244 req_id = 52210a50-9c89-4885-98de-1f85cc81d80b response_code = 204 uri = /eip-gateways
19652025-01-28T17:46:15.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42228
19662025-01-28T17:46:15.444ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19672025-01-28T17:46:15.488ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19682025-01-28T17:46:15.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42228 req_id = 3fe1402f-a7f0-44c1-8502-d89337a96493 response_code = 204 uri = /switch-ports
19692025-01-28T17:46:15.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36808
19702025-01-28T17:46:15.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60951
19712025-01-28T17:46:15.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35823
19722025-01-28T17:46:15.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35823 req_id = 6820f39b-67d1-4abf-a48a-a103b920af89 response_code = 200 uri = /vpc-routes
19732025-01-28T17:46:15.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 397 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42228 req_id = e885bd79-a743-4bfa-9bc6-8ab9400a9e8b response_code = 200 uri = /network-bootstore-config
19742025-01-28T17:46:15.563ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19752025-01-28T17:46:15.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 623 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53244 req_id = f892364e-1f46-4847-bae3-924ff7442e0a response_code = 204 uri = /vpc-routes
19762025-01-28T17:46:15.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36808 req_id = 72191896-d65b-48cb-a4f6-2b3f58436162 response_code = 200 uri = /v2p
19772025-01-28T17:46:15.604ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19782025-01-28T17:46:15.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
19792025-01-28T17:46:15.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 533 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35823 req_id = fe006241-aca2-4822-8c72-1cc1a310a7ae response_code = 204 uri = /eip-gateways
19802025-01-28T17:46:15.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1010 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35823 req_id = 67a449c3-a2e7-4ec9-9bdc-8b9c667b624a response_code = 204 uri = /vpc-routes
19812025-01-28T17:46:15.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41046
19822025-01-28T17:46:15.667ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19832025-01-28T17:46:15.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104298 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60951 req_id = 2c35fe79-2027-47e3-bc09-0d81460ebd99 response_code = 204 uri = /switch-ports
19842025-01-28T17:46:15.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60951 req_id = 63079eb2-6b13-41e7-95ca-008edaf21912 response_code = 200 uri = /network-bootstore-config
19852025-01-28T17:46:15.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62218
19862025-01-28T17:46:15.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62218 req_id = f6e7d28e-ded4-48fb-b4b1-d776477e4742 response_code = 200 uri = /v2p
19872025-01-28T17:46:15.703ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19882025-01-28T17:46:15.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41046 req_id = eb3da968-870d-430d-af1a-dd1f90da90e6 response_code = 204 uri = /switch-ports
19892025-01-28T17:46:15.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41046 req_id = c8269593-df6c-4533-b033-c5bc9295dcc5 response_code = 200 uri = /network-bootstore-config
19902025-01-28T17:46:26.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7176 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = c82d9f8e-b027-4226-af88-ff359fdc4bb5 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
19912025-01-28T17:46:39.994ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41584
19922025-01-28T17:46:39.994ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41584 req_id = d7da4402-9d4c-44bc-9f19-e2bbfb301402 response_code = 200 uri = /baseboard
19932025-01-28T17:46:45.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45828
19942025-01-28T17:46:45.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45828 req_id = 8bb5bfd0-463d-4446-b64e-a2afc338c3a0 response_code = 200 uri = /vpc-routes
19952025-01-28T17:46:45.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64957
19962025-01-28T17:46:45.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64957 req_id = e85c24ea-b860-48aa-a4eb-17531e1647d4 response_code = 200 uri = /vpc-routes
19972025-01-28T17:46:45.234ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
19982025-01-28T17:46:45.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45828 req_id = eb1f167e-c3c6-4288-961a-d3c20f47be1e response_code = 204 uri = /eip-gateways
19992025-01-28T17:46:45.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45828 req_id = da8680ba-10cb-4368-a3a1-2737cf3a7701 response_code = 204 uri = /vpc-routes
20002025-01-28T17:46:45.290ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
20012025-01-28T17:46:45.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64957 req_id = 197a9fd6-d671-4336-bbba-782993a123a8 response_code = 204 uri = /eip-gateways
20022025-01-28T17:46:45.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64957 req_id = 7be5258a-974f-4b39-b23c-029c1777db63 response_code = 204 uri = /vpc-routes
20032025-01-28T17:46:45.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61301
20042025-01-28T17:46:45.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61301 req_id = 9645fb5c-6e02-40d2-828f-76a9b89ad098 response_code = 200 uri = /v2p
20052025-01-28T17:46:45.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46398
20062025-01-28T17:46:45.337ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20072025-01-28T17:46:45.382ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20082025-01-28T17:46:45.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46398 req_id = 8c8c7217-008d-469b-819a-b1091852e421 response_code = 204 uri = /switch-ports
20092025-01-28T17:46:45.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37098
20102025-01-28T17:46:45.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64113
20112025-01-28T17:46:45.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64855
20122025-01-28T17:46:45.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64855 req_id = ad5b4b67-dd8c-429c-b154-2bb4012ccc61 response_code = 200 uri = /vpc-routes
20132025-01-28T17:46:45.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46398 req_id = d81d89a0-dd06-47cf-b0e4-5ba682c62d1b response_code = 200 uri = /network-bootstore-config
20142025-01-28T17:46:45.441ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20152025-01-28T17:46:45.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64113 req_id = e45aa288-74ce-4a1b-bf3c-3032673eae7c response_code = 200 uri = /v2p
20162025-01-28T17:46:45.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44019
20172025-01-28T17:46:45.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48716
20182025-01-28T17:46:45.483ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20192025-01-28T17:46:45.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48716 req_id = bc1bc1bc-953a-4a65-b750-d6bf4f587eb1 response_code = 200 uri = /v2p
20202025-01-28T17:46:45.487ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
20212025-01-28T17:46:45.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64855 req_id = d38b2122-8b0e-489f-978d-ca15f7e5b4b6 response_code = 204 uri = /eip-gateways
20222025-01-28T17:46:45.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1084 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64855 req_id = 96fb808b-5bfe-4c7a-a7f6-c44ffe93c976 response_code = 204 uri = /vpc-routes
20232025-01-28T17:46:45.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104052 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37098 req_id = d22ef097-3942-4423-9065-2482206214a3 response_code = 204 uri = /switch-ports
20242025-01-28T17:46:45.545ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20252025-01-28T17:46:45.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37098 req_id = fb61cab4-7769-49b0-af66-6e923a9311a3 response_code = 200 uri = /network-bootstore-config
20262025-01-28T17:46:45.580ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20272025-01-28T17:46:45.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180866 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44019 req_id = 57acf204-6104-4f0f-b56f-220c90cde295 response_code = 204 uri = /switch-ports
20282025-01-28T17:46:45.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44019 req_id = 7f65a242-2166-440a-a479-6364113a4006 response_code = 200 uri = /network-bootstore-config
20292025-01-28T17:46:56.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7087 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 2b591006-a19c-4cf0-92a2-9c4c43bed498 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
20302025-01-28T17:47:10.027ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61600
20312025-01-28T17:47:10.027ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61600 req_id = 778387b5-4dbd-42af-8675-71b4c30edbf2 response_code = 200 uri = /baseboard
20322025-01-28T17:47:15.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48855
20332025-01-28T17:47:15.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48855 req_id = 6d7ed606-5d0c-40fd-a763-02b3d2bd9833 response_code = 200 uri = /vpc-routes
20342025-01-28T17:47:15.303ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
20352025-01-28T17:47:15.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48855 req_id = 8ba57d5b-899c-4e62-8fd4-747b745f37e2 response_code = 204 uri = /eip-gateways
20362025-01-28T17:47:15.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65000
20372025-01-28T17:47:15.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65000 req_id = 4614217a-31df-467d-9efa-dd0fae96592f response_code = 200 uri = /vpc-routes
20382025-01-28T17:47:15.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57246
20392025-01-28T17:47:15.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57246 req_id = 92a575c8-6fcf-4ed2-b9fd-56e71ca5df29 response_code = 200 uri = /v2p
20402025-01-28T17:47:15.385ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
20412025-01-28T17:47:15.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65000 req_id = 64db03ca-a058-4725-a701-10ac59516e00 response_code = 204 uri = /eip-gateways
20422025-01-28T17:47:15.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48855 req_id = d7cc515d-c44f-4d22-b4d3-36416d87d11d response_code = 204 uri = /vpc-routes
20432025-01-28T17:47:15.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46448
20442025-01-28T17:47:15.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46448 req_id = 99e7dd7e-2352-4fd6-904e-25a8b4675cab response_code = 200 uri = /v2p
20452025-01-28T17:47:15.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33951
20462025-01-28T17:47:15.466ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20472025-01-28T17:47:15.512ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20482025-01-28T17:47:15.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33951 req_id = 1587a3b8-0edf-415f-8e98-990d4ca8c658 response_code = 204 uri = /switch-ports
20492025-01-28T17:47:15.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38702
20502025-01-28T17:47:15.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53130
20512025-01-28T17:47:15.587ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20522025-01-28T17:47:15.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33951 req_id = b4540091-0858-4f7d-8b7c-f8e6d2d87a3e response_code = 200 uri = /network-bootstore-config
20532025-01-28T17:47:15.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53130 req_id = 2efd03ef-933e-461e-97e9-61c72c66ae19 response_code = 200 uri = /vpc-routes
20542025-01-28T17:47:15.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7033 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65000 req_id = 702724d8-0be3-4d5c-8d2d-0dac00076028 response_code = 204 uri = /vpc-routes
20552025-01-28T17:47:15.637ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20562025-01-28T17:47:15.652ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
20572025-01-28T17:47:15.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53130 req_id = c4dc6edb-25f4-459f-b342-68b2246996f3 response_code = 204 uri = /eip-gateways
20582025-01-28T17:47:15.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53130 req_id = e721270e-713d-4f2a-846a-2bf8174a5e40 response_code = 204 uri = /vpc-routes
20592025-01-28T17:47:15.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44355
20602025-01-28T17:47:15.685ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20612025-01-28T17:47:15.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20622025-01-28T17:47:15.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20632025-01-28T17:47:15.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20642025-01-28T17:47:15.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20652025-01-28T17:47:15.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20662025-01-28T17:47:15.685ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20672025-01-28T17:47:15.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44355 req_id = aace142a-b69b-4891-b70b-7a70634aa5ec response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20682025-01-28T17:47:15.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43562
20692025-01-28T17:47:15.703ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20702025-01-28T17:47:15.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20712025-01-28T17:47:15.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20722025-01-28T17:47:15.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20732025-01-28T17:47:15.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20742025-01-28T17:47:15.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20752025-01-28T17:47:15.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20762025-01-28T17:47:15.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43562 req_id = 4b5be8ba-d4d9-4c42-932e-b97c0344e5f0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20772025-01-28T17:47:15.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118630 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38702 req_id = 0c8914cb-0569-480b-9faa-1f38f5cb4bb0 response_code = 204 uri = /switch-ports
20782025-01-28T17:47:15.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38702 req_id = fa33a1c8-b45b-4fea-802a-facc0f1514ad response_code = 200 uri = /network-bootstore-config
20792025-01-28T17:47:15.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60982
20802025-01-28T17:47:15.724ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20812025-01-28T17:47:15.765ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20822025-01-28T17:47:15.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60982 req_id = 8870df17-3482-441e-9a45-0a5a7426e956 response_code = 204 uri = /switch-ports
20832025-01-28T17:47:15.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33876
20842025-01-28T17:47:15.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33876 req_id = 656dc45e-4805-42cc-bfec-fb5786099fd0 response_code = 200 uri = /v2p
20852025-01-28T17:47:15.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60982 req_id = d0f0be04-905b-48c1-8946-d13b7bbbbd05 response_code = 200 uri = /network-bootstore-config
20862025-01-28T17:47:15.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65394
20872025-01-28T17:47:15.947ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20882025-01-28T17:47:15.947ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20892025-01-28T17:47:15.947ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20902025-01-28T17:47:15.947ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20912025-01-28T17:47:15.947ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20922025-01-28T17:47:15.947ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20932025-01-28T17:47:15.947ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20942025-01-28T17:47:15.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65394 req_id = c289690e-b871-4556-91ba-4f3289367db9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20952025-01-28T17:47:26.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7053 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 7fff2d4d-156f-4ada-b9b8-8bbfaa361c72 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
20962025-01-28T17:47:40.061ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41747
20972025-01-28T17:47:40.061ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41747 req_id = 15524424-174a-445f-9783-9f2ab21ef3b0 response_code = 200 uri = /baseboard
20982025-01-28T17:47:45.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60851
20992025-01-28T17:47:45.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60851 req_id = 4ebc06dd-cbce-48ab-9d6d-d7b836ff25a4 response_code = 200 uri = /vpc-routes
21002025-01-28T17:47:45.211ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
21012025-01-28T17:47:45.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60851 req_id = 0de5fd97-5110-42d9-b32c-a2f0b002865a response_code = 204 uri = /eip-gateways
21022025-01-28T17:47:45.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60851 req_id = b4f52786-97f7-4d81-b2a4-3eaa7770f35a response_code = 204 uri = /vpc-routes
21032025-01-28T17:47:45.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62896
21042025-01-28T17:47:45.279ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21052025-01-28T17:47:45.320ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21062025-01-28T17:47:45.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108111 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62896 req_id = 5a90864a-b026-467e-a924-7e624fe880e1 response_code = 204 uri = /switch-ports
21072025-01-28T17:47:45.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64197
21082025-01-28T17:47:45.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37347
21092025-01-28T17:47:45.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62896 req_id = 8756d596-2c43-4dc6-a0fb-c69100b9e3f2 response_code = 200 uri = /network-bootstore-config
21102025-01-28T17:47:45.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59924
21112025-01-28T17:47:45.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48069
21122025-01-28T17:47:45.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37347 req_id = 55b3c199-45db-4e6c-95f0-3b4e5d869078 response_code = 200 uri = /v2p
21132025-01-28T17:47:45.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59924 req_id = 3462ea6a-0b13-4651-b4fc-57dad1d9f78d response_code = 200 uri = /v2p
21142025-01-28T17:47:45.388ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21152025-01-28T17:47:45.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64197 req_id = 32073ea2-cdb0-4904-8f10-8818485c1ae2 response_code = 200 uri = /vpc-routes
21162025-01-28T17:47:45.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48294
21172025-01-28T17:47:45.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48294 req_id = 1ad5de76-7d55-4503-99a4-c4a5e4b73c5d response_code = 200 uri = /vpc-routes
21182025-01-28T17:47:45.428ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21192025-01-28T17:47:45.432ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
21202025-01-28T17:47:45.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 672 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64197 req_id = 2d1a969a-197b-4e19-88b2-24713aa45ee6 response_code = 204 uri = /eip-gateways
21212025-01-28T17:47:45.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 950 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64197 req_id = ef1a00ee-f01c-408a-801d-337e60d5d8c7 response_code = 204 uri = /vpc-routes
21222025-01-28T17:47:45.456ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
21232025-01-28T17:47:45.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48294 req_id = f870277c-c7c7-45e9-9537-1cbabae5f1d7 response_code = 204 uri = /eip-gateways
21242025-01-28T17:47:45.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48069 req_id = 64e2e8af-5f32-4502-9376-f84e58917f63 response_code = 204 uri = /switch-ports
21252025-01-28T17:47:45.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48069 req_id = e4528c24-880b-44a4-afbf-54d679dac3d3 response_code = 200 uri = /network-bootstore-config
21262025-01-28T17:47:45.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34548
21272025-01-28T17:47:45.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34548 req_id = 84d64a97-a16c-40fd-bded-f3430d4f334b response_code = 200 uri = /v2p
21282025-01-28T17:47:45.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48294 req_id = 4bd61de9-067a-4f50-920a-0479cae2d564 response_code = 204 uri = /vpc-routes
21292025-01-28T17:47:45.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55347
21302025-01-28T17:47:45.531ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21312025-01-28T17:47:45.567ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21322025-01-28T17:47:45.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55347 req_id = 58a5e567-b330-485a-88e6-41f8a4e59a87 response_code = 204 uri = /switch-ports
21332025-01-28T17:47:45.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55347 req_id = ed5e132e-d9f7-405c-8c4d-f7f320574ca5 response_code = 200 uri = /network-bootstore-config
21342025-01-28T17:47:56.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7001 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = a806e207-e27a-4a34-8696-43cfd54a78ac response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
21352025-01-28T17:48:10.094ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59235
21362025-01-28T17:48:10.094ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59235 req_id = ac471bc1-dec8-48b3-9934-2825500e497f response_code = 200 uri = /baseboard
21372025-01-28T17:48:15.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58748
21382025-01-28T17:48:15.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58748 req_id = c22e6779-0a4a-471f-884a-933604f97e0f response_code = 200 uri = /vpc-routes
21392025-01-28T17:48:15.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41208
21402025-01-28T17:48:15.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41208 req_id = 4d3bc360-6c40-4a19-ad76-87891f335f4e response_code = 200 uri = /vpc-routes
21412025-01-28T17:48:15.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
21422025-01-28T17:48:15.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58748 req_id = 612b6f96-b02a-4942-9aaf-c8867692c64b response_code = 204 uri = /eip-gateways
21432025-01-28T17:48:15.360ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
21442025-01-28T17:48:15.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41208 req_id = 688187df-d7dc-4dde-b98b-327caa3aae84 response_code = 204 uri = /eip-gateways
21452025-01-28T17:48:15.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 452 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41208 req_id = ad7e3f3c-4cc5-449d-866b-0d0e4b88b221 response_code = 204 uri = /vpc-routes
21462025-01-28T17:48:15.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 530 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58748 req_id = 12ccfc9d-16de-453e-a5ff-d1b9ce33bcb7 response_code = 204 uri = /vpc-routes
21472025-01-28T17:48:15.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59160
21482025-01-28T17:48:15.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59160 req_id = c0f64c6a-5233-4fa4-9fe9-e0c15fdf5e3f response_code = 200 uri = /vpc-routes
21492025-01-28T17:48:15.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63306
21502025-01-28T17:48:15.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63306 req_id = d369c86e-8179-42f1-984e-9c7f66a7ac5c response_code = 200 uri = /v2p
21512025-01-28T17:48:15.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45244
21522025-01-28T17:48:15.454ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21532025-01-28T17:48:15.501ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21542025-01-28T17:48:15.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107652 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45244 req_id = ad9c2d08-82e8-4429-90c6-c37c9d39b7fe response_code = 204 uri = /switch-ports
21552025-01-28T17:48:15.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65458
21562025-01-28T17:48:15.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60763
21572025-01-28T17:48:15.562ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
21582025-01-28T17:48:15.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59160 req_id = b9af3f19-4160-43fe-a9a5-5c429ea71eba response_code = 204 uri = /eip-gateways
21592025-01-28T17:48:15.562ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21602025-01-28T17:48:15.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3801 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45244 req_id = 89b99705-83e7-4ca8-9fd4-a524a2859b5b response_code = 200 uri = /network-bootstore-config
21612025-01-28T17:48:15.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3691 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65458 req_id = 0997661b-9331-4e29-82e6-51ff68e6d42a response_code = 200 uri = /v2p
21622025-01-28T17:48:15.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35603
21632025-01-28T17:48:15.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35603 req_id = 4d855ca3-43e8-4d50-bd90-50aa083f3367 response_code = 200 uri = /v2p
21642025-01-28T17:48:15.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59160 req_id = be4f2a8a-9aca-4ebc-9dc8-7a555a3290ed response_code = 204 uri = /vpc-routes
21652025-01-28T17:48:15.597ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21662025-01-28T17:48:15.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60763 req_id = 0e4304ca-b536-41a5-a47f-1576576d1985 response_code = 204 uri = /switch-ports
21672025-01-28T17:48:15.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60763 req_id = 753cc0f0-16e9-4692-89a6-19b45bee6cd6 response_code = 200 uri = /network-bootstore-config
21682025-01-28T17:48:15.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37550
21692025-01-28T17:48:15.677ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21702025-01-28T17:48:15.715ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21712025-01-28T17:48:15.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91328 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37550 req_id = 3cabb6c4-b4ad-4382-8efe-1f3888b3b0c1 response_code = 204 uri = /switch-ports
21722025-01-28T17:48:15.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37550 req_id = d1b26518-c6db-4d42-ace4-dc34a8ea152e response_code = 200 uri = /network-bootstore-config
21732025-01-28T17:48:26.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7288 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = ffd9e14b-995a-4317-abf5-7259b029fb8f response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
21742025-01-28T17:48:40.127ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45160
21752025-01-28T17:48:40.127ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45160 req_id = c33ce04c-4cf8-444b-bbbe-1ccca1531c8a response_code = 200 uri = /baseboard
21762025-01-28T17:48:45.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38543
21772025-01-28T17:48:45.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38543 req_id = fc5d9edc-bf83-4039-ac4d-17e11804759e response_code = 200 uri = /vpc-routes
21782025-01-28T17:48:45.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
21792025-01-28T17:48:45.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38543 req_id = 9ae8bd13-cabb-45df-b486-dc9ffd197c2f response_code = 204 uri = /eip-gateways
21802025-01-28T17:48:45.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56423
21812025-01-28T17:48:45.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56423 req_id = bc553fa6-5e76-4d51-b449-c1d703373de5 response_code = 200 uri = /vpc-routes
21822025-01-28T17:48:45.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43487
21832025-01-28T17:48:45.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43487 req_id = 224d376e-9593-44db-aba2-bdd29180e307 response_code = 200 uri = /v2p
21842025-01-28T17:48:45.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38543 req_id = e0876b84-3f6c-4e7a-97c1-bca07d2f39ac response_code = 204 uri = /vpc-routes
21852025-01-28T17:48:45.201ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
21862025-01-28T17:48:45.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56423 req_id = b4ab7f8c-31a3-470f-ab04-4b2167f95e89 response_code = 204 uri = /eip-gateways
21872025-01-28T17:48:45.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56423 req_id = 4cd61687-00fb-4cb8-b2c3-8971a7da7e3d response_code = 204 uri = /vpc-routes
21882025-01-28T17:48:45.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54057
21892025-01-28T17:48:45.276ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21902025-01-28T17:48:45.321ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21912025-01-28T17:48:45.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54057 req_id = 0fde92f0-35d8-4a4a-a84d-7f43553927ff response_code = 204 uri = /switch-ports
21922025-01-28T17:48:45.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54514
21932025-01-28T17:48:45.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49142
21942025-01-28T17:48:45.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54057 req_id = d687e394-8672-4f27-bafd-fdfc280640b4 response_code = 200 uri = /network-bootstore-config
21952025-01-28T17:48:45.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54514 req_id = 52c62974-46a4-4b12-9e84-bb4608aa9f99 response_code = 200 uri = /v2p
21962025-01-28T17:48:45.390ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21972025-01-28T17:48:45.427ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21982025-01-28T17:48:45.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89188 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49142 req_id = 4c411ab4-b2bb-4672-b518-00c9e6d5f2ea response_code = 204 uri = /switch-ports
21992025-01-28T17:48:45.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49142 req_id = 3296b65f-5457-40e2-bd75-9119fd7f10d0 response_code = 200 uri = /network-bootstore-config
22002025-01-28T17:48:45.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42881
22012025-01-28T17:48:45.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42881 req_id = 1bf5dba7-86e8-4c2e-a2de-18d0eab58c1f response_code = 200 uri = /vpc-routes
22022025-01-28T17:48:45.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48955
22032025-01-28T17:48:45.525ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22042025-01-28T17:48:45.562ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22052025-01-28T17:48:45.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48955 req_id = 99748af3-dedb-42c8-8c45-bee1a41202c9 response_code = 204 uri = /switch-ports
22062025-01-28T17:48:45.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61345
22072025-01-28T17:48:45.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48955 req_id = 3fd2e464-998c-4bf0-8e15-29791a846cb6 response_code = 200 uri = /network-bootstore-config
22082025-01-28T17:48:45.616ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
22092025-01-28T17:48:45.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42881 req_id = 288c09dc-0c89-4b45-81a4-b81465299b73 response_code = 204 uri = /eip-gateways
22102025-01-28T17:48:45.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61345 req_id = a13d41d9-0ffe-450c-a5bd-6068ee46ae2a response_code = 200 uri = /v2p
22112025-01-28T17:48:45.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42881 req_id = 0d214639-5207-4702-937b-7a3735b689e7 response_code = 204 uri = /vpc-routes
22122025-01-28T17:48:56.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7405 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = d52cd841-da4d-4f51-8e4d-6a3840f81870 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
22132025-01-28T17:49:10.160ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44445
22142025-01-28T17:49:10.160ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44445 req_id = c1142ee1-0dbe-4cab-a421-a789664fddc7 response_code = 200 uri = /baseboard
22152025-01-28T17:49:15.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58274
22162025-01-28T17:49:15.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58274 req_id = e939db93-0849-4bf4-b8df-a2f448742e6c response_code = 200 uri = /vpc-routes
22172025-01-28T17:49:15.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49266
22182025-01-28T17:49:15.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49266 req_id = 0826ab0e-e5f4-4781-a615-0b41c23fcc41 response_code = 200 uri = /vpc-routes
22192025-01-28T17:49:15.351ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
22202025-01-28T17:49:15.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58274 req_id = c9595770-4535-41c0-8bda-eb3ccc218f63 response_code = 204 uri = /eip-gateways
22212025-01-28T17:49:15.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58274 req_id = 288f5264-11c9-4adc-b8d8-4fb94511e079 response_code = 204 uri = /vpc-routes
22222025-01-28T17:49:15.429ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
22232025-01-28T17:49:15.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49266 req_id = 194eef63-7475-468d-bb16-a1b2a3ee4529 response_code = 204 uri = /eip-gateways
22242025-01-28T17:49:15.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49266 req_id = 5828cc17-cd77-48d0-867d-9b597bbce81c response_code = 204 uri = /vpc-routes
22252025-01-28T17:49:15.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55829
22262025-01-28T17:49:15.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55829 req_id = 16426619-1544-41d2-8137-16104752ed32 response_code = 200 uri = /v2p
22272025-01-28T17:49:15.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49843
22282025-01-28T17:49:15.512ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22292025-01-28T17:49:15.551ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22302025-01-28T17:49:15.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49843 req_id = d0f25682-c4f4-4902-bfe6-29d3e779baaf response_code = 204 uri = /switch-ports
22312025-01-28T17:49:15.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38635
22322025-01-28T17:49:15.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42520
22332025-01-28T17:49:15.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42520 req_id = cf2e41ab-3a2a-47b1-aa53-59daf645c630 response_code = 200 uri = /v2p
22342025-01-28T17:49:15.607ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22352025-01-28T17:49:15.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49843 req_id = d076c3fd-5bd4-4c60-98ac-29f60ca7ff15 response_code = 200 uri = /network-bootstore-config
22362025-01-28T17:49:15.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52704
22372025-01-28T17:49:15.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52704 req_id = cbe38e95-232a-44f7-8736-b41424383c42 response_code = 200 uri = /vpc-routes
22382025-01-28T17:49:15.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22392025-01-28T17:49:15.665ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
22402025-01-28T17:49:15.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52704 req_id = df8fab5e-6f99-45af-b8d2-0aa9c97d013d response_code = 204 uri = /eip-gateways
22412025-01-28T17:49:15.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52704 req_id = 76b470b3-23e3-4a72-9971-6b51cafdca92 response_code = 204 uri = /vpc-routes
22422025-01-28T17:49:15.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49028
22432025-01-28T17:49:15.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49028 req_id = 5b702dd5-80da-4075-86fc-3edd719f07fd response_code = 200 uri = /v2p
22442025-01-28T17:49:15.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93705 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 94905957-54fd-463f-802f-c55293efbfea response_code = 204 uri = /switch-ports
22452025-01-28T17:49:15.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38635 req_id = 9ae862e3-f764-4708-91d8-38056b2b750d response_code = 200 uri = /network-bootstore-config
22462025-01-28T17:49:15.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48302
22472025-01-28T17:49:15.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22482025-01-28T17:49:15.748ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22492025-01-28T17:49:15.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85108 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48302 req_id = 276376ae-415c-4bd2-b659-d4c5da91d69c response_code = 204 uri = /switch-ports
22502025-01-28T17:49:15.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48302 req_id = eb6a8bed-9052-4cca-b4cd-c4738615cc62 response_code = 200 uri = /network-bootstore-config
22512025-01-28T17:49:26.619ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7455 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 28ce53da-2b3b-477c-bd95-98f3ed8a06eb response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
22522025-01-28T17:49:40.195ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48530
22532025-01-28T17:49:40.195ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48530 req_id = 4335ae2f-3c57-4ad1-b38b-70f6f3ca9efb response_code = 200 uri = /baseboard
22542025-01-28T17:49:45.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62569
22552025-01-28T17:49:45.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62569 req_id = b7a13d01-bda0-468f-a453-2c16f8904862 response_code = 200 uri = /vpc-routes
22562025-01-28T17:49:45.178ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
22572025-01-28T17:49:45.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62569 req_id = d6982c40-9ce8-489b-86ca-ffbebff561d4 response_code = 204 uri = /eip-gateways
22582025-01-28T17:49:45.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62569 req_id = 097303cb-6add-46c5-adfc-6ff15e47c9fd response_code = 204 uri = /vpc-routes
22592025-01-28T17:49:45.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54128
22602025-01-28T17:49:45.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54128 req_id = 13437f9a-448a-4a19-90be-480a48cedb51 response_code = 200 uri = /v2p
22612025-01-28T17:49:45.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61359
22622025-01-28T17:49:45.269ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22632025-01-28T17:49:45.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22642025-01-28T17:49:45.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118982 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61359 req_id = 61b10893-15cd-487e-819b-d850c120033b response_code = 204 uri = /switch-ports
22652025-01-28T17:49:45.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50813
22662025-01-28T17:49:45.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56805
22672025-01-28T17:49:45.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57679
22682025-01-28T17:49:45.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50813 req_id = 62fc0dc5-70e1-4711-b526-e22662473ce0 response_code = 200 uri = /vpc-routes
22692025-01-28T17:49:45.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4479 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57679 req_id = 9b4a2c52-178b-41ee-833c-55212111a158 response_code = 200 uri = /v2p
22702025-01-28T17:49:45.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4595 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61359 req_id = 0c4cb2c4-1a73-47ba-ba05-4a662469341c response_code = 200 uri = /network-bootstore-config
22712025-01-28T17:49:45.393ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22722025-01-28T17:49:45.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22732025-01-28T17:49:45.444ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
22742025-01-28T17:49:45.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50813 req_id = b45e5f6f-3094-46ee-b1ce-0437e06dbccf response_code = 204 uri = /eip-gateways
22752025-01-28T17:49:45.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49923
22762025-01-28T17:49:45.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49923 req_id = e1a6e8a9-38e7-4e9b-9cd3-56207aeb7045 response_code = 200 uri = /vpc-routes
22772025-01-28T17:49:45.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50813 req_id = f119d2a3-26cc-437c-a728-6b8f3213f950 response_code = 204 uri = /vpc-routes
22782025-01-28T17:49:45.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54895
22792025-01-28T17:49:45.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54895 req_id = 3e8cccdf-e79b-4c68-968b-bc52f17cfc91 response_code = 200 uri = /v2p
22802025-01-28T17:49:45.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
22812025-01-28T17:49:45.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49923 req_id = b132bae4-6876-4673-8da8-60d738ecc668 response_code = 204 uri = /eip-gateways
22822025-01-28T17:49:45.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49923 req_id = ec19ee61-d6f0-4cf9-b7db-abbec356196d response_code = 204 uri = /vpc-routes
22832025-01-28T17:49:45.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104758 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56805 req_id = d729304e-ff61-4acb-9ec3-d55e707ce7db response_code = 204 uri = /switch-ports
22842025-01-28T17:49:45.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56805 req_id = 60275a01-9810-433c-874b-53f2fc2301c2 response_code = 200 uri = /network-bootstore-config
22852025-01-28T17:49:45.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36799
22862025-01-28T17:49:45.537ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22872025-01-28T17:49:45.573ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22882025-01-28T17:49:45.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36799 req_id = e3c400de-cbe6-4cf6-890c-85e540f5c910 response_code = 204 uri = /switch-ports
22892025-01-28T17:49:45.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36799 req_id = 2ab9aa36-242c-4ce9-8c6a-38e9b7f37c7a response_code = 200 uri = /network-bootstore-config
22902025-01-28T17:49:56.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8154 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = e2213d16-c0ea-42c2-b015-dbb470b5f47f response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
22912025-01-28T17:50:10.230ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44539
22922025-01-28T17:50:10.230ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44539 req_id = 6cc2577e-7e48-4ddb-ae77-811d6ba8f736 response_code = 200 uri = /baseboard
22932025-01-28T17:50:13.190ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22942025-01-28T17:50:13.191ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22952025-01-28T17:50:13.220ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3184, tv_nsec: 240467873 } time_to_next_cleanup = 599.99999615s
22962025-01-28T17:50:15.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62914
22972025-01-28T17:50:15.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62914 req_id = 8366d5f6-a111-4176-a8e1-5adcdceecf9a response_code = 200 uri = /vpc-routes
22982025-01-28T17:50:15.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65384
22992025-01-28T17:50:15.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65384 req_id = fae1e298-4e23-4880-86b3-b5af8fb44441 response_code = 200 uri = /vpc-routes
23002025-01-28T17:50:15.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50804
23012025-01-28T17:50:15.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50804 req_id = f61e2341-e689-4e4d-9789-2738721eca29 response_code = 200 uri = /v2p
23022025-01-28T17:50:15.392ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
23032025-01-28T17:50:15.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62914 req_id = 9e6ab018-5940-4daa-bee8-7e30c46ccd6a response_code = 204 uri = /eip-gateways
23042025-01-28T17:50:15.403ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
23052025-01-28T17:50:15.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65384 req_id = fa981786-5992-4a64-bb22-25aacc0b55ae response_code = 204 uri = /eip-gateways
23062025-01-28T17:50:15.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62914 req_id = d73e25a1-9696-45f9-a96e-da84b615907b response_code = 204 uri = /vpc-routes
23072025-01-28T17:50:15.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65384 req_id = 5a4f0cac-1558-44d9-937b-f0d227b0160c response_code = 204 uri = /vpc-routes
23082025-01-28T17:50:15.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60622
23092025-01-28T17:50:15.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23102025-01-28T17:50:15.503ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23112025-01-28T17:50:15.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60622 req_id = 36452585-7254-49e9-9041-cf436a13b0c5 response_code = 204 uri = /switch-ports
23122025-01-28T17:50:15.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56282
23132025-01-28T17:50:15.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37375
23142025-01-28T17:50:15.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37375 req_id = 8b697c19-7a07-4f4c-8af3-d63941c88a56 response_code = 200 uri = /v2p
23152025-01-28T17:50:15.564ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23162025-01-28T17:50:15.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60622 req_id = d4e292cf-cfec-4316-8823-e34f2fb6d14a response_code = 200 uri = /network-bootstore-config
23172025-01-28T17:50:15.601ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23182025-01-28T17:50:15.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43234
23192025-01-28T17:50:15.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43234 req_id = 633e29a4-89dc-4711-9b9a-94092da9c4ef response_code = 200 uri = /vpc-routes
23202025-01-28T17:50:15.645ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
23212025-01-28T17:50:15.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43234 req_id = 15ce1a35-32f2-4145-9f0a-5e7b12e3fa82 response_code = 204 uri = /eip-gateways
23222025-01-28T17:50:15.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43234 req_id = 4131c29b-8286-46a0-b45e-f061d2d3bce6 response_code = 204 uri = /vpc-routes
23232025-01-28T17:50:15.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93855 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56282 req_id = 9e1652f7-2f35-4bf5-92a6-9b533ed31748 response_code = 204 uri = /switch-ports
23242025-01-28T17:50:15.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56282 req_id = 9531cee6-eb97-40ca-97fd-09319ebc5e0f response_code = 200 uri = /network-bootstore-config
23252025-01-28T17:50:15.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51641
23262025-01-28T17:50:15.702ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23272025-01-28T17:50:15.738ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23282025-01-28T17:50:15.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92048 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51641 req_id = 0c53944c-d7dc-420c-b399-d65a39cd2dfd response_code = 204 uri = /switch-ports
23292025-01-28T17:50:15.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51641 req_id = fb66a8cd-dc11-46cc-a515-0860e61eef81 response_code = 200 uri = /network-bootstore-config
23302025-01-28T17:50:15.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42736
23312025-01-28T17:50:15.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42736 req_id = 6b57941c-8b55-4a41-b2a4-834625473486 response_code = 200 uri = /v2p
23322025-01-28T17:50:26.621ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8789 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 675797b0-d9aa-4c3e-a792-9992459a9028 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
23332025-01-28T17:50:27.426ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23342025-01-28T17:50:40.263ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60683
23352025-01-28T17:50:40.263ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60683 req_id = b312fc6f-c38c-4d34-b6b1-26344b74571c response_code = 200 uri = /baseboard
23362025-01-28T17:50:45.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51793
23372025-01-28T17:50:45.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51793 req_id = fdfcfc53-d05f-4e6d-b9f6-35dcd21f6f78 response_code = 200 uri = /vpc-routes
23382025-01-28T17:50:45.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37613
23392025-01-28T17:50:45.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37613 req_id = 2e6bbc5e-841f-4373-9192-1b27cd4e62ab response_code = 200 uri = /vpc-routes
23402025-01-28T17:50:45.201ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
23412025-01-28T17:50:45.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37613 req_id = 9854a6cd-c87c-49f1-9664-76602a81c9ae response_code = 204 uri = /eip-gateways
23422025-01-28T17:50:45.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37613 req_id = b4726deb-4137-4963-8b33-733467971d34 response_code = 204 uri = /vpc-routes
23432025-01-28T17:50:45.226ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
23442025-01-28T17:50:45.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51793 req_id = 3b5c51fc-a1e2-449f-8e38-5943de123e3e response_code = 204 uri = /eip-gateways
23452025-01-28T17:50:45.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51793 req_id = 74b26504-fa20-4702-be6c-2b63cdf858ed response_code = 204 uri = /vpc-routes
23462025-01-28T17:50:45.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60750
23472025-01-28T17:50:45.308ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23482025-01-28T17:50:45.350ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23492025-01-28T17:50:45.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106513 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60750 req_id = b5e4e09c-b7fd-4606-85cb-96b7b6123a75 response_code = 204 uri = /switch-ports
23502025-01-28T17:50:45.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49863
23512025-01-28T17:50:45.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58434
23522025-01-28T17:50:45.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49708
23532025-01-28T17:50:45.415ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23542025-01-28T17:50:45.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60750 req_id = 3076741f-8eaf-482d-b9f2-9ec4120cde8f response_code = 200 uri = /network-bootstore-config
23552025-01-28T17:50:45.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3470 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49863 req_id = beed6f33-e657-460c-b9ae-53f49750b5f0 response_code = 200 uri = /v2p
23562025-01-28T17:50:45.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3469 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58434 req_id = a8e95341-e8a4-4f3c-a8cd-554ce7fc729d response_code = 200 uri = /vpc-routes
23572025-01-28T17:50:45.434ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
23582025-01-28T17:50:45.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58434 req_id = 63caf2bc-f170-4de1-898f-0cd74ae103dc response_code = 204 uri = /eip-gateways
23592025-01-28T17:50:45.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47237
23602025-01-28T17:50:45.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47237 req_id = 2de8d4ef-1dff-46c1-88f5-93b9dcff1425 response_code = 200 uri = /v2p
23612025-01-28T17:50:45.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63226
23622025-01-28T17:50:45.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 802 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58434 req_id = 965f6560-6aa1-4ea8-b3c6-773ffa241242 response_code = 204 uri = /vpc-routes
23632025-01-28T17:50:45.454ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23642025-01-28T17:50:45.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62003
23652025-01-28T17:50:45.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62003 req_id = 1b9a0e68-50b9-4c05-832f-25fa94c442a9 response_code = 200 uri = /v2p
23662025-01-28T17:50:45.509ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23672025-01-28T17:50:45.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94307 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49708 req_id = aac0a15c-c97d-414b-8b3c-0b11b4d7af0f response_code = 204 uri = /switch-ports
23682025-01-28T17:50:45.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 704 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49708 req_id = 1458fc33-003d-4447-b6af-503faf3885f2 response_code = 200 uri = /network-bootstore-config
23692025-01-28T17:50:45.543ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23702025-01-28T17:50:45.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63226 req_id = 185d0ee9-cbd7-4f84-ae31-8c45d0559bff response_code = 204 uri = /switch-ports
23712025-01-28T17:50:45.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63226 req_id = fb7ab611-c3a7-4daf-be50-b9eeeb218533 response_code = 200 uri = /network-bootstore-config
23722025-01-28T17:50:56.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7411 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = f80afde9-f3a7-4f88-b8a4-b76d95da8773 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
23732025-01-28T17:51:10.298ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39307
23742025-01-28T17:51:10.298ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39307 req_id = ae891566-e0a7-4e8e-9cf3-4b59b2ce9890 response_code = 200 uri = /baseboard
23752025-01-28T17:51:15.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58866
23762025-01-28T17:51:15.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58866 req_id = fe92edfb-c81f-419c-a20d-2dd7db9c0310 response_code = 200 uri = /vpc-routes
23772025-01-28T17:51:15.251ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
23782025-01-28T17:51:15.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58866 req_id = d95d2f59-1448-4b19-a838-f45dcd7a0dde response_code = 204 uri = /eip-gateways
23792025-01-28T17:51:15.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40395
23802025-01-28T17:51:15.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40395 req_id = 452236c5-932b-4469-aaad-346e0f6a3000 response_code = 200 uri = /v2p
23812025-01-28T17:51:15.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58866 req_id = c2fc10a5-ee24-4a46-bc04-aa32273918f5 response_code = 204 uri = /vpc-routes
23822025-01-28T17:51:15.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57675
23832025-01-28T17:51:15.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57675 req_id = 8f90e743-d98b-41c0-b44b-fe9cf8ed107c response_code = 200 uri = /vpc-routes
23842025-01-28T17:51:15.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39452
23852025-01-28T17:51:15.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39452 req_id = 863baaa0-f129-489e-b069-901d429f3f99 response_code = 200 uri = /v2p
23862025-01-28T17:51:15.409ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
23872025-01-28T17:51:15.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57675 req_id = c90eec16-629c-427c-a364-0af6e0515717 response_code = 204 uri = /eip-gateways
23882025-01-28T17:51:15.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57675 req_id = d9e9199e-30b9-4956-b76f-3025c959d5c4 response_code = 204 uri = /vpc-routes
23892025-01-28T17:51:15.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37290
23902025-01-28T17:51:15.503ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23912025-01-28T17:51:15.543ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23922025-01-28T17:51:15.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95835 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37290 req_id = b531577d-306a-4de8-a468-92702a7c69dc response_code = 204 uri = /switch-ports
23932025-01-28T17:51:15.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61966
23942025-01-28T17:51:15.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40301
23952025-01-28T17:51:15.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40301 req_id = 071a0bd9-a4c5-4aa8-a755-2f62c305309c response_code = 200 uri = /vpc-routes
23962025-01-28T17:51:15.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37290 req_id = c22a823a-7438-4549-b176-dc68754f5ad7 response_code = 200 uri = /network-bootstore-config
23972025-01-28T17:51:15.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23982025-01-28T17:51:15.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36636
23992025-01-28T17:51:15.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36636 req_id = 0da4f1e0-79c0-4586-9c58-1dfb64e4a16a response_code = 200 uri = /v2p
24002025-01-28T17:51:15.639ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24012025-01-28T17:51:15.643ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
24022025-01-28T17:51:15.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40301 req_id = bce03002-c753-4d32-996a-e5d26e841443 response_code = 204 uri = /eip-gateways
24032025-01-28T17:51:15.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1081 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40301 req_id = ea159aa6-162b-443f-96a7-adca0cbcdcfc response_code = 204 uri = /vpc-routes
24042025-01-28T17:51:15.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94395 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61966 req_id = 1b69ed24-ac1f-469b-8148-02d9b046c2c5 response_code = 204 uri = /switch-ports
24052025-01-28T17:51:15.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61966 req_id = 3eca274a-1408-40c8-8d41-946bf5c0a2cb response_code = 200 uri = /network-bootstore-config
24062025-01-28T17:51:15.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55167
24072025-01-28T17:51:15.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24082025-01-28T17:51:15.756ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24092025-01-28T17:51:15.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88008 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55167 req_id = ad322c40-16c6-4327-8a23-23cc9aafe82e response_code = 204 uri = /switch-ports
24102025-01-28T17:51:15.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55167 req_id = 25f73c6d-ca14-4cbb-b418-663256fcb560 response_code = 200 uri = /network-bootstore-config
24112025-01-28T17:51:26.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8035 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 7d712cab-0a11-46f7-bc80-d9aa2299a07e response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
24122025-01-28T17:51:40.331ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40360
24132025-01-28T17:51:40.331ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40360 req_id = 08c96ca8-8dfa-4b75-99f7-1bfacf071e99 response_code = 200 uri = /baseboard
24142025-01-28T17:51:45.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49498
24152025-01-28T17:51:45.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49498 req_id = ce297858-82e0-41ac-9649-412d25849b7d response_code = 200 uri = /vpc-routes
24162025-01-28T17:51:45.244ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
24172025-01-28T17:51:45.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49498 req_id = 352677dd-652e-4fab-8522-05eab6d05e4a response_code = 204 uri = /eip-gateways
24182025-01-28T17:51:45.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47976
24192025-01-28T17:51:45.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47976 req_id = 846f691f-d928-4077-aba5-94c7b0c7964f response_code = 200 uri = /vpc-routes
24202025-01-28T17:51:45.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49498 req_id = e13d6a97-40d9-4fed-94aa-286ef65978eb response_code = 204 uri = /vpc-routes
24212025-01-28T17:51:45.279ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
24222025-01-28T17:51:45.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47976 req_id = 6cc736e6-1ca3-4f2d-ade8-80b5abc2764e response_code = 204 uri = /eip-gateways
24232025-01-28T17:51:45.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47976 req_id = 7d3314f6-8e04-4f63-b9f7-35979e6d8fca response_code = 204 uri = /vpc-routes
24242025-01-28T17:51:45.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36341
24252025-01-28T17:51:45.350ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24262025-01-28T17:51:45.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24272025-01-28T17:51:45.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118702 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36341 req_id = 8fead8cb-7233-4468-b9e5-46bf054e8c17 response_code = 204 uri = /switch-ports
24282025-01-28T17:51:45.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44543
24292025-01-28T17:51:45.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56115
24302025-01-28T17:51:45.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41401
24312025-01-28T17:51:45.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47043
24322025-01-28T17:51:45.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36341 req_id = 478c99ab-fab2-4c91-9553-fec00a82983a response_code = 200 uri = /network-bootstore-config
24332025-01-28T17:51:45.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62822
24342025-01-28T17:51:45.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56115 req_id = fddd609a-e949-46cb-96a7-efc9ee416dc4 response_code = 200 uri = /vpc-routes
24352025-01-28T17:51:45.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 415 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44543 req_id = c602deb7-6ebf-46ea-889d-1137cd22f9ac response_code = 200 uri = /v2p
24362025-01-28T17:51:45.470ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24372025-01-28T17:51:45.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62822 req_id = 1b6fadb7-8e2b-48a9-a0a3-3c5753d24f24 response_code = 200 uri = /v2p
24382025-01-28T17:51:45.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 432 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41401 req_id = 76e7324c-3cd3-447d-9159-baedf23c8fd9 response_code = 200 uri = /v2p
24392025-01-28T17:51:45.493ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
24402025-01-28T17:51:45.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56115 req_id = 51a1493d-dcfc-4ab4-b828-835a89ab6efc response_code = 204 uri = /eip-gateways
24412025-01-28T17:51:45.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56115 req_id = cc8b7004-0acb-43b5-b6b4-00059951f9e4 response_code = 204 uri = /vpc-routes
24422025-01-28T17:51:45.524ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24432025-01-28T17:51:45.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59230
24442025-01-28T17:51:45.612ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24452025-01-28T17:51:45.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47043 req_id = 003cff8b-8480-453e-8782-e773ce895e25 response_code = 204 uri = /switch-ports
24462025-01-28T17:51:45.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 800 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47043 req_id = e3d8dbae-601f-427b-ac1c-7b281b4de53c response_code = 200 uri = /network-bootstore-config
24472025-01-28T17:51:45.663ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24482025-01-28T17:51:45.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201114 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59230 req_id = b4ab3ad6-cdd4-44c0-aff4-7d0667b5884b response_code = 204 uri = /switch-ports
24492025-01-28T17:51:45.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59230 req_id = edd68f5c-2a2d-4142-8224-17f77fecd14a response_code = 200 uri = /network-bootstore-config
24502025-01-28T17:51:56.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8223 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = b1b4823a-0525-42c4-947a-dec77677960f response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
24512025-01-28T17:52:10.363ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44105
24522025-01-28T17:52:10.363ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44105 req_id = ff04e366-eb62-48a5-b711-09cce07f86f3 response_code = 200 uri = /baseboard
24532025-01-28T17:52:15.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63125
24542025-01-28T17:52:15.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63125 req_id = 80b50ff8-cd1c-4254-92c0-256f172be602 response_code = 200 uri = /vpc-routes
24552025-01-28T17:52:15.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33415
24562025-01-28T17:52:15.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33415 req_id = f7e178e0-8afd-4e05-b06f-103b2f973aaa response_code = 200 uri = /vpc-routes
24572025-01-28T17:52:15.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
24582025-01-28T17:52:15.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63125 req_id = a5e1282c-ea1b-4f27-811a-b180eccfc2bd response_code = 204 uri = /eip-gateways
24592025-01-28T17:52:15.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63125 req_id = 45c7a9bd-7988-4886-ada1-36683f38f2a9 response_code = 204 uri = /vpc-routes
24602025-01-28T17:52:15.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34042
24612025-01-28T17:52:15.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34042 req_id = 55e8d13e-b6cc-4127-8932-3eef29e5d202 response_code = 200 uri = /vpc-routes
24622025-01-28T17:52:15.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
24632025-01-28T17:52:15.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34042 req_id = 0f1e905f-514f-4ca3-bb5d-2ca1c61e56e9 response_code = 204 uri = /eip-gateways
24642025-01-28T17:52:15.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45343
24652025-01-28T17:52:15.527ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24662025-01-28T17:52:15.527ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24672025-01-28T17:52:15.527ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:177
24682025-01-28T17:52:15.528ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:177
24692025-01-28T17:52:15.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63744
24702025-01-28T17:52:15.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63744 req_id = efb30e4a-3449-40a4-b30d-7da04e077ea3 response_code = 200 uri = /v2p
24712025-01-28T17:52:15.542ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24722025-01-28T17:52:15.542ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7
24732025-01-28T17:52:15.569ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24742025-01-28T17:52:15.569ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d033c793-1184-4faf-a379-2f30181b8b7f
24752025-01-28T17:52:15.581ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
24762025-01-28T17:52:15.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33415 req_id = 69f41bd7-c842-4db7-89c1-98a555d50ee1 response_code = 204 uri = /eip-gateways
24772025-01-28T17:52:15.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53670
24782025-01-28T17:52:15.583ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24792025-01-28T17:52:15.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34508
24802025-01-28T17:52:15.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37786
24812025-01-28T17:52:15.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55977
24822025-01-28T17:52:15.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 577 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55977 req_id = 2c562ca5-4a30-4241-996e-7b77aced63a4 response_code = 200 uri = /v2p
24832025-01-28T17:52:15.595ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24842025-01-28T17:52:15.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24852025-01-28T17:52:15.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 729 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33415 req_id = a741a768-2262-4cac-beea-1814da4e123d response_code = 204 uri = /vpc-routes
24862025-01-28T17:52:15.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24872025-01-28T17:52:15.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24882025-01-28T17:52:15.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24892025-01-28T17:52:15.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24902025-01-28T17:52:15.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24912025-01-28T17:52:15.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 821 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34508 req_id = ad680e56-43f9-4a11-8714-ce770bd07a85 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24922025-01-28T17:52:15.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24932025-01-28T17:52:15.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24942025-01-28T17:52:15.596ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:177
24952025-01-28T17:52:15.605ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24962025-01-28T17:52:15.606ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_94f0d539-6272-43cf-85f5-da15e180f2ad
24972025-01-28T17:52:15.606ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:177
24982025-01-28T17:52:15.627ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24992025-01-28T17:52:15.628ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7
25002025-01-28T17:52:15.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41766
25012025-01-28T17:52:15.632ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25022025-01-28T17:52:15.650ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25032025-01-28T17:52:15.650ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25042025-01-28T17:52:15.650ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25052025-01-28T17:52:15.650ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7
25062025-01-28T17:52:15.664ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/config/omicron-zones.json file = common/src/ledger.rs:177
25072025-01-28T17:52:15.668ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25082025-01-28T17:52:15.668ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d033c793-1184-4faf-a379-2f30181b8b7f
25092025-01-28T17:52:15.677ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/config/omicron-zones.json file = common/src/ledger.rs:177
25102025-01-28T17:52:15.683ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25112025-01-28T17:52:15.684ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d69f461c-d55e-48a5-9816-173eae69537e
25122025-01-28T17:52:15.700ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25132025-01-28T17:52:15.700ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7
25142025-01-28T17:52:15.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121537 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53670 req_id = 1d0a6400-842d-4d6a-9bbc-dcba33200e94 response_code = 204 uri = /switch-ports
25152025-01-28T17:52:15.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48291
25162025-01-28T17:52:15.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 567 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53670 req_id = cfc36979-f148-461c-8f1a-39ec1f095f0c response_code = 200 uri = /network-bootstore-config
25172025-01-28T17:52:15.711ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25182025-01-28T17:52:15.722ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25192025-01-28T17:52:15.722ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_94f0d539-6272-43cf-85f5-da15e180f2ad
25202025-01-28T17:52:15.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39980
25212025-01-28T17:52:15.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 539 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39980 req_id = 0144e2da-766a-41d0-b082-6f9850ad03f8 response_code = 200 uri = /v2p
25222025-01-28T17:52:15.746ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25232025-01-28T17:52:15.746ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7d23e6c8-6805-4a21-bee4-ece464779811
25242025-01-28T17:52:15.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 16574 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34042 req_id = 2fbbd92d-c744-4d70-8a62-4c78b248716c response_code = 204 uri = /vpc-routes
25252025-01-28T17:52:15.761ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25262025-01-28T17:52:15.766ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25272025-01-28T17:52:15.766ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7
25282025-01-28T17:52:15.780ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d033c793-1184-4faf-a379-2f30181b8b7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25292025-01-28T17:52:15.780ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d033c793-1184-4faf-a379-2f30181b8b7f
25302025-01-28T17:52:15.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60404
25312025-01-28T17:52:15.794ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25322025-01-28T17:52:15.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25332025-01-28T17:52:15.795ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25342025-01-28T17:52:15.795ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25352025-01-28T17:52:15.795ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25362025-01-28T17:52:15.795ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25372025-01-28T17:52:15.795ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25382025-01-28T17:52:15.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 681 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60404 req_id = 770a7353-d5a4-48b6-b19d-78954fe9ff4d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25392025-01-28T17:52:15.799ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25402025-01-28T17:52:15.800ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_37b8192c-9236-4941-bad3-2ab9840de50c
25412025-01-28T17:52:15.814ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25422025-01-28T17:52:15.814ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d69f461c-d55e-48a5-9816-173eae69537e
25432025-01-28T17:52:15.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65336
25442025-01-28T17:52:15.824ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e634cb2-ad7a-437d-8c85-7b4881cd8c12, kind: Service { id: 733cf09b-dc13-4827-8d0b-579ef784fbbc }, name: Name("external-dns-733cf09b-dc13-4827-8d0b-579ef784fbbc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 248])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 95bbef37-b203-490e-bdcd-87a4f4bc957b, kind: Service { id: bcae8c4d-613c-4240-a5a7-639225fc1614 }, name: Name("external-dns-bcae8c4d-613c-4240-a5a7-639225fc1614"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 371a328f-6342-4b2f-b9b5-140bcf8a9a69, kind: Service { id: 11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd }, name: Name("nexus-11eb6c6b-c566-4de2-8c4b-29cd2c9e57fd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 524223c0-a8a4-46e8-8424-65e9e93be2b1, kind: Service { id: 4ad358d0-bd51-49e0-b02e-9246fa3bca53 }, name: Name("nexus-4ad358d0-bd51-49e0-b02e-9246fa3bca53"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 148])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa016f59-1e73-49a5-ac0c-9207b4c83e10, kind: Service { id: a3cdca35-19bc-4856-a3d7-072cc05bbb93 }, name: Name("nexus-a3cdca35-19bc-4856-a3d7-072cc05bbb93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25452025-01-28T17:52:15.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25462025-01-28T17:52:15.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25472025-01-28T17:52:15.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25482025-01-28T17:52:15.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25492025-01-28T17:52:15.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25502025-01-28T17:52:15.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25512025-01-28T17:52:15.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 395 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65336 req_id = 7918305c-df21-4562-8061-bf74e0a864aa response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25522025-01-28T17:52:15.829ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94f0d539-6272-43cf-85f5-da15e180f2ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25532025-01-28T17:52:15.829ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_94f0d539-6272-43cf-85f5-da15e180f2ad
25542025-01-28T17:52:15.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121914 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48291 req_id = 0a94c6fa-1ba1-40ed-935a-1f2a283add5e response_code = 204 uri = /switch-ports
25552025-01-28T17:52:15.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48291 req_id = af3bf6e8-de27-482a-9498-092be2031ea9 response_code = 200 uri = /network-bootstore-config
25562025-01-28T17:52:15.846ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25572025-01-28T17:52:15.846ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_da44c06d-1c73-487e-9c46-5eba2365be55
25582025-01-28T17:52:15.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56305
25592025-01-28T17:52:15.857ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25602025-01-28T17:52:15.863ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d623ca36-204f-4167-b0d2-bf03085fd8a7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25612025-01-28T17:52:15.863ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d623ca36-204f-4167-b0d2-bf03085fd8a7
25622025-01-28T17:52:15.877ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25632025-01-28T17:52:15.877ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7d23e6c8-6805-4a21-bee4-ece464779811
25642025-01-28T17:52:15.893ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25652025-01-28T17:52:15.893ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04
25662025-01-28T17:52:15.898ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25672025-01-28T17:52:15.911ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25682025-01-28T17:52:15.912ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_37b8192c-9236-4941-bad3-2ab9840de50c
25692025-01-28T17:52:15.924ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d69f461c-d55e-48a5-9816-173eae69537e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25702025-01-28T17:52:15.924ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d69f461c-d55e-48a5-9816-173eae69537e
25712025-01-28T17:52:15.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 405261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45343 req_id = d18c49a0-717b-45e2-9737-e5a929bc493d response_code = 200 uri = /inventory
25722025-01-28T17:52:15.950ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7d23e6c8-6805-4a21-bee4-ece464779811 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25732025-01-28T17:52:15.950ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7d23e6c8-6805-4a21-bee4-ece464779811
25742025-01-28T17:52:15.963ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25752025-01-28T17:52:15.963ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_da44c06d-1c73-487e-9c46-5eba2365be55
25762025-01-28T17:52:15.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114247 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56305 req_id = 88f8087e-5781-4951-a5a7-378d4819be33 response_code = 204 uri = /switch-ports
25772025-01-28T17:52:15.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56305 req_id = eae2d240-6479-48f9-80f6-346062087b91 response_code = 200 uri = /network-bootstore-config
25782025-01-28T17:52:15.978ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37b8192c-9236-4941-bad3-2ab9840de50c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25792025-01-28T17:52:15.978ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_37b8192c-9236-4941-bad3-2ab9840de50c
25802025-01-28T17:52:15.994ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25812025-01-28T17:52:15.994ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04
25822025-01-28T17:52:16.009ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: da44c06d-1c73-487e-9c46-5eba2365be55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25832025-01-28T17:52:16.009ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_da44c06d-1c73-487e-9c46-5eba2365be55
25842025-01-28T17:52:16.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 417759 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37786 req_id = 6a87f505-ac2b-4f71-a622-4d9430ef89d9 response_code = 200 uri = /inventory
25852025-01-28T17:52:16.035ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25862025-01-28T17:52:16.035ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04
25872025-01-28T17:52:16.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 411085 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41766 req_id = 70dd896a-5d4c-4651-b448-7c156b2c91d3 response_code = 200 uri = /inventory
25882025-01-28T17:52:26.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7519 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 23d768d8-1fc3-496b-8157-46183fd46412 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
25892025-01-28T17:52:40.395ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36650
25902025-01-28T17:52:40.395ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36650 req_id = 5051d2f0-116d-4ab2-a7b8-f06ceab3bfba response_code = 200 uri = /baseboard
25912025-01-28T17:52:45.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37080
25922025-01-28T17:52:45.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37080 req_id = 8497367a-7c25-49fd-b7fa-9394d47f7827 response_code = 200 uri = /vpc-routes
25932025-01-28T17:52:45.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53079
25942025-01-28T17:52:45.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53079 req_id = b3bd4557-cfea-4b82-817d-1ae4259d0b62 response_code = 200 uri = /vpc-routes
25952025-01-28T17:52:45.146ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
25962025-01-28T17:52:45.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37080 req_id = d5b15ca4-7e01-40b0-9d3c-2d72eefc3848 response_code = 204 uri = /eip-gateways
25972025-01-28T17:52:45.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37080 req_id = 3b47cf51-196b-4fe0-b86c-b2f6eb18e4c3 response_code = 204 uri = /vpc-routes
25982025-01-28T17:52:45.181ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
25992025-01-28T17:52:45.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53079 req_id = 80ae4f41-05a8-4502-a53a-e614ef11f231 response_code = 204 uri = /eip-gateways
26002025-01-28T17:52:45.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53079 req_id = a53cefbc-25bc-4057-a553-c9858b95d4de response_code = 204 uri = /vpc-routes
26012025-01-28T17:52:45.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33606
26022025-01-28T17:52:45.255ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26032025-01-28T17:52:45.294ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26042025-01-28T17:52:45.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103616 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33606 req_id = 34c080b9-8004-450f-b018-c39ee484d413 response_code = 204 uri = /switch-ports
26052025-01-28T17:52:45.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38657
26062025-01-28T17:52:45.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64334
26072025-01-28T17:52:45.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38199
26082025-01-28T17:52:45.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54939
26092025-01-28T17:52:45.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54939 req_id = e1eb75de-c0ad-4776-a6e8-2cf83817a379 response_code = 200 uri = /vpc-routes
26102025-01-28T17:52:45.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33606 req_id = a3e6be1d-3ae5-46cd-9bea-2fa3b21dfacb response_code = 200 uri = /network-bootstore-config
26112025-01-28T17:52:45.360ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26122025-01-28T17:52:45.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64334 req_id = 556a4f01-5137-4663-a0c8-1a562f81ccb8 response_code = 200 uri = /v2p
26132025-01-28T17:52:45.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38199 req_id = 8cae19d6-4cd5-424b-92c7-756a4caa4acd response_code = 200 uri = /v2p
26142025-01-28T17:52:45.399ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26152025-01-28T17:52:45.403ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
26162025-01-28T17:52:45.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 541 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54939 req_id = 97c2a3c8-4279-43dd-9902-c5765cea8f29 response_code = 204 uri = /eip-gateways
26172025-01-28T17:52:45.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 929 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54939 req_id = cd9c0990-6017-4755-8889-295c9cd071f4 response_code = 204 uri = /vpc-routes
26182025-01-28T17:52:45.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61783
26192025-01-28T17:52:45.457ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26202025-01-28T17:52:45.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38657 req_id = 157cf9d0-c90f-44f6-b7f0-97ced26c8795 response_code = 204 uri = /switch-ports
26212025-01-28T17:52:45.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 645 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38657 req_id = e1cf9926-7d43-4deb-be43-7e6076fba0c6 response_code = 200 uri = /network-bootstore-config
26222025-01-28T17:52:45.492ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26232025-01-28T17:52:45.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34521
26242025-01-28T17:52:45.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34521 req_id = 47825670-a8d7-4400-88c6-bf64ee4d2435 response_code = 200 uri = /v2p
26252025-01-28T17:52:45.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61783 req_id = 447b8c91-4802-413d-9b4e-9dbdd9e258e0 response_code = 204 uri = /switch-ports
26262025-01-28T17:52:45.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61783 req_id = 17485687-2774-430e-9709-b7c9ddd798d7 response_code = 200 uri = /network-bootstore-config
26272025-01-28T17:52:56.625ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 12724 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 9b4589f7-062e-4948-b696-5776973d697f response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
26282025-01-28T17:53:10.427ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44157
26292025-01-28T17:53:10.427ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44157 req_id = a34c44a3-116f-44e7-add0-cf0e0a3a0d8c response_code = 200 uri = /baseboard
26302025-01-28T17:53:15.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34599
26312025-01-28T17:53:15.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34599 req_id = 00936d74-40e1-4202-8764-d2eca33cca70 response_code = 200 uri = /vpc-routes
26322025-01-28T17:53:15.350ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
26332025-01-28T17:53:15.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34599 req_id = 9f3166d7-e51f-45a3-8cc5-e2dfc70d58ad response_code = 204 uri = /eip-gateways
26342025-01-28T17:53:15.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34599 req_id = cd0db2a4-ca0c-406b-8c57-e5d5a9e0d7a6 response_code = 204 uri = /vpc-routes
26352025-01-28T17:53:15.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54651
26362025-01-28T17:53:15.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54651 req_id = 3cc5f421-4191-4270-859b-3cefd2539bdc response_code = 200 uri = /vpc-routes
26372025-01-28T17:53:15.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61907
26382025-01-28T17:53:15.416ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26392025-01-28T17:53:15.457ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26402025-01-28T17:53:15.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94998 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61907 req_id = c1e0ddf6-353f-4638-9544-0086181cda9b response_code = 204 uri = /switch-ports
26412025-01-28T17:53:15.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39726
26422025-01-28T17:53:15.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55582
26432025-01-28T17:53:15.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61907 req_id = e73de02b-aa00-46c3-b241-e54d6bc683dd response_code = 200 uri = /network-bootstore-config
26442025-01-28T17:53:15.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55582 req_id = 396e5480-eca5-45f1-979f-d126ff3bec75 response_code = 200 uri = /v2p
26452025-01-28T17:53:15.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39726 req_id = 5bf46d83-5e56-4441-af9e-21b03e656a92 response_code = 200 uri = /v2p
26462025-01-28T17:53:15.540ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
26472025-01-28T17:53:15.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54651 req_id = 999138fc-7da0-4106-9000-d05f7ddbbdc7 response_code = 204 uri = /eip-gateways
26482025-01-28T17:53:15.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51250
26492025-01-28T17:53:15.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51250 req_id = 9b7e2a97-788f-4a0d-8a53-5c4d7a47f3d1 response_code = 200 uri = /vpc-routes
26502025-01-28T17:53:15.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54651 req_id = 81b57aaa-e49a-4e0e-908e-00cea1a7e944 response_code = 204 uri = /vpc-routes
26512025-01-28T17:53:15.580ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
26522025-01-28T17:53:15.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51250 req_id = c41b7e68-b07f-4f12-9bf9-5c7d242bf06f response_code = 204 uri = /eip-gateways
26532025-01-28T17:53:15.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51250 req_id = 2a046b57-f094-4081-8669-9b2b1943a4bf response_code = 204 uri = /vpc-routes
26542025-01-28T17:53:15.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55598
26552025-01-28T17:53:15.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26562025-01-28T17:53:15.671ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26572025-01-28T17:53:15.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55598 req_id = 4b1e73fc-a650-4453-9f08-e41a822ab139 response_code = 204 uri = /switch-ports
26582025-01-28T17:53:15.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37706
26592025-01-28T17:53:15.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37706 req_id = 35c046fd-1e62-4a27-ab54-e18cb862fc0d response_code = 200 uri = /v2p
26602025-01-28T17:53:15.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55598 req_id = c1154bbb-604e-4d6d-ac82-39ed084355ac response_code = 200 uri = /network-bootstore-config
26612025-01-28T17:53:15.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48118
26622025-01-28T17:53:15.768ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26632025-01-28T17:53:15.803ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26642025-01-28T17:53:15.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90405 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48118 req_id = 8953ae61-3969-403a-86dc-94bb7e680957 response_code = 204 uri = /switch-ports
26652025-01-28T17:53:15.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48118 req_id = d3ac22f7-bf0b-4040-a819-9ce64270f5ee response_code = 200 uri = /network-bootstore-config
26662025-01-28T17:53:26.619ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6758 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 386506a0-d0de-459a-a9ad-8b1c55c6d3d5 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
26672025-01-28T17:53:40.459ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47097
26682025-01-28T17:53:40.459ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47097 req_id = f08834e2-cd53-458b-80d7-976d8fc30310 response_code = 200 uri = /baseboard
26692025-01-28T17:53:40.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36362
26702025-01-28T17:53:40.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36362 req_id = 3b5bb937-6c89-4ce2-85b9-38eb87b823c0 response_code = 200 uri = /v2p
26712025-01-28T17:53:40.842ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(4921519) }
26722025-01-28T17:53:40.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 776 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36362 req_id = 879e1fec-2ada-48ca-bd51-9bca3767812c response_code = 204 uri = /v2p
26732025-01-28T17:53:40.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46721
26742025-01-28T17:53:40.913ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e581addc-6ac6-44e5-8b7e-32350c348f75, kind: Instance { id: 4543ce72-670d-4dca-beee-bed47b56e431 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4921519), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e581addc-6ac6-44e5-8b7e-32350c348f75, kind: Instance { id: 4543ce72-670d-4dca-beee-bed47b56e431 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4921519), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e581addc-6ac6-44e5-8b7e-32350c348f75, kind: Instance { id: 4543ce72-670d-4dca-beee-bed47b56e431 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4921519), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4921519))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e581addc-6ac6-44e5-8b7e-32350c348f75, kind: Instance { id: 4543ce72-670d-4dca-beee-bed47b56e431 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4921519), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 2bc783b7-c09c-4b41-9799-3805023e0168, slot: 0, read_only: false, vcr_json: .., name: "disk-3785674a4a5" }], boot_settings: Some(InstanceBootSettings { order: [2bc783b7-c09c-4b41-9799-3805023e0168] }), cloud_init_bytes: Some(..) } instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 metadata = InstanceMetadata { silo_id: 3cdf2fa0-69b0-4f02-885f-d69226d6adce, project_id: 171db679-1783-4df1-8313-8844b1e6827a } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-28T17:53:40.907101333Z }
26752025-01-28T17:53:40.913ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 migration_id = None propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26762025-01-28T17:53:40.913ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 migration_id = None propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e581addc-6ac6-44e5-8b7e-32350c348f75, kind: Instance { id: 4543ce72-670d-4dca-beee-bed47b56e431 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4921519), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e581addc-6ac6-44e5-8b7e-32350c348f75, kind: Instance { id: 4543ce72-670d-4dca-beee-bed47b56e431 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4921519), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e581addc-6ac6-44e5-8b7e-32350c348f75, kind: Instance { id: 4543ce72-670d-4dca-beee-bed47b56e431 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4921519), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4921519))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e581addc-6ac6-44e5-8b7e-32350c348f75, kind: Instance { id: 4543ce72-670d-4dca-beee-bed47b56e431 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4921519), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 2bc783b7-c09c-4b41-9799-3805023e0168, slot: 0, read_only: false, vcr_json: .., name: "disk-3785674a4a5" }], boot_settings: Some(InstanceBootSettings { order: [2bc783b7-c09c-4b41-9799-3805023e0168] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-28T17:53:40.907101333Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26772025-01-28T17:53:40.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6862 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46721 req_id = c003fe3a-762d-4c87-b708-086f4abca2b7 response_code = 200 uri = /vmms/508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26782025-01-28T17:53:40.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58750
26792025-01-28T17:53:40.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58750 req_id = 030cde1b-7faf-4383-ac71-c94170ee1bf4 response_code = 200 uri = /vmms/508fdc67-e4e4-4de8-8d20-bb3e3eb24d13/state
26802025-01-28T17:53:40.998ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 4921519 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26812025-01-28T17:53:40.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26822025-01-28T17:53:41.036ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 file = illumos-utils/src/zone.rs:325 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26832025-01-28T17:53:41.060ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 file = illumos-utils/src/zone.rs:363 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26842025-01-28T17:53:41.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48951
26852025-01-28T17:53:41.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48951 req_id = bc05906b-ffa9-44c1-a177-b4f3fd466340 response_code = 200 uri = /vpc-routes
26862025-01-28T17:53:41.124ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {e581addc-6ac6-44e5-8b7e-32350c348f75: {10.151.2.176: {07a0a145-f680-4a2b-883c-7d91afa322ba}, 10.151.2.175: {07a0a145-f680-4a2b-883c-7d91afa322ba}}} }
26872025-01-28T17:53:42.429ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26882025-01-28T17:53:42.429ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26892025-01-28T17:53:42.695ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 33.030761ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26902025-01-28T17:53:42.738ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 85.743683ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26912025-01-28T17:53:42.840ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 117.306773ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26922025-01-28T17:53:42.971ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 586.681702ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26932025-01-28T17:53:43.574ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 476.823049ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26942025-01-28T17:53:44.069ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 732.682722ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26952025-01-28T17:53:44.811ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 722.033618ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
26962025-01-28T17:53:45.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55241
26972025-01-28T17:53:45.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38750
26982025-01-28T17:53:45.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34059
26992025-01-28T17:53:45.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34059 req_id = 110b0830-7a16-47a4-a8d7-a17e473bcffb response_code = 200 uri = /vpc-routes
27002025-01-28T17:53:45.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46255
27012025-01-28T17:53:45.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46255 req_id = 6ca560b0-8358-40d5-8c24-a0d05fa69d2c response_code = 200 uri = /v2p
27022025-01-28T17:53:45.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {e581addc-6ac6-44e5-8b7e-32350c348f75: {10.151.2.176: {07a0a145-f680-4a2b-883c-7d91afa322ba}, 10.151.2.175: {07a0a145-f680-4a2b-883c-7d91afa322ba}}} }
27032025-01-28T17:53:45.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34059 req_id = a81da4bf-19bb-4e30-b55f-7f4c04bf6db2 response_code = 204 uri = /eip-gateways
27042025-01-28T17:53:45.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56924
27052025-01-28T17:53:45.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58954
27062025-01-28T17:53:45.309ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27072025-01-28T17:53:45.360ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27082025-01-28T17:53:45.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117499 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58954 req_id = cae29c89-8a01-445f-a200-70d8c49ca4de response_code = 204 uri = /switch-ports
27092025-01-28T17:53:45.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46459
27102025-01-28T17:53:45.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46459 req_id = 010fa53d-9c1d-473b-a38e-9fb1ba0a5f7e response_code = 200 uri = /vpc-routes
27112025-01-28T17:53:45.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58954 req_id = 11307f2c-8824-41ce-a7d2-e7eeedb126e7 response_code = 200 uri = /network-bootstore-config
27122025-01-28T17:53:45.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48043
27132025-01-28T17:53:45.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48043 req_id = 65f84684-97b9-4109-8e6c-67f83a5c964f response_code = 200 uri = /v2p
27142025-01-28T17:53:45.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62413
27152025-01-28T17:53:45.471ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27162025-01-28T17:53:45.514ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27172025-01-28T17:53:45.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97965 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62413 req_id = 8971fafd-9f60-4bc7-bbbe-04b097ea9b07 response_code = 204 uri = /switch-ports
27182025-01-28T17:53:45.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36846
27192025-01-28T17:53:45.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58909
27202025-01-28T17:53:45.570ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {e581addc-6ac6-44e5-8b7e-32350c348f75: {10.151.2.175: {07a0a145-f680-4a2b-883c-7d91afa322ba}, 10.151.2.176: {07a0a145-f680-4a2b-883c-7d91afa322ba}}} }
27212025-01-28T17:53:45.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4916 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58909 req_id = 7b0095b4-8899-4fc0-83db-e1a26744d3f5 response_code = 200 uri = /v2p
27222025-01-28T17:53:45.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5034 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46459 req_id = 6c96605b-4104-40e8-8d26-957306b8a8a2 response_code = 204 uri = /eip-gateways
27232025-01-28T17:53:45.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27242025-01-28T17:53:45.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10540 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62413 req_id = 93166963-deb0-4971-8d45-27ae87b40573 response_code = 200 uri = /network-bootstore-config
27252025-01-28T17:53:45.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10996 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34059 req_id = 48b08574-7299-49a9-98b9-4a483a001270 response_code = 204 uri = /vpc-routes
27262025-01-28T17:53:45.583ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 597.182658ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27272025-01-28T17:53:45.615ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27282025-01-28T17:53:45.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36846 req_id = 018399ce-b7da-4abd-a5f6-bee3b227997e response_code = 204 uri = /switch-ports
27292025-01-28T17:53:45.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36846 req_id = fa279e8b-f306-4deb-b536-9218d1485070 response_code = 200 uri = /network-bootstore-config
27302025-01-28T17:53:45.686ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 10ac6a8f-5ca2-4d70-b190-b925ea9a1ace, version: 3 } old_vers = RouterVersion { router_id: 10ac6a8f-5ca2-4d70-b190-b925ea9a1ace, version: 3 } subnet = RouterId { vni: Vni(4921519), kind: System }
27312025-01-28T17:53:45.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46459 req_id = 59b03eaf-5e1a-4b6e-815f-a0a424b24244 response_code = 204 uri = /vpc-routes
27322025-01-28T17:53:46.192ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 1.444111141s file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 zone = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27332025-01-28T17:53:47.668ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 file = sled-agent/src/instance.rs:2068 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27342025-01-28T17:53:47.678ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 49.561548ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27352025-01-28T17:53:47.738ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 51.196005ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27362025-01-28T17:53:47.799ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 222.263018ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27372025-01-28T17:53:48.031ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13") failed: Property not found. retry in 424.219103ms file = illumos-utils/src/svc.rs:42 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27382025-01-28T17:53:48.468ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27392025-01-28T17:53:48.503ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27402025-01-28T17:53:48.579ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27412025-01-28T17:53:48.581ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
27422025-01-28T17:53:48.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3277590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56924 req_id = 3c556aba-3819-4a44-a593-7d14f209543d response_code = 200 uri = /vmms/508fdc67-e4e4-4de8-8d20-bb3e3eb24d13/state
27432025-01-28T17:53:48.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3449004 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55241 req_id = f1a67132-dd9c-4e64-bc60-1fc2fa661971 response_code = 200 uri = /vmms/508fdc67-e4e4-4de8-8d20-bb3e3eb24d13/state
27442025-01-28T17:53:48.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3403411 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38750 req_id = 9631f008-1930-4768-b42f-654c3c4cc4ac response_code = 200 uri = /vmms/508fdc67-e4e4-4de8-8d20-bb3e3eb24d13/state
27452025-01-28T17:53:48.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7457678 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48951 req_id = 7dadbb36-f0c8-4a68-ac76-1d75b5959a5f response_code = 204 uri = /eip-gateways
27462025-01-28T17:53:48.582ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-28T17:53:48.582174594Z } file = sled-agent/src/instance.rs:781 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27472025-01-28T17:53:48.582ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-28T17:53:48.582174594Z } propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27482025-01-28T17:53:48.583ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-28T17:53:48.582174594Z }, migration_in: None, migration_out: None }
27492025-01-28T17:53:48.626ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-28T17:53:48.626901138Z } file = sled-agent/src/instance.rs:781 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27502025-01-28T17:53:48.626ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-28T17:53:48.626901138Z } propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27512025-01-28T17:53:48.626ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-28T17:53:48.626901138Z }, migration_in: None, migration_out: None }
27522025-01-28T17:53:48.704ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 10ac6a8f-5ca2-4d70-b190-b925ea9a1ace, version: 3 } old_vers = RouterVersion { router_id: 10ac6a8f-5ca2-4d70-b190-b925ea9a1ace, version: 3 } subnet = RouterId { vni: Vni(4921519), kind: System }
27532025-01-28T17:53:48.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48951 req_id = 75d676f9-5b79-4094-ae8f-c84d3c357648 response_code = 204 uri = /vpc-routes
27542025-01-28T17:53:48.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60814
27552025-01-28T17:53:48.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60814 req_id = edf97762-df76-4acb-87d6-e935ea2531c6 response_code = 200 uri = /vpc-routes
27562025-01-28T17:53:48.855ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {e581addc-6ac6-44e5-8b7e-32350c348f75: {10.151.2.176: {07a0a145-f680-4a2b-883c-7d91afa322ba}, 10.151.2.175: {07a0a145-f680-4a2b-883c-7d91afa322ba}}} }
27572025-01-28T17:53:48.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60814 req_id = b82c6bfb-eda1-467c-903a-881b99bb725c response_code = 204 uri = /eip-gateways
27582025-01-28T17:53:48.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60814 req_id = 59c23b92-ad10-4cf2-9a94-e1482575a2cd response_code = 204 uri = /vpc-routes
27592025-01-28T17:53:56.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7460 local_addr = [fd00:1122:3344:101::1]:39712 method = GET remote_addr = [fd00:1122:3344:101::d]:34912 req_id = 9a5f8309-1726-4e60-af01-9c914b769089 response_code = 200 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 uri = /3f3bc5ca-5950-49d6-a443-b9f8f960dab0
27602025-01-28T17:53:58.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41076
27612025-01-28T17:53:58.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 519 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41076 req_id = f17fd0e4-1f69-4653-a8ad-5a769b56d722 response_code = 200 uri = /vmms/508fdc67-e4e4-4de8-8d20-bb3e3eb24d13/state
27622025-01-28T17:53:58.552ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-28T17:53:58.552736660Z } file = sled-agent/src/instance.rs:781 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27632025-01-28T17:53:58.552ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-28T17:53:58.552736660Z } propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27642025-01-28T17:53:58.552ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-28T17:53:58.552736660Z }, migration_in: None, migration_out: None }
27652025-01-28T17:53:58.565ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-28T17:53:58.565165679Z } file = sled-agent/src/instance.rs:781 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27662025-01-28T17:53:58.565ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-28T17:53:58.565165679Z } propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27672025-01-28T17:53:58.565ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27682025-01-28T17:53:58.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27692025-01-28T17:53:58.565ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 7882820608363702456 n_samples = 6 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
27702025-01-28T17:53:58.565ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 18389021083078180345 n_samples = 6 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
27712025-01-28T17:53:58.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27722025-01-28T17:53:58.565ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/b33f8e45-ef1c-4734-b801-0475dcb207f6/debug/bundle/zone", "/pool/int/d6f75b00-8f28-4662-bf32-9c3356765a1d/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/45c07d49-6fd6-4f8d-b28c-a3f43c3d62a7/crypt/debug", "/pool/ext/d033c793-1184-4faf-a379-2f30181b8b7f/crypt/debug", "/pool/ext/94f0d539-6272-43cf-85f5-da15e180f2ad/crypt/debug", "/pool/ext/d623ca36-204f-4167-b0d2-bf03085fd8a7/crypt/debug", "/pool/ext/d69f461c-d55e-48a5-9816-173eae69537e/crypt/debug", "/pool/ext/7d23e6c8-6805-4a21-bee4-ece464779811/crypt/debug", "/pool/ext/37b8192c-9236-4941-bad3-2ab9840de50c/crypt/debug", "/pool/ext/da44c06d-1c73-487e-9c46-5eba2365be55/crypt/debug", "/pool/ext/be3dfabc-4e5d-4d5b-b447-b58a8bfc3a04/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27732025-01-28T17:53:59.208ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13", bundle_id: f49da91d-a420-490b-aeec-ed640d891ff5 }, time_created: 2025-01-28T17:53:58.566111207Z, version: 0, cause: TerminatedInstance }
27742025-01-28T17:53:59.208ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 file = sled-agent/src/instance.rs:1314 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27752025-01-28T17:54:00.963ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27762025-01-28T17:54:00.980ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4921519), kind: System }
27772025-01-28T17:54:00.980ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4921519), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27782025-01-28T17:54:00.981ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-28T17:54:00.981090240Z }, migration_in: None, migration_out: None }
27792025-01-28T17:54:01.020ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-28T17:54:00.981090240Z }, migration_in: None, migration_out: None }
27802025-01-28T17:54:01.024ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = 4543ce72-670d-4dca-beee-bed47b56e431 propolis_id = 508fdc67-e4e4-4de8-8d20-bb3e3eb24d13
27812025-01-28T17:54:01.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39840
27822025-01-28T17:54:01.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39840 req_id = cf581ad9-3234-42f9-9217-65ecab2f1d5f response_code = 200 uri = /vpc-routes
27832025-01-28T17:54:01.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
27842025-01-28T17:54:01.505ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0
27852025-01-28T17:54:01.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39840 req_id = a3441dce-833e-4c6a-807e-62920e23e278 response_code = 204 uri = /eip-gateways
27862025-01-28T17:54:01.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39840 req_id = 649ecb95-15a1-49b3-8b0c-52ed03858d34 response_code = 204 uri = /vpc-routes
27872025-01-28T17:54:01.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45721
27882025-01-28T17:54:01.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45721 req_id = 16c75716-704e-4730-b130-60b9e32f40df response_code = 200 uri = /v2p
27892025-01-28T17:54:02.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44137
27902025-01-28T17:54:02.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44137 req_id = 7250579f-b5e3-4186-b06e-d8b8bc1d2074 response_code = 200 uri = /vpc-routes
27912025-01-28T17:54:02.081ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
27922025-01-28T17:54:02.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44137 req_id = 70f99e4b-74a2-4e04-bf7f-7ad19a431630 response_code = 204 uri = /eip-gateways
27932025-01-28T17:54:02.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44137 req_id = 2b871a84-e30e-48ba-aa92-4ad8b5e2c4c4 response_code = 204 uri = /vpc-routes
27942025-01-28T17:54:02.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34710
27952025-01-28T17:54:02.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34710 req_id = 3e0a3394-e95e-4735-90fe-8a4b5fb01b1b response_code = 200 uri = /v2p
27962025-01-28T17:54:02.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56940
27972025-01-28T17:54:02.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56940 req_id = a028cedd-2041-4bc6-88ce-e600c6486041 response_code = 200 uri = /vpc-routes
27982025-01-28T17:54:02.810ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 3f3bc5ca-5950-49d6-a443-b9f8f960dab0 values = ExternalIpGatewayMap { mappings: {} }
27992025-01-28T17:54:02.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56940 req_id = 90d8fb5a-49d2-4522-90df-263aefe10bea response_code = 204 uri = /eip-gateways
28002025-01-28T17:54:02.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56940 req_id = 27cb7337-32f6-4053-8f03-2cbc91e364c9 response_code = 204 uri = /vpc-routes