Max level shown:
1 [ Jan 10 05:03:17 Enabled. ]
2 [ Jan 10 05:03:17 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 10 05:03:17 Method "start" exited with status 0. ]
4 [ Jan 10 05:03:17 Rereading configuration. ]
5 [ Jan 10 05:03:17 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-10T05:03:17.677ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-10T05:03:17.678ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-10T05:03:17.730ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-10T05:03:17.730ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-10T05:03:17.844ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-10T05:03:17.854ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-10T05:03:17.862ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-10T05:03:18.466ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-10T05:03:18.606ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-10T05:03:18.606ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-10T05:03:18.606ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-10T05:03:18.606ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-10T05:03:18.606ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-01-10T05:03:18.606ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-10T05:03:18.609ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-10T05:03:18.609ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-10T05:03:18.609ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-10T05:03:18.609ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-10T05:03:18.609ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-10T05:03:18.609ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-10T05:03:18.609ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-10T05:03:18.609ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-10T05:03:18.609ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-10T05:03:18.621ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-10T05:03:18.621ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool)
322025-01-10T05:03:18.739ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal }
332025-01-10T05:03:19.188ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-10T05:03:19.188ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-10T05:03:19.188ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-10T05:03:19.188ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-10T05:03:19.188ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-10T05:03:19.188ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-10T05:03:19.188ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-10T05:03:19.197ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-10T05:03:19.197ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 03344b71-863f-4057-bb5e-476456797573 (zpool)
422025-01-10T05:03:19.308ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal }
432025-01-10T05:03:19.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
472025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482025-01-10T05:03:19.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-10T05:03:19.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-10T05:03:19.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-10T05:03:19.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-10T05:03:19.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-10T05:03:19.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632025-01-10T05:03:19.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672025-01-10T05:03:19.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
692025-01-10T05:03:19.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732025-01-10T05:03:19.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-10T05:03:19.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-10T05:03:19.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
822025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842025-01-10T05:03:19.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-10T05:03:19.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-10T05:03:19.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-10T05:03:19.761ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
942025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
952025-01-10T05:03:19.761ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
962025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-10T05:03:19.761ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-10T05:03:19.761ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-10T05:03:19.761ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-01-10T05:03:19.761ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-01-10T05:03:19.761ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-10T05:03:19.761ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-10T05:03:19.761ZINFOSledAgent (bootstore): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-10T05:03:19.761ZINFOSledAgent (bootstore): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-10T05:03:19.761ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-10T05:03:19.761ZINFOSledAgent (bootstore): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-10T05:03:19.761ZINFOSledAgent (bootstore): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-10T05:03:19.761ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-10T05:03:19.761ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-10T05:03:19.761ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-10T05:03:19.773ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:748
1132025-01-10T05:03:19.773ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 26810, tv_nsec: 737934445 } time_to_next_cleanup = 599.999913487s
1142025-01-10T05:03:19.773ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
1152025-01-10T05:03:19.773ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-10T05:03:19.773ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-10T05:03:19.776ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-10T05:03:19.776ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-10T05:03:19.778ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-10T05:03:19.778ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-10T05:03:19.778ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-10T05:03:19.779ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-10T05:03:19.779ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-10T05:03:19.779ZINFOSledAgent (RSS): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-10T05:03:19.779ZINFOSledAgent (RSS): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-10T05:03:19.779ZINFOSledAgent (RSS): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-10T05:03:19.779ZINFOSledAgent (RSS): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-10T05:03:19.779ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-10T05:03:19.779ZINFOSledAgent (RSS): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-10T05:03:19.779ZINFOSledAgent (RSS): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-10T05:03:19.779ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-10T05:03:19.779ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-10T05:03:19.779ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-10T05:03:19.779ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-10T05:03:19.779ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-10T05:03:19.779ZINFOSledAgent (bootstore): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-10T05:03:19.779ZINFOSledAgent (bootstore): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-10T05:03:19.779ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-10T05:03:19.779ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 (sled), rack_id: 79fde928-482f-41ab-aee3-3f2478145f08, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-10T05:03:19.780ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4270
1412025-01-10T05:03:19.780ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4664
1422025-01-10T05:03:19.785ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-10T05:03:19.790ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-10T05:03:19.791ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-10T05:03:19.795ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-10T05:03:19.795ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-10T05:03:19.795ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:44741
1482025-01-10T05:03:19.795ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 (sled), rack_id: 79fde928-482f-41ab-aee3-3f2478145f08, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-10T05:03:19.795ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-10T05:03:19.796ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-10T05:03:19.796ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-10T05:03:19.796ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-10T05:03:19.796ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-10T05:03:19.796ZINFOSledAgent (StorageManager): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-10T05:03:19.796ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562025-01-10T05:03:19.796ZINFOSledAgent (StorageManager): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-10T05:03:19.796ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-10T05:03:19.796ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-10T05:03:19.796ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-10T05:03:19.796ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-10T05:03:19.796ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-10T05:03:19.811ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-10T05:03:19.830ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-10T05:03:19.848ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-10T05:03:19.855ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1662025-01-10T05:03:19.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-10T05:03:19.855ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1682025-01-10T05:03:19.855ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-10T05:03:19.858ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 81.036091ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "210300bd-4622-4a3f-9065-44e1b71fa0e4", "content-length": "124", "date": "Fri, 10 Jan 2025 05:03:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "210300bd-4622-4a3f-9065-44e1b71fa0e4" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-10T05:03:19.868ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_18bf51d7-5505-48c1-a181-3dfd285cd8e8/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-10T05:03:19.896ZINFOSledAgent: successfully created encrypted zvol: name="oxi_18bf51d7-5505-48c1-a181-3dfd285cd8e8/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-10T05:03:19.896ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_18bf51d7-5505-48c1-a181-3dfd285cd8e8/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-10T05:03:19.902ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1742025-01-10T05:03:19.902ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-10T05:03:19.902ZINFOSledAgent (BackingFs): Ensuring dataset oxi_18bf51d7-5505-48c1-a181-3dfd285cd8e8/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-10T05:03:19.940ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-10T05:03:19.943ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 158.801372ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4810d9e3-51e4-44ed-a7ae-cda86baecb0c", "content-length": "124", "date": "Fri, 10 Jan 2025 05:03:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4810d9e3-51e4-44ed-a7ae-cda86baecb0c" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-10T05:03:19.977ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-10T05:03:20.103ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-10T05:03:20.104ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 158.299411ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ccf8d4a0-3e5a-40e1-bd7f-1db583af6a19", "content-length": "124", "date": "Fri, 10 Jan 2025 05:03:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ccf8d4a0-3e5a-40e1-bd7f-1db583af6a19" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-10T05:03:20.195ZINFOSledAgent (BackingFs): Mounting oxi_18bf51d7-5505-48c1-a181-3dfd285cd8e8/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-10T05:03:20.208ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-10T05:03:20.208ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-10T05:03:20.208ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-10T05:03:20.208ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-10T05:03:20.263ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-10T05:03:20.264ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 195.160011ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5a349235-7b2a-481b-a5c0-6e93b1d238fa", "content-length": "124", "date": "Fri, 10 Jan 2025 05:03:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5a349235-7b2a-481b-a5c0-6e93b1d238fa" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-10T05:03:20.459ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-10T05:03:20.460ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 238.819394ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c201b11c-c24c-4ec5-9a07-8c3f38090ace", "content-length": "124", "date": "Fri, 10 Jan 2025 05:03:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c201b11c-c24c-4ec5-9a07-8c3f38090ace" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-10T05:03:20.699ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-10T05:03:20.700ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 275.120264ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7b8cdb70-0088-4c33-af4a-906bc8793e0e", "content-length": "124", "date": "Fri, 10 Jan 2025 05:03:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7b8cdb70-0088-4c33-af4a-906bc8793e0e" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-10T05:03:20.961ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1932025-01-10T05:03:20.969ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:61625 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1942025-01-10T05:03:20.969ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1952025-01-10T05:03:20.969ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:61625 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1962025-01-10T05:03:20.970ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 333.544888ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1972025-01-10T05:03:20.971ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1982025-01-10T05:03:20.971ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
1992025-01-10T05:03:20.971ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:932 underlay_address = fd00:1122:3344:101::1
2002025-01-10T05:03:20.971ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012025-01-10T05:03:20.976ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022025-01-10T05:03:21.305ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 725.572163ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2032025-01-10T05:03:22.032ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 920.309015ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2042025-01-10T05:03:22.954ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.800196149s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2052025-01-10T05:03:23.493ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2694
2062025-01-10T05:03:23.493ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2939
2072025-01-10T05:03:23.493ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2564
2082025-01-10T05:03:23.493ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2611
2092025-01-10T05:03:23.493ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3020
2102025-01-10T05:03:23.493ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3065
2112025-01-10T05:03:23.495ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2864
2122025-01-10T05:03:23.496ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2605
2132025-01-10T05:03:23.497ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='31594f6f-4134-43a3-9b3f-719235123b6c'/> <propval type="astring" name="rack_id" value='79fde928-482f-41ab-aee3-3f2478145f08'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe41:794f'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='79fde928-482f-41ab-aee3-3f2478145f08'/> <propval type="astring" name="sled_id" value='a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59'/> <propval type="astring" name="rack_uuid" value='79fde928-482f-41ab-aee3-3f2478145f08'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59'/> <propval type="astring" name="rack_uuid" value='79fde928-482f-41ab-aee3-3f2478145f08'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-01-10T05:03:23.497ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152025-01-10T05:03:23.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 69.167149ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162025-01-10T05:03:23.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 72.298766ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172025-01-10T05:03:24.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 103.401925ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182025-01-10T05:03:24.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 275.297417ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192025-01-10T05:03:24.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 963.933789ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-10T05:03:24.756ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.045907509s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2212025-01-10T05:03:25.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 569.332584ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222025-01-10T05:03:26.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 729.808944ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232025-01-10T05:03:27.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 765.078559ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-10T05:03:28.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 850.207672ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252025-01-10T05:03:28.803ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.161660085s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2262025-01-10T05:03:29.373ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/nexus.rs:527 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2272025-01-10T05:03:29.403ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282025-01-10T05:03:29.404ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2292025-01-10T05:03:29.405ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2302025-01-10T05:03:29.405ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312025-01-10T05:03:29.405ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322025-01-10T05:03:29.405ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-01-10T05:03:29.405ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-10T05:03:29.405ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352025-01-10T05:03:29.406ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362025-01-10T05:03:29.406ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
2372025-01-10T05:03:29.406ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:44741
2382025-01-10T05:03:29.586ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2392025-01-10T05:03:29.586ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2402025-01-10T05:03:29.591ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4294 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412025-01-10T05:03:30.540ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/probe_manager.rs:231 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2422025-01-10T05:03:30.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50432
2432025-01-10T05:03:30.541ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442025-01-10T05:03:30.541ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-01-10T05:03:30.541ZINFOSledAgent (ServiceManager): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:188
2462025-01-10T05:03:30.541ZINFOSledAgent (ServiceManager): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-01-10T05:03:30.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50432 req_id = 5ad7de93-e17a-40bd-811f-542f189fef39 response_code = 200 uri = /inventory
2482025-01-10T05:03:30.778ZINFOSledAgent (ServiceManager): refreshed zone-network-setup service with new configuration file = sled-agent/src/services.rs:4343
2492025-01-10T05:03:30.778ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4401
2502025-01-10T05:03:30.990ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2512025-01-10T05:03:30.992ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1343461989832016708 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2522025-01-10T05:03:30.993ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4658672294461489299 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2532025-01-10T05:03:31.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59975
2542025-01-10T05:03:31.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59975 req_id = f3a6172f-2a33-4dce-b6b3-11b4cf47f2d6 response_code = 200 uri = /sled-role
2552025-01-10T05:03:31.061ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9a57f2bb-3dcb-435c-9b99-1f9568518aa0 (physical_disk), pool_id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 373f6d13-5433-475c-a870-df48eb715b6b (physical_disk), pool_id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 3f72603e-d5c3-4514-b2b7-dd554ae055ec (physical_disk), pool_id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0f7bf04e-3c50-4f01-b48a-879fea6a1faf (physical_disk), pool_id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 4d12a70b-3f38-40d6-b718-bdfc6ee60ace (physical_disk), pool_id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 265d7646-2148-4136-9208-00bc760aefb9 (physical_disk), pool_id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b3bfab79-778c-4322-b079-21f815959825 (physical_disk), pool_id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 90fd0ed1-1c71-44cf-adb9-e2286729c1fc (physical_disk), pool_id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 3d6187ff-24bb-47ab-bfff-b21db96abfae (physical_disk), pool_id: 49894127-b79c-4807-aac5-383699d40578 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2562025-01-10T05:03:31.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58616
2572025-01-10T05:03:31.062ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
2582025-01-10T05:03:31.062ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9a57f2bb-3dcb-435c-9b99-1f9568518aa0 (physical_disk), pool_id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 373f6d13-5433-475c-a870-df48eb715b6b (physical_disk), pool_id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 3f72603e-d5c3-4514-b2b7-dd554ae055ec (physical_disk), pool_id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0f7bf04e-3c50-4f01-b48a-879fea6a1faf (physical_disk), pool_id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 4d12a70b-3f38-40d6-b718-bdfc6ee60ace (physical_disk), pool_id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 265d7646-2148-4136-9208-00bc760aefb9 (physical_disk), pool_id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b3bfab79-778c-4322-b079-21f815959825 (physical_disk), pool_id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 90fd0ed1-1c71-44cf-adb9-e2286729c1fc (physical_disk), pool_id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 3d6187ff-24bb-47ab-bfff-b21db96abfae (physical_disk), pool_id: 49894127-b79c-4807-aac5-383699d40578 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2592025-01-10T05:03:31.062ZINFOSledAgent (StorageManager): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602025-01-10T05:03:31.062ZINFOSledAgent (StorageManager): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2612025-01-10T05:03:31.062ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2622025-01-10T05:03:31.062ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2632025-01-10T05:03:31.062ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2642025-01-10T05:03:31.062ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2652025-01-10T05:03:31.062ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2662025-01-10T05:03:31.074ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2672025-01-10T05:03:31.074ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool)
2682025-01-10T05:03:31.132ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4467
2692025-01-10T05:03:31.132ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4494
2702025-01-10T05:03:31.173ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4507
2712025-01-10T05:03:31.173ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4353
2722025-01-10T05:03:31.199ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }
2732025-01-10T05:03:31.209ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2742025-01-10T05:03:31.209ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2752025-01-10T05:03:31.209ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2762025-01-10T05:03:31.209ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2772025-01-10T05:03:31.209ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2782025-01-10T05:03:31.209ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2792025-01-10T05:03:31.209ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2802025-01-10T05:03:31.229ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4395
2812025-01-10T05:03:31.229ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4474 rack_subnet = fd00:1122:3344::
2822025-01-10T05:03:31.249ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4485
2832025-01-10T05:03:31.249ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4527
2842025-01-10T05:03:31.253ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2852025-01-10T05:03:31.263ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone file = sled-storage/src/dataset.rs:302
2862025-01-10T05:03:31.435ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1 file = sled-storage/src/dataset.rs:388
2872025-01-10T05:03:31.443ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2882025-01-10T05:03:31.443ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2892025-01-10T05:03:31.443ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2902025-01-10T05:03:31.443ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2912025-01-10T05:03:31.443ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2922025-01-10T05:03:31.452ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2932025-01-10T05:03:31.452ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool)
2942025-01-10T05:03:31.564ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }
2952025-01-10T05:03:31.572ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2962025-01-10T05:03:31.572ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2972025-01-10T05:03:31.572ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2982025-01-10T05:03:31.572ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2992025-01-10T05:03:31.572ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3002025-01-10T05:03:31.572ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3012025-01-10T05:03:31.572ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3022025-01-10T05:03:31.575ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/probe_manager.rs:231 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
3032025-01-10T05:03:31.614ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3042025-01-10T05:03:31.623ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone file = sled-storage/src/dataset.rs:302
3052025-01-10T05:03:31.791ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1ceb1ad5-1952-4abe-b542-37b814690640 file = sled-storage/src/dataset.rs:388
3062025-01-10T05:03:31.800ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3072025-01-10T05:03:31.800ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3082025-01-10T05:03:31.800ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3092025-01-10T05:03:31.800ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3102025-01-10T05:03:31.800ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3112025-01-10T05:03:31.809ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3122025-01-10T05:03:31.809ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool)
3132025-01-10T05:03:31.926ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }
3142025-01-10T05:03:31.934ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3152025-01-10T05:03:31.934ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3162025-01-10T05:03:31.934ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3172025-01-10T05:03:31.934ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3182025-01-10T05:03:31.934ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3192025-01-10T05:03:31.934ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3202025-01-10T05:03:31.934ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3212025-01-10T05:03:31.976ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3222025-01-10T05:03:31.985ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone file = sled-storage/src/dataset.rs:302
3232025-01-10T05:03:32.156ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f file = sled-storage/src/dataset.rs:388
3242025-01-10T05:03:32.164ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3252025-01-10T05:03:32.164ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3262025-01-10T05:03:32.164ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3272025-01-10T05:03:32.164ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3282025-01-10T05:03:32.164ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3292025-01-10T05:03:32.174ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3302025-01-10T05:03:32.174ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 721ba211-f349-4837-89b3-f4cf559302bb (zpool)
3312025-01-10T05:03:32.286ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }
3322025-01-10T05:03:32.294ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3332025-01-10T05:03:32.294ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3342025-01-10T05:03:32.294ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3352025-01-10T05:03:32.294ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3362025-01-10T05:03:32.294ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3372025-01-10T05:03:32.294ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3382025-01-10T05:03:32.294ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3392025-01-10T05:03:32.335ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3402025-01-10T05:03:32.343ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_721ba211-f349-4837-89b3-f4cf559302bb/crypt/zone file = sled-storage/src/dataset.rs:302
3412025-01-10T05:03:32.514ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_721ba211-f349-4837-89b3-f4cf559302bb file = sled-storage/src/dataset.rs:388
3422025-01-10T05:03:32.522ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3432025-01-10T05:03:32.522ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3442025-01-10T05:03:32.522ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3452025-01-10T05:03:32.522ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3462025-01-10T05:03:32.522ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3472025-01-10T05:03:32.532ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3482025-01-10T05:03:32.532ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool)
3492025-01-10T05:03:32.642ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }
3502025-01-10T05:03:32.650ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3512025-01-10T05:03:32.650ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3522025-01-10T05:03:32.650ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3532025-01-10T05:03:32.650ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3542025-01-10T05:03:32.650ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3552025-01-10T05:03:32.650ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3562025-01-10T05:03:32.650ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3572025-01-10T05:03:32.692ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3582025-01-10T05:03:32.697ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/probe_manager.rs:231 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
3592025-01-10T05:03:32.701ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone file = sled-storage/src/dataset.rs:302
3602025-01-10T05:03:32.866ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49 file = sled-storage/src/dataset.rs:388
3612025-01-10T05:03:32.874ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3622025-01-10T05:03:32.874ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3632025-01-10T05:03:32.874ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3642025-01-10T05:03:32.874ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3652025-01-10T05:03:32.874ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3662025-01-10T05:03:32.884ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3672025-01-10T05:03:32.884ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 19b37234-d205-4094-b223-ad0e72e9c46e (zpool)
3682025-01-10T05:03:32.995ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }
3692025-01-10T05:03:33.003ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3702025-01-10T05:03:33.003ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3712025-01-10T05:03:33.003ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3722025-01-10T05:03:33.003ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3732025-01-10T05:03:33.003ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3742025-01-10T05:03:33.003ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3752025-01-10T05:03:33.003ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3762025-01-10T05:03:33.006ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 17.347877711s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
3772025-01-10T05:03:33.043ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3782025-01-10T05:03:33.050ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_19b37234-d205-4094-b223-ad0e72e9c46e/crypt/zone file = sled-storage/src/dataset.rs:302
3792025-01-10T05:03:33.213ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_19b37234-d205-4094-b223-ad0e72e9c46e file = sled-storage/src/dataset.rs:388
3802025-01-10T05:03:33.221ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3812025-01-10T05:03:33.221ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3822025-01-10T05:03:33.221ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3832025-01-10T05:03:33.221ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3842025-01-10T05:03:33.221ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3852025-01-10T05:03:33.231ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3862025-01-10T05:03:33.231ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5c7c8012-1908-4829-b530-3992d83456e0 (zpool)
3872025-01-10T05:03:33.347ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }
3882025-01-10T05:03:33.355ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3892025-01-10T05:03:33.355ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3902025-01-10T05:03:33.355ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3912025-01-10T05:03:33.355ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3922025-01-10T05:03:33.355ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3932025-01-10T05:03:33.355ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3942025-01-10T05:03:33.355ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3952025-01-10T05:03:33.400ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3962025-01-10T05:03:33.409ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5c7c8012-1908-4829-b530-3992d83456e0/crypt/zone file = sled-storage/src/dataset.rs:302
3972025-01-10T05:03:33.583ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5c7c8012-1908-4829-b530-3992d83456e0 file = sled-storage/src/dataset.rs:388
3982025-01-10T05:03:33.591ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3992025-01-10T05:03:33.591ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4002025-01-10T05:03:33.591ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4012025-01-10T05:03:33.591ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4022025-01-10T05:03:33.591ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4032025-01-10T05:03:33.601ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4042025-01-10T05:03:33.601ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool)
4052025-01-10T05:03:33.743ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }
4062025-01-10T05:03:33.751ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4072025-01-10T05:03:33.751ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4082025-01-10T05:03:33.751ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4092025-01-10T05:03:33.751ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4102025-01-10T05:03:33.751ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4112025-01-10T05:03:33.751ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4122025-01-10T05:03:33.751ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4132025-01-10T05:03:33.757ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/probe_manager.rs:231 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4142025-01-10T05:03:33.797ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4152025-01-10T05:03:33.805ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/zone file = sled-storage/src/dataset.rs:302
4162025-01-10T05:03:33.968ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794 file = sled-storage/src/dataset.rs:388
4172025-01-10T05:03:33.976ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4182025-01-10T05:03:33.976ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4192025-01-10T05:03:33.976ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4202025-01-10T05:03:33.976ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4212025-01-10T05:03:33.976ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4222025-01-10T05:03:33.985ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4232025-01-10T05:03:33.985ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 49894127-b79c-4807-aac5-383699d40578 (zpool)
4242025-01-10T05:03:34.105ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }
4252025-01-10T05:03:34.113ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4262025-01-10T05:03:34.113ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4272025-01-10T05:03:34.113ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4282025-01-10T05:03:34.113ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4292025-01-10T05:03:34.113ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4302025-01-10T05:03:34.113ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4312025-01-10T05:03:34.113ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4322025-01-10T05:03:34.155ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4332025-01-10T05:03:34.162ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_49894127-b79c-4807-aac5-383699d40578/crypt/zone file = sled-storage/src/dataset.rs:302
4342025-01-10T05:03:34.327ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_49894127-b79c-4807-aac5-383699d40578 file = sled-storage/src/dataset.rs:388
4352025-01-10T05:03:34.334ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4362025-01-10T05:03:34.334ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4372025-01-10T05:03:34.334ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4382025-01-10T05:03:34.334ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18bf51d7-5505-48c1-a181-3dfd285cd8e8 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03344b71-863f-4057-bb5e-476456797573 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4392025-01-10T05:03:34.334ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4402025-01-10T05:03:34.334ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4412025-01-10T05:03:34.334ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4422025-01-10T05:03:34.335ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4432025-01-10T05:03:34.335ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4442025-01-10T05:03:34.335ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4452025-01-10T05:03:34.335ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4462025-01-10T05:03:34.335ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4472025-01-10T05:03:34.335ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4482025-01-10T05:03:34.335ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4492025-01-10T05:03:34.335ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4502025-01-10T05:03:34.335ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4512025-01-10T05:03:34.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3273027 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58616 req_id = ead1f85a-c1fc-4faa-9be4-365f6039d368 response_code = 200 uri = /omicron-physical-disks
4522025-01-10T05:03:34.367ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {002e2136-eb9d-4524-b129-8c5f0e81c4e9 (dataset): DatasetConfig { id: 002e2136-eb9d-4524-b129-8c5f0e81c4e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 00c1db0d-d282-47b5-9989-cbf2fb0d54fa (dataset): DatasetConfig { id: 00c1db0d-d282-47b5-9989-cbf2fb0d54fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0776a3b4-d5a9-464c-94c1-d5f87114e2c3 (dataset): DatasetConfig { id: 0776a3b4-d5a9-464c-94c1-d5f87114e2c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 095145c1-c1de-4221-9048-21f889f9407c (dataset): DatasetConfig { id: 095145c1-c1de-4221-9048-21f889f9407c (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e08af02-afc8-431c-92e6-dd11d7488e22 (dataset): DatasetConfig { id: 0e08af02-afc8-431c-92e6-dd11d7488e22 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10bb8921-69be-4a82-b0b0-ee64b606c5a8 (dataset): DatasetConfig { id: 10bb8921-69be-4a82-b0b0-ee64b606c5a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12db8c95-022b-4d9f-9d65-4b2cfd31e284 (dataset): DatasetConfig { id: 12db8c95-022b-4d9f-9d65-4b2cfd31e284 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15b70950-7a96-4831-a9dc-8cc38ace31a1 (dataset): DatasetConfig { id: 15b70950-7a96-4831-a9dc-8cc38ace31a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1826c996-3e17-4489-a039-0061406a5f3a (dataset): DatasetConfig { id: 1826c996-3e17-4489-a039-0061406a5f3a (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b76a6cc-b082-4710-bf9d-c6e9441950f2 (dataset): DatasetConfig { id: 1b76a6cc-b082-4710-bf9d-c6e9441950f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dd701f4-735f-468d-9301-4556efecc18d (dataset): DatasetConfig { id: 1dd701f4-735f-468d-9301-4556efecc18d (dataset), name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1e0196cd-0d1e-40e3-a86e-a8eb20bca161 (dataset): DatasetConfig { id: 1e0196cd-0d1e-40e3-a86e-a8eb20bca161 (dataset), name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f5f4ec6-a25b-4cfe-9641-88ed5bab1d7b (dataset): DatasetConfig { id: 1f5f4ec6-a25b-4cfe-9641-88ed5bab1d7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27080678-b5ee-4893-addb-ae73b88915cb (dataset): DatasetConfig { id: 27080678-b5ee-4893-addb-ae73b88915cb (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 288097d3-d053-4038-9bf7-d5cc297d1e75 (dataset): DatasetConfig { id: 288097d3-d053-4038-9bf7-d5cc297d1e75 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29358660-9a74-44a4-aa8f-678f92e05346 (dataset): DatasetConfig { id: 29358660-9a74-44a4-aa8f-678f92e05346 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29ecb36c-b0ce-497f-8e5d-532807222420 (dataset): DatasetConfig { id: 29ecb36c-b0ce-497f-8e5d-532807222420 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3242a75c-1aca-4ccf-a2f2-8d1625619a50 (dataset): DatasetConfig { id: 3242a75c-1aca-4ccf-a2f2-8d1625619a50 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3502d19c-901f-4ef2-8e54-abf1589c122f (dataset): DatasetConfig { id: 3502d19c-901f-4ef2-8e54-abf1589c122f (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36f0d09c-c425-4eaf-845b-7d578d8aa486 (dataset): DatasetConfig { id: 36f0d09c-c425-4eaf-845b-7d578d8aa486 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 41cc741e-b401-47be-99b4-1250c3df8a4c (dataset): DatasetConfig { id: 41cc741e-b401-47be-99b4-1250c3df8a4c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c2d8176-792a-4365-8936-0f7d9fca7d1c (dataset): DatasetConfig { id: 4c2d8176-792a-4365-8936-0f7d9fca7d1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c95f667-219b-4237-a879-aa27ce43db21 (dataset): DatasetConfig { id: 4c95f667-219b-4237-a879-aa27ce43db21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51d2b6cb-bf74-4fef-9f12-e2d42e0c1fc9 (dataset): DatasetConfig { id: 51d2b6cb-bf74-4fef-9f12-e2d42e0c1fc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5425fd63-ddb8-4c8c-9007-a0b721b70c34 (dataset): DatasetConfig { id: 5425fd63-ddb8-4c8c-9007-a0b721b70c34 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59c935c7-d3cb-4372-8d1c-8e11ade9f9cb (dataset): DatasetConfig { id: 59c935c7-d3cb-4372-8d1c-8e11ade9f9cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b20d56a-67b7-4c71-85f8-34bd25dbf02c (dataset): DatasetConfig { id: 5b20d56a-67b7-4c71-85f8-34bd25dbf02c (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d62c4af-76a9-4807-bfa8-838c8bb03021 (dataset): DatasetConfig { id: 5d62c4af-76a9-4807-bfa8-838c8bb03021 (dataset), name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5dded717-3abb-490a-94e9-2b14f1f16645 (dataset): DatasetConfig { id: 5dded717-3abb-490a-94e9-2b14f1f16645 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 612fa0cb-affc-47b9-b8db-bc125594c5bc (dataset): DatasetConfig { id: 612fa0cb-affc-47b9-b8db-bc125594c5bc (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 69fe7bed-a3e0-4387-ba79-0c334fac5b95 (dataset): DatasetConfig { id: 69fe7bed-a3e0-4387-ba79-0c334fac5b95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72e69f43-0464-4988-88d8-36607646ac03 (dataset): DatasetConfig { id: 72e69f43-0464-4988-88d8-36607646ac03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 788d1c2b-8db7-4bcf-a8aa-7258cd5c1e3d (dataset): DatasetConfig { id: 788d1c2b-8db7-4bcf-a8aa-7258cd5c1e3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bf0a845-7c8e-413e-92c6-122cff2a1aea (dataset): DatasetConfig { id: 7bf0a845-7c8e-413e-92c6-122cff2a1aea (dataset), name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84cbfe90-2c25-491d-a602-208d245a2ad5 (dataset): DatasetConfig { id: 84cbfe90-2c25-491d-a602-208d245a2ad5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 939e74a2-b9b9-4f5c-8d42-39fcb8fc64b9 (dataset): DatasetConfig { id: 939e74a2-b9b9-4f5c-8d42-39fcb8fc64b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 991f75a4-a104-4143-94e8-1eea8f1e9ca1 (dataset): DatasetConfig { id: 991f75a4-a104-4143-94e8-1eea8f1e9ca1 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9961a326-cd12-4f1b-b729-2bcc5b137ebe (dataset): DatasetConfig { id: 9961a326-cd12-4f1b-b729-2bcc5b137ebe (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ef454f0-0f8c-43a0-ac34-8a8e56b6c832 (dataset): DatasetConfig { id: 9ef454f0-0f8c-43a0-ac34-8a8e56b6c832 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a5275319-f258-4c8e-a353-62b16bd27107 (dataset): DatasetConfig { id: a5275319-f258-4c8e-a353-62b16bd27107 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, abb80a93-1621-4672-a65e-8bd904dc3c05 (dataset): DatasetConfig { id: abb80a93-1621-4672-a65e-8bd904dc3c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3c8fbe4-c5cf-49c5-87b8-978f43575577 (dataset): DatasetConfig { id: b3c8fbe4-c5cf-49c5-87b8-978f43575577 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4b8b942-9a7b-48cb-bc52-7340d3e3d12b (dataset): DatasetConfig { id: b4b8b942-9a7b-48cb-bc52-7340d3e3d12b (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d250f5-0ecc-40e6-a827-b1ea7d7a7713 (dataset): DatasetConfig { id: b6d250f5-0ecc-40e6-a827-b1ea7d7a7713 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8bec7e3-eb15-4f25-9510-256810148762 (dataset): DatasetConfig { id: b8bec7e3-eb15-4f25-9510-256810148762 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, baa212ba-0678-4487-a3f6-4e85bcbcdcc8 (dataset): DatasetConfig { id: baa212ba-0678-4487-a3f6-4e85bcbcdcc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1b0302b-2289-4ef5-815c-faa51bf4936b (dataset): DatasetConfig { id: c1b0302b-2289-4ef5-815c-faa51bf4936b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1b1a239-bdc3-422b-83de-f413f6919429 (dataset): DatasetConfig { id: c1b1a239-bdc3-422b-83de-f413f6919429 (dataset), name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c25aabd3-349e-4c2b-9394-743486a7c3b0 (dataset): DatasetConfig { id: c25aabd3-349e-4c2b-9394-743486a7c3b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ef1643-3eab-4f8f-bd76-68c0d58bfb6a (dataset): DatasetConfig { id: c3ef1643-3eab-4f8f-bd76-68c0d58bfb6a (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c50e48dc-1504-4f58-a9de-06874ae666c6 (dataset): DatasetConfig { id: c50e48dc-1504-4f58-a9de-06874ae666c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce768689-3fe5-4679-9779-783a0b229610 (dataset): DatasetConfig { id: ce768689-3fe5-4679-9779-783a0b229610 (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cf180b37-e4bb-46b3-9411-6eda2bab3f3c (dataset): DatasetConfig { id: cf180b37-e4bb-46b3-9411-6eda2bab3f3c (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d032d6e5-57b3-414a-9feb-ed750a3ad354 (dataset): DatasetConfig { id: d032d6e5-57b3-414a-9feb-ed750a3ad354 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc064424-c55b-4dbb-8a65-65b3c934e75f (dataset): DatasetConfig { id: dc064424-c55b-4dbb-8a65-65b3c934e75f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dddc39fe-35b7-4fa0-8bf0-324ce76904c8 (dataset): DatasetConfig { id: dddc39fe-35b7-4fa0-8bf0-324ce76904c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e265e1ce-9582-4bc2-a2a4-58fd529dd477 (dataset): DatasetConfig { id: e265e1ce-9582-4bc2-a2a4-58fd529dd477 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ec71198a-195c-4630-8d7c-4bf8633463e5 (dataset): DatasetConfig { id: ec71198a-195c-4630-8d7c-4bf8633463e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee1625c1-51ff-4abb-a1eb-dbeeeab39037 (dataset): DatasetConfig { id: ee1625c1-51ff-4abb-a1eb-dbeeeab39037 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1c3b644-9a33-46c4-ac12-e7a9828010ac (dataset): DatasetConfig { id: f1c3b644-9a33-46c4-ac12-e7a9828010ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2b5a2a4-259e-4fbf-b630-02eb9e7ae2b1 (dataset): DatasetConfig { id: f2b5a2a4-259e-4fbf-b630-02eb9e7ae2b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f57f1a85-d7e7-49c7-9540-5b3f40bba78d (dataset): DatasetConfig { id: f57f1a85-d7e7-49c7-9540-5b3f40bba78d (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6c3db76-08c6-4fc0-9e8f-d86512e5a956 (dataset): DatasetConfig { id: f6c3db76-08c6-4fc0-9e8f-d86512e5a956 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8e871ac-24cf-441a-8f32-de11561bfb60 (dataset): DatasetConfig { id: f8e871ac-24cf-441a-8f32-de11561bfb60 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fad82c9d-bea2-4733-b716-59d236301036 (dataset): DatasetConfig { id: fad82c9d-bea2-4733-b716-59d236301036 (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcc6de04-ea5e-43d5-af38-a83a3755b3e0 (dataset): DatasetConfig { id: fcc6de04-ea5e-43d5-af38-a83a3755b3e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4532025-01-10T05:03:34.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32919
4542025-01-10T05:03:34.368ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4552025-01-10T05:03:34.368ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {002e2136-eb9d-4524-b129-8c5f0e81c4e9 (dataset): DatasetConfig { id: 002e2136-eb9d-4524-b129-8c5f0e81c4e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 00c1db0d-d282-47b5-9989-cbf2fb0d54fa (dataset): DatasetConfig { id: 00c1db0d-d282-47b5-9989-cbf2fb0d54fa (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0776a3b4-d5a9-464c-94c1-d5f87114e2c3 (dataset): DatasetConfig { id: 0776a3b4-d5a9-464c-94c1-d5f87114e2c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 095145c1-c1de-4221-9048-21f889f9407c (dataset): DatasetConfig { id: 095145c1-c1de-4221-9048-21f889f9407c (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e08af02-afc8-431c-92e6-dd11d7488e22 (dataset): DatasetConfig { id: 0e08af02-afc8-431c-92e6-dd11d7488e22 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10bb8921-69be-4a82-b0b0-ee64b606c5a8 (dataset): DatasetConfig { id: 10bb8921-69be-4a82-b0b0-ee64b606c5a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12db8c95-022b-4d9f-9d65-4b2cfd31e284 (dataset): DatasetConfig { id: 12db8c95-022b-4d9f-9d65-4b2cfd31e284 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15b70950-7a96-4831-a9dc-8cc38ace31a1 (dataset): DatasetConfig { id: 15b70950-7a96-4831-a9dc-8cc38ace31a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1826c996-3e17-4489-a039-0061406a5f3a (dataset): DatasetConfig { id: 1826c996-3e17-4489-a039-0061406a5f3a (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b76a6cc-b082-4710-bf9d-c6e9441950f2 (dataset): DatasetConfig { id: 1b76a6cc-b082-4710-bf9d-c6e9441950f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dd701f4-735f-468d-9301-4556efecc18d (dataset): DatasetConfig { id: 1dd701f4-735f-468d-9301-4556efecc18d (dataset), name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1e0196cd-0d1e-40e3-a86e-a8eb20bca161 (dataset): DatasetConfig { id: 1e0196cd-0d1e-40e3-a86e-a8eb20bca161 (dataset), name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f5f4ec6-a25b-4cfe-9641-88ed5bab1d7b (dataset): DatasetConfig { id: 1f5f4ec6-a25b-4cfe-9641-88ed5bab1d7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27080678-b5ee-4893-addb-ae73b88915cb (dataset): DatasetConfig { id: 27080678-b5ee-4893-addb-ae73b88915cb (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 288097d3-d053-4038-9bf7-d5cc297d1e75 (dataset): DatasetConfig { id: 288097d3-d053-4038-9bf7-d5cc297d1e75 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29358660-9a74-44a4-aa8f-678f92e05346 (dataset): DatasetConfig { id: 29358660-9a74-44a4-aa8f-678f92e05346 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29ecb36c-b0ce-497f-8e5d-532807222420 (dataset): DatasetConfig { id: 29ecb36c-b0ce-497f-8e5d-532807222420 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3242a75c-1aca-4ccf-a2f2-8d1625619a50 (dataset): DatasetConfig { id: 3242a75c-1aca-4ccf-a2f2-8d1625619a50 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3502d19c-901f-4ef2-8e54-abf1589c122f (dataset): DatasetConfig { id: 3502d19c-901f-4ef2-8e54-abf1589c122f (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36f0d09c-c425-4eaf-845b-7d578d8aa486 (dataset): DatasetConfig { id: 36f0d09c-c425-4eaf-845b-7d578d8aa486 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 41cc741e-b401-47be-99b4-1250c3df8a4c (dataset): DatasetConfig { id: 41cc741e-b401-47be-99b4-1250c3df8a4c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c2d8176-792a-4365-8936-0f7d9fca7d1c (dataset): DatasetConfig { id: 4c2d8176-792a-4365-8936-0f7d9fca7d1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c95f667-219b-4237-a879-aa27ce43db21 (dataset): DatasetConfig { id: 4c95f667-219b-4237-a879-aa27ce43db21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51d2b6cb-bf74-4fef-9f12-e2d42e0c1fc9 (dataset): DatasetConfig { id: 51d2b6cb-bf74-4fef-9f12-e2d42e0c1fc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5425fd63-ddb8-4c8c-9007-a0b721b70c34 (dataset): DatasetConfig { id: 5425fd63-ddb8-4c8c-9007-a0b721b70c34 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59c935c7-d3cb-4372-8d1c-8e11ade9f9cb (dataset): DatasetConfig { id: 59c935c7-d3cb-4372-8d1c-8e11ade9f9cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b20d56a-67b7-4c71-85f8-34bd25dbf02c (dataset): DatasetConfig { id: 5b20d56a-67b7-4c71-85f8-34bd25dbf02c (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d62c4af-76a9-4807-bfa8-838c8bb03021 (dataset): DatasetConfig { id: 5d62c4af-76a9-4807-bfa8-838c8bb03021 (dataset), name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5dded717-3abb-490a-94e9-2b14f1f16645 (dataset): DatasetConfig { id: 5dded717-3abb-490a-94e9-2b14f1f16645 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 612fa0cb-affc-47b9-b8db-bc125594c5bc (dataset): DatasetConfig { id: 612fa0cb-affc-47b9-b8db-bc125594c5bc (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 69fe7bed-a3e0-4387-ba79-0c334fac5b95 (dataset): DatasetConfig { id: 69fe7bed-a3e0-4387-ba79-0c334fac5b95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72e69f43-0464-4988-88d8-36607646ac03 (dataset): DatasetConfig { id: 72e69f43-0464-4988-88d8-36607646ac03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 788d1c2b-8db7-4bcf-a8aa-7258cd5c1e3d (dataset): DatasetConfig { id: 788d1c2b-8db7-4bcf-a8aa-7258cd5c1e3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bf0a845-7c8e-413e-92c6-122cff2a1aea (dataset): DatasetConfig { id: 7bf0a845-7c8e-413e-92c6-122cff2a1aea (dataset), name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84cbfe90-2c25-491d-a602-208d245a2ad5 (dataset): DatasetConfig { id: 84cbfe90-2c25-491d-a602-208d245a2ad5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 939e74a2-b9b9-4f5c-8d42-39fcb8fc64b9 (dataset): DatasetConfig { id: 939e74a2-b9b9-4f5c-8d42-39fcb8fc64b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 991f75a4-a104-4143-94e8-1eea8f1e9ca1 (dataset): DatasetConfig { id: 991f75a4-a104-4143-94e8-1eea8f1e9ca1 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9961a326-cd12-4f1b-b729-2bcc5b137ebe (dataset): DatasetConfig { id: 9961a326-cd12-4f1b-b729-2bcc5b137ebe (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ef454f0-0f8c-43a0-ac34-8a8e56b6c832 (dataset): DatasetConfig { id: 9ef454f0-0f8c-43a0-ac34-8a8e56b6c832 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a5275319-f258-4c8e-a353-62b16bd27107 (dataset): DatasetConfig { id: a5275319-f258-4c8e-a353-62b16bd27107 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, abb80a93-1621-4672-a65e-8bd904dc3c05 (dataset): DatasetConfig { id: abb80a93-1621-4672-a65e-8bd904dc3c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3c8fbe4-c5cf-49c5-87b8-978f43575577 (dataset): DatasetConfig { id: b3c8fbe4-c5cf-49c5-87b8-978f43575577 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4b8b942-9a7b-48cb-bc52-7340d3e3d12b (dataset): DatasetConfig { id: b4b8b942-9a7b-48cb-bc52-7340d3e3d12b (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d250f5-0ecc-40e6-a827-b1ea7d7a7713 (dataset): DatasetConfig { id: b6d250f5-0ecc-40e6-a827-b1ea7d7a7713 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8bec7e3-eb15-4f25-9510-256810148762 (dataset): DatasetConfig { id: b8bec7e3-eb15-4f25-9510-256810148762 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, baa212ba-0678-4487-a3f6-4e85bcbcdcc8 (dataset): DatasetConfig { id: baa212ba-0678-4487-a3f6-4e85bcbcdcc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1b0302b-2289-4ef5-815c-faa51bf4936b (dataset): DatasetConfig { id: c1b0302b-2289-4ef5-815c-faa51bf4936b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1b1a239-bdc3-422b-83de-f413f6919429 (dataset): DatasetConfig { id: c1b1a239-bdc3-422b-83de-f413f6919429 (dataset), name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c25aabd3-349e-4c2b-9394-743486a7c3b0 (dataset): DatasetConfig { id: c25aabd3-349e-4c2b-9394-743486a7c3b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ef1643-3eab-4f8f-bd76-68c0d58bfb6a (dataset): DatasetConfig { id: c3ef1643-3eab-4f8f-bd76-68c0d58bfb6a (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c50e48dc-1504-4f58-a9de-06874ae666c6 (dataset): DatasetConfig { id: c50e48dc-1504-4f58-a9de-06874ae666c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce768689-3fe5-4679-9779-783a0b229610 (dataset): DatasetConfig { id: ce768689-3fe5-4679-9779-783a0b229610 (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cf180b37-e4bb-46b3-9411-6eda2bab3f3c (dataset): DatasetConfig { id: cf180b37-e4bb-46b3-9411-6eda2bab3f3c (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d032d6e5-57b3-414a-9feb-ed750a3ad354 (dataset): DatasetConfig { id: d032d6e5-57b3-414a-9feb-ed750a3ad354 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc064424-c55b-4dbb-8a65-65b3c934e75f (dataset): DatasetConfig { id: dc064424-c55b-4dbb-8a65-65b3c934e75f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dddc39fe-35b7-4fa0-8bf0-324ce76904c8 (dataset): DatasetConfig { id: dddc39fe-35b7-4fa0-8bf0-324ce76904c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e265e1ce-9582-4bc2-a2a4-58fd529dd477 (dataset): DatasetConfig { id: e265e1ce-9582-4bc2-a2a4-58fd529dd477 (dataset), name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ec71198a-195c-4630-8d7c-4bf8633463e5 (dataset): DatasetConfig { id: ec71198a-195c-4630-8d7c-4bf8633463e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee1625c1-51ff-4abb-a1eb-dbeeeab39037 (dataset): DatasetConfig { id: ee1625c1-51ff-4abb-a1eb-dbeeeab39037 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1c3b644-9a33-46c4-ac12-e7a9828010ac (dataset): DatasetConfig { id: f1c3b644-9a33-46c4-ac12-e7a9828010ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2b5a2a4-259e-4fbf-b630-02eb9e7ae2b1 (dataset): DatasetConfig { id: f2b5a2a4-259e-4fbf-b630-02eb9e7ae2b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f57f1a85-d7e7-49c7-9540-5b3f40bba78d (dataset): DatasetConfig { id: f57f1a85-d7e7-49c7-9540-5b3f40bba78d (dataset), name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6c3db76-08c6-4fc0-9e8f-d86512e5a956 (dataset): DatasetConfig { id: f6c3db76-08c6-4fc0-9e8f-d86512e5a956 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8e871ac-24cf-441a-8f32-de11561bfb60 (dataset): DatasetConfig { id: f8e871ac-24cf-441a-8f32-de11561bfb60 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fad82c9d-bea2-4733-b716-59d236301036 (dataset): DatasetConfig { id: fad82c9d-bea2-4733-b716-59d236301036 (dataset), name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcc6de04-ea5e-43d5-af38-a83a3755b3e0 (dataset): DatasetConfig { id: fcc6de04-ea5e-43d5-af38-a83a3755b3e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4562025-01-10T05:03:34.368ZINFOSledAgent (StorageManager): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4572025-01-10T05:03:34.368ZINFOSledAgent (StorageManager): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4582025-01-10T05:03:34.368ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4592025-01-10T05:03:34.382ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602025-01-10T05:03:34.382ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612025-01-10T05:03:34.382ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/721ba211-f349-4837-89b3-f4cf559302bb/crypt/zone/oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f"), full_name: "oxp_721ba211-f349-4837-89b3-f4cf559302bb/crypt/zone/oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f" } file = sled-storage/src/manager.rs:1431
4622025-01-10T05:03:34.461ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632025-01-10T05:03:34.461ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4642025-01-10T05:03:34.461ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/721ba211-f349-4837-89b3-f4cf559302bb/crypt/zone"), full_name: "oxp_721ba211-f349-4837-89b3-f4cf559302bb/crypt/zone" } file = sled-storage/src/manager.rs:1431
4652025-01-10T05:03:34.500ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662025-01-10T05:03:34.500ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4672025-01-10T05:03:34.500ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone" } file = sled-storage/src/manager.rs:1431
4682025-01-10T05:03:34.539ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692025-01-10T05:03:34.539ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702025-01-10T05:03:34.539ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa" } file = sled-storage/src/manager.rs:1431
4712025-01-10T05:03:34.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722025-01-10T05:03:34.615ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732025-01-10T05:03:34.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599" } file = sled-storage/src/manager.rs:1431
4742025-01-10T05:03:34.689ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752025-01-10T05:03:34.689ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762025-01-10T05:03:34.689ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crucible" } file = sled-storage/src/manager.rs:1431
4772025-01-10T05:03:34.754ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782025-01-10T05:03:34.754ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4792025-01-10T05:03:34.754ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/zone"), full_name: "oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/zone" } file = sled-storage/src/manager.rs:1431
4802025-01-10T05:03:34.760ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/probe_manager.rs:231 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
4812025-01-10T05:03:34.792ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822025-01-10T05:03:34.792ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832025-01-10T05:03:34.792ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab" } file = sled-storage/src/manager.rs:1431
4842025-01-10T05:03:34.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852025-01-10T05:03:34.864ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4862025-01-10T05:03:34.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8" } file = sled-storage/src/manager.rs:1431
4872025-01-10T05:03:34.937ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882025-01-10T05:03:34.937ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4892025-01-10T05:03:34.937ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf" } file = sled-storage/src/manager.rs:1431
4902025-01-10T05:03:35.010ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912025-01-10T05:03:35.010ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4922025-01-10T05:03:35.010ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/49894127-b79c-4807-aac5-383699d40578/crypt/debug"), full_name: "oxp_49894127-b79c-4807-aac5-383699d40578/crypt/debug" } file = sled-storage/src/manager.rs:1431
4932025-01-10T05:03:35.048ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942025-01-10T05:03:35.048ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4952025-01-10T05:03:35.048ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/19b37234-d205-4094-b223-ad0e72e9c46e/crypt/zone/oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89"), full_name: "oxp_19b37234-d205-4094-b223-ad0e72e9c46e/crypt/zone/oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89" } file = sled-storage/src/manager.rs:1431
4962025-01-10T05:03:35.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972025-01-10T05:03:35.119ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4982025-01-10T05:03:35.120ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c7c8012-1908-4829-b530-3992d83456e0/crypt/zone/oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44"), full_name: "oxp_5c7c8012-1908-4829-b530-3992d83456e0/crypt/zone/oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44" } file = sled-storage/src/manager.rs:1431
4992025-01-10T05:03:35.196ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002025-01-10T05:03:35.196ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5012025-01-10T05:03:35.196ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crucible" } file = sled-storage/src/manager.rs:1431
5022025-01-10T05:03:35.258ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032025-01-10T05:03:35.258ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5042025-01-10T05:03:35.258ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone/oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), full_name: "oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone/oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8" } file = sled-storage/src/manager.rs:1431
5052025-01-10T05:03:35.326ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4559
5062025-01-10T05:03:35.326ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4565
5072025-01-10T05:03:35.335ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-01-10T05:03:35.335ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092025-01-10T05:03:35.335ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/zone/oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4"), full_name: "oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/zone/oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4" } file = sled-storage/src/manager.rs:1431
5102025-01-10T05:03:35.411ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-01-10T05:03:35.411ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122025-01-10T05:03:35.411ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5132025-01-10T05:03:35.475ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-01-10T05:03:35.475ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152025-01-10T05:03:35.475ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone/oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone/oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a" } file = sled-storage/src/manager.rs:1431
5162025-01-10T05:03:35.544ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-01-10T05:03:35.545ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5182025-01-10T05:03:35.545ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_721ba211-f349-4837-89b3-f4cf559302bb/crucible" } file = sled-storage/src/manager.rs:1431
5192025-01-10T05:03:35.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-01-10T05:03:35.603ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5212025-01-10T05:03:35.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c7c8012-1908-4829-b530-3992d83456e0/crypt/debug"), full_name: "oxp_5c7c8012-1908-4829-b530-3992d83456e0/crypt/debug" } file = sled-storage/src/manager.rs:1431
5222025-01-10T05:03:35.641ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-10T05:03:35.641ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-01-10T05:03:35.641ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone/oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone/oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527" } file = sled-storage/src/manager.rs:1431
5252025-01-10T05:03:35.718ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-01-10T05:03:35.718ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5272025-01-10T05:03:35.718ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5282025-01-10T05:03:35.762ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/probe_manager.rs:231 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
5292025-01-10T05:03:35.782ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302025-01-10T05:03:35.782ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312025-01-10T05:03:35.782ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_49894127-b79c-4807-aac5-383699d40578/crucible" } file = sled-storage/src/manager.rs:1431
5322025-01-10T05:03:35.846ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-01-10T05:03:35.846ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342025-01-10T05:03:35.846ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crucible" } file = sled-storage/src/manager.rs:1431
5352025-01-10T05:03:35.909ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-01-10T05:03:35.909ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372025-01-10T05:03:35.909ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone/oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4"), full_name: "oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone/oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4" } file = sled-storage/src/manager.rs:1431
5382025-01-10T05:03:35.982ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-01-10T05:03:35.982ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402025-01-10T05:03:35.982ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5412025-01-10T05:03:36.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422025-01-10T05:03:36.046ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432025-01-10T05:03:36.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2" } file = sled-storage/src/manager.rs:1431
5442025-01-10T05:03:36.118ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-01-10T05:03:36.118ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5462025-01-10T05:03:36.118ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/19b37234-d205-4094-b223-ad0e72e9c46e/crypt/zone"), full_name: "oxp_19b37234-d205-4094-b223-ad0e72e9c46e/crypt/zone" } file = sled-storage/src/manager.rs:1431
5472025-01-10T05:03:36.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-01-10T05:03:36.156ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5492025-01-10T05:03:36.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050" } file = sled-storage/src/manager.rs:1431
5502025-01-10T05:03:36.234ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-01-10T05:03:36.234ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5522025-01-10T05:03:36.234ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/debug"), full_name: "oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/debug" } file = sled-storage/src/manager.rs:1431
5532025-01-10T05:03:36.271ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-10T05:03:36.271ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5552025-01-10T05:03:36.271ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/49894127-b79c-4807-aac5-383699d40578/crypt/zone"), full_name: "oxp_49894127-b79c-4807-aac5-383699d40578/crypt/zone" } file = sled-storage/src/manager.rs:1431
5562025-01-10T05:03:36.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-10T05:03:36.310ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5582025-01-10T05:03:36.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5592025-01-10T05:03:36.372ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-01-10T05:03:36.372ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5612025-01-10T05:03:36.372ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768" } file = sled-storage/src/manager.rs:1431
5622025-01-10T05:03:36.450ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-01-10T05:03:36.450ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642025-01-10T05:03:36.450ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/49894127-b79c-4807-aac5-383699d40578/crypt/zone/oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387"), full_name: "oxp_49894127-b79c-4807-aac5-383699d40578/crypt/zone/oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387" } file = sled-storage/src/manager.rs:1431
5652025-01-10T05:03:36.521ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-01-10T05:03:36.521ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5672025-01-10T05:03:36.521ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crucible" } file = sled-storage/src/manager.rs:1431
5682025-01-10T05:03:36.585ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-01-10T05:03:36.585ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-01-10T05:03:36.585ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848" } file = sled-storage/src/manager.rs:1431
5712025-01-10T05:03:36.657ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-01-10T05:03:36.657ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5732025-01-10T05:03:36.657ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone/oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514"), full_name: "oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone/oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514" } file = sled-storage/src/manager.rs:1431
5742025-01-10T05:03:36.734ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-01-10T05:03:36.734ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762025-01-10T05:03:36.734ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5772025-01-10T05:03:36.763ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/probe_manager.rs:231 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
5782025-01-10T05:03:36.800ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-01-10T05:03:36.800ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5802025-01-10T05:03:36.800ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/debug"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/debug" } file = sled-storage/src/manager.rs:1431
5812025-01-10T05:03:36.839ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822025-01-10T05:03:36.839ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832025-01-10T05:03:36.839ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone/oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517" } file = sled-storage/src/manager.rs:1431
5842025-01-10T05:03:36.912ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852025-01-10T05:03:36.912ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862025-01-10T05:03:36.912ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794/crucible" } file = sled-storage/src/manager.rs:1431
5872025-01-10T05:03:36.980ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882025-01-10T05:03:36.980ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892025-01-10T05:03:36.980ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone/oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone/oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62" } file = sled-storage/src/manager.rs:1431
5902025-01-10T05:03:37.056ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912025-01-10T05:03:37.056ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5922025-01-10T05:03:37.056ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone"), full_name: "oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone" } file = sled-storage/src/manager.rs:1431
5932025-01-10T05:03:37.097ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-01-10T05:03:37.097ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5952025-01-10T05:03:37.097ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5c7c8012-1908-4829-b530-3992d83456e0/crucible" } file = sled-storage/src/manager.rs:1431
5962025-01-10T05:03:37.163ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-01-10T05:03:37.163ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5982025-01-10T05:03:37.163ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ceb1ad5-1952-4abe-b542-37b814690640/crypt/debug"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/debug" } file = sled-storage/src/manager.rs:1431
5992025-01-10T05:03:37.202ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002025-01-10T05:03:37.202ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6012025-01-10T05:03:37.202ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6022025-01-10T05:03:37.269ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032025-01-10T05:03:37.269ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6042025-01-10T05:03:37.269ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone/oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone/oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a" } file = sled-storage/src/manager.rs:1431
6052025-01-10T05:03:37.345ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062025-01-10T05:03:37.345ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6072025-01-10T05:03:37.345ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/19b37234-d205-4094-b223-ad0e72e9c46e/crypt/debug"), full_name: "oxp_19b37234-d205-4094-b223-ad0e72e9c46e/crypt/debug" } file = sled-storage/src/manager.rs:1431
6082025-01-10T05:03:37.386ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092025-01-10T05:03:37.386ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102025-01-10T05:03:37.386ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301" } file = sled-storage/src/manager.rs:1431
6112025-01-10T05:03:37.462ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122025-01-10T05:03:37.462ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6132025-01-10T05:03:37.462ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6142025-01-10T05:03:37.529ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6152025-01-10T05:03:37.529ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6162025-01-10T05:03:37.529ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6172025-01-10T05:03:37.598ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6182025-01-10T05:03:37.598ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6192025-01-10T05:03:37.598ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/721ba211-f349-4837-89b3-f4cf559302bb/crypt/debug"), full_name: "oxp_721ba211-f349-4837-89b3-f4cf559302bb/crypt/debug" } file = sled-storage/src/manager.rs:1431
6202025-01-10T05:03:37.639ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212025-01-10T05:03:37.640ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222025-01-10T05:03:37.640ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/zone/oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4" } file = sled-storage/src/manager.rs:1431
6232025-01-10T05:03:37.711ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242025-01-10T05:03:37.711ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6252025-01-10T05:03:37.711ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/zone" } file = sled-storage/src/manager.rs:1431
6262025-01-10T05:03:37.750ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272025-01-10T05:03:37.750ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6282025-01-10T05:03:37.750ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c7c8012-1908-4829-b530-3992d83456e0/crypt/zone"), full_name: "oxp_5c7c8012-1908-4829-b530-3992d83456e0/crypt/zone" } file = sled-storage/src/manager.rs:1431
6292025-01-10T05:03:37.766ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/probe_manager.rs:231 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
6302025-01-10T05:03:37.789ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-01-10T05:03:37.789ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6322025-01-10T05:03:37.789ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/debug"), full_name: "oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/debug" } file = sled-storage/src/manager.rs:1431
6332025-01-10T05:03:37.827ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342025-01-10T05:03:37.827ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6352025-01-10T05:03:37.827ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/debug"), full_name: "oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/debug" } file = sled-storage/src/manager.rs:1431
6362025-01-10T05:03:37.867ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372025-01-10T05:03:37.867ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382025-01-10T05:03:37.867ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_19b37234-d205-4094-b223-ad0e72e9c46e/crucible" } file = sled-storage/src/manager.rs:1431
6392025-01-10T05:03:37.931ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402025-01-10T05:03:37.931ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412025-01-10T05:03:37.931ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone/oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127"), full_name: "oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/zone/oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127" } file = sled-storage/src/manager.rs:1431
6422025-01-10T05:03:38.008ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432025-01-10T05:03:38.008ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442025-01-10T05:03:38.008ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6452025-01-10T05:03:38.073ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462025-01-10T05:03:38.073ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472025-01-10T05:03:38.073ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/721ba211-f349-4837-89b3-f4cf559302bb/crypt/zone/oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e"), full_name: "oxp_721ba211-f349-4837-89b3-f4cf559302bb/crypt/zone/oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e" } file = sled-storage/src/manager.rs:1431
6482025-01-10T05:03:38.150ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6492025-01-10T05:03:38.150ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6502025-01-10T05:03:38.150ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/zone/oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078"), full_name: "oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/zone/oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078" } file = sled-storage/src/manager.rs:1431
6512025-01-10T05:03:38.224ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6522025-01-10T05:03:38.224ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6532025-01-10T05:03:38.224ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone"), full_name: "oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crypt/zone" } file = sled-storage/src/manager.rs:1431
6542025-01-10T05:03:38.264ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6552025-01-10T05:03:38.264ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6562025-01-10T05:03:38.264ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c7c8012-1908-4829-b530-3992d83456e0/crypt/zone/oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b"), full_name: "oxp_5c7c8012-1908-4829-b530-3992d83456e0/crypt/zone/oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b" } file = sled-storage/src/manager.rs:1431
6572025-01-10T05:03:38.340ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6582025-01-10T05:03:38.340ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6592025-01-10T05:03:38.340ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_721ba211-f349-4837-89b3-f4cf559302bb/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6602025-01-10T05:03:38.408ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6612025-01-10T05:03:38.408ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6622025-01-10T05:03:38.408ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6632025-01-10T05:03:38.475ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6642025-01-10T05:03:38.476ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6652025-01-10T05:03:38.476ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
6662025-01-10T05:03:38.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4108996 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:32919 req_id = e912bf6d-6461-436a-8ee4-afff825ab022 response_code = 200 uri = /datasets
6672025-01-10T05:03:38.508ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: e93887bd-ffe8-46b8-ad6f-92e0665448ab (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3737e73-ceea-4b83-966e-05b55558955a (service), filesystem_pool: Some(ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 53514ca5-28a5-4b76-afd8-362873acf1d4 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6682025-01-10T05:03:38.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48440
6692025-01-10T05:03:38.509ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6702025-01-10T05:03:38.509ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6712025-01-10T05:03:38.518ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6722025-01-10T05:03:38.518ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6732025-01-10T05:03:38.527ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6742025-01-10T05:03:38.527ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6752025-01-10T05:03:38.535ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6762025-01-10T05:03:38.535ZINFOSledAgent (ServiceManager): No ledger in /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:188
6772025-01-10T05:03:38.535ZINFOSledAgent (ServiceManager): No ledger in /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:188
6782025-01-10T05:03:38.535ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6792025-01-10T05:03:38.576ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6802025-01-10T05:03:38.576ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6812025-01-10T05:03:38.576ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6822025-01-10T05:03:38.630ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4 file = illumos-utils/src/zone.rs:325
6832025-01-10T05:03:38.634ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a file = illumos-utils/src/zone.rs:325
6842025-01-10T05:03:38.638ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab file = illumos-utils/src/zone.rs:325
6852025-01-10T05:03:38.652ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4 file = illumos-utils/src/zone.rs:363
6862025-01-10T05:03:38.657ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a file = illumos-utils/src/zone.rs:363
6872025-01-10T05:03:38.661ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab file = illumos-utils/src/zone.rs:363
6882025-01-10T05:03:38.767ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/probe_manager.rs:231 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
6892025-01-10T05:03:39.374ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16150807815380570739 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
6902025-01-10T05:03:39.374ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10206841596814025130 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
6912025-01-10T05:03:39.428ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4606
6922025-01-10T05:03:39.428ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6932025-01-10T05:03:39.462ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59) file = sled-agent/src/nexus.rs:527 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
6942025-01-10T05:03:40.247ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6952025-01-10T05:03:40.725ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6962025-01-10T05:03:40.725ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6972025-01-10T05:03:40.728ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 36.488843ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
6982025-01-10T05:03:40.767ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6992025-01-10T05:03:40.799ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7002025-01-10T05:03:40.799ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7012025-01-10T05:03:40.799ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7022025-01-10T05:03:40.799ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7032025-01-10T05:03:40.837ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
7042025-01-10T05:03:40.883ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7052025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7062025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7072025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7082025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7092025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7102025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7112025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7122025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7132025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7142025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7152025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7162025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7172025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7182025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7192025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7202025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7212025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7222025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7232025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7242025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7252025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7262025-01-10T05:03:40.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7272025-01-10T05:03:40.995ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1343461989832016708 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
7282025-01-10T05:03:40.995ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4658672294461489299 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
7292025-01-10T05:03:41.204ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
7302025-01-10T05:03:41.204ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7312025-01-10T05:03:41.204ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
7322025-01-10T05:03:41.204ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7332025-01-10T05:03:41.209ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7342025-01-10T05:03:41.214ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7352025-01-10T05:03:41.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4") failed: Property not found. retry in 34.436284ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7362025-01-10T05:03:41.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a") failed: Property not found. retry in 63.638779ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7372025-01-10T05:03:41.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab") failed: Property not found. retry in 70.558945ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7382025-01-10T05:03:41.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4") failed: Property not found. retry in 136.998375ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7392025-01-10T05:03:41.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a") failed: Property not found. retry in 55.501395ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7402025-01-10T05:03:41.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4") failed: Property not found. retry in 274.135598ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7412025-01-10T05:03:41.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a") failed: Property not found. retry in 178.519225ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7422025-01-10T05:03:41.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab") failed: Property not found. retry in 119.884682ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7432025-01-10T05:03:41.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab") failed: Property not found. retry in 135.043814ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7442025-01-10T05:03:42.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a") failed: Property not found. retry in 368.866822ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7452025-01-10T05:03:42.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4") failed: Property not found. retry in 356.755398ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7462025-01-10T05:03:42.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab") failed: Property not found. retry in 352.931148ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7472025-01-10T05:03:42.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a") failed: Property not found. retry in 1.115325217s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7482025-01-10T05:03:42.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4") failed: Property not found. retry in 658.916223ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7492025-01-10T05:03:42.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab") failed: Property not found. retry in 1.173491603s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7502025-01-10T05:03:43.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4") failed: Property not found. retry in 539.914882ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7512025-01-10T05:03:43.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a") failed: Property not found. retry in 1.18648782s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7522025-01-10T05:03:43.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4") failed: Property not found. retry in 1.239268767s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7532025-01-10T05:03:43.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab") failed: Property not found. retry in 781.503295ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7542025-01-10T05:03:44.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab") failed: Property not found. retry in 1.423100058s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7552025-01-10T05:03:44.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a") failed: Property not found. retry in 985.246503ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7562025-01-10T05:03:44.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4") failed: Property not found. retry in 710.661011ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7572025-01-10T05:03:45.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4") failed: Property not found. retry in 1.204254906s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7582025-01-10T05:03:45.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a") failed: Property not found. retry in 1.272732483s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7592025-01-10T05:03:45.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab") failed: Property not found. retry in 1.176896499s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7602025-01-10T05:03:47.114ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_53514ca5-28a5-4b76-afd8-362873acf1d4
7612025-01-10T05:03:47.114ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_b3737e73-ceea-4b83-966e-05b55558955a
7622025-01-10T05:03:47.114ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_e93887bd-ffe8-46b8-ad6f-92e0665448ab
7632025-01-10T05:03:47.114ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642025-01-10T05:03:47.114ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7652025-01-10T05:03:47.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8606098 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48440 req_id = e8b83cfa-ea0b-46cd-91b6-e236467ed666 response_code = 204 uri = /omicron-zones
7662025-01-10T05:03:47.117ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7672025-01-10T05:03:48.300ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7682025-01-10T05:03:48.358ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7692025-01-10T05:03:48.413ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7702025-01-10T05:03:48.413ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7712025-01-10T05:03:48.445ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7722025-01-10T05:03:48.445ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7732025-01-10T05:03:48.445ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7742025-01-10T05:03:48.475ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: e93887bd-ffe8-46b8-ad6f-92e0665448ab (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3737e73-ceea-4b83-966e-05b55558955a (service), filesystem_pool: Some(ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 53514ca5-28a5-4b76-afd8-362873acf1d4 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: da96efd1-6357-4f76-822a-2ba6728735f8 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1d46ed58-be63-432e-83e6-d9d61cd8a6cf, kind: Service { id: da96efd1-6357-4f76-822a-2ba6728735f8 }, name: Name("ntp-da96efd1-6357-4f76-822a-2ba6728735f8"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 126])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7752025-01-10T05:03:48.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60671
7762025-01-10T05:03:48.475ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7772025-01-10T05:03:48.475ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7782025-01-10T05:03:48.486ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7792025-01-10T05:03:48.486ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7802025-01-10T05:03:48.496ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-01-10T05:03:48.496ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-01-10T05:03:48.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7832025-01-10T05:03:48.507ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:177
7842025-01-10T05:03:48.507ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:177
7852025-01-10T05:03:48.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7862025-01-10T05:03:48.518ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7872025-01-10T05:03:48.550ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7882025-01-10T05:03:48.551ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7892025-01-10T05:03:48.551ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7902025-01-10T05:03:48.581ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 186, 126]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7912025-01-10T05:03:48.581ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = boundary_ntp
7922025-01-10T05:03:48.581ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7932025-01-10T05:03:48.581ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7942025-01-10T05:03:48.581ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7952025-01-10T05:03:48.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7962025-01-10T05:03:48.606ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8 file = illumos-utils/src/zone.rs:325
7972025-01-10T05:03:48.624ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8 file = illumos-utils/src/zone.rs:363
7982025-01-10T05:03:49.244ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7992025-01-10T05:03:49.244ZINFOSledAgent (ServiceManager): Booting oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8002025-01-10T05:03:49.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 46.515645ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8012025-01-10T05:03:49.380ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16150807815380570739 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8022025-01-10T05:03:49.380ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10206841596814025130 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8032025-01-10T05:03:49.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 109.964224ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8042025-01-10T05:03:49.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 171.983497ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8052025-01-10T05:03:49.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 319.159092ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8062025-01-10T05:03:50.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 580.890436ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8072025-01-10T05:03:50.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 556.847213ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8082025-01-10T05:03:50.998ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1343461989832016708 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8092025-01-10T05:03:50.998ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4658672294461489299 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8102025-01-10T05:03:51.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 500.103515ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8112025-01-10T05:03:51.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 1.096399867s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8122025-01-10T05:03:52.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 578.32554ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8132025-01-10T05:03:53.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 729.431307ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8142025-01-10T05:03:54.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8") failed: Property not found. retry in 784.395629ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8152025-01-10T05:03:54.972ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8
8162025-01-10T05:03:54.972ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8172025-01-10T05:03:54.972ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182025-01-10T05:03:54.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6498041 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60671 req_id = aed8bfda-1a39-4d14-8df4-c7020659ae9b response_code = 204 uri = /omicron-zones
8192025-01-10T05:03:54.975ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8202025-01-10T05:03:55.005ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8212025-01-10T05:03:55.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58438
8222025-01-10T05:03:55.015ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8232025-01-10T05:03:55.016ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10392 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58438 req_id = 7494ff1b-c59f-44e6-9c68-246713dfd2b6 response_code = 500 uri = /timesync
8242025-01-10T05:03:55.019ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8252025-01-10T05:03:55.160ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8262025-01-10T05:03:55.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38517
8272025-01-10T05:03:56.861ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9783228898214164193 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8282025-01-10T05:03:57.006ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4115298416508984310 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8292025-01-10T05:03:57.117ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6288407893850951128 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8302025-01-10T05:03:59.169ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8312025-01-10T05:03:59.169ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009075 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38517 req_id = 2d800bc7-67e3-4e58-9d0e-4e1d95a90bc7 response_code = 500 uri = /timesync
8322025-01-10T05:03:59.172ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8332025-01-10T05:03:59.304ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8342025-01-10T05:03:59.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48444
8352025-01-10T05:03:59.314ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8362025-01-10T05:03:59.314ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48444 req_id = 9c9c8503-7503-438b-97e1-6816e852250b response_code = 500 uri = /timesync
8372025-01-10T05:03:59.316ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382025-01-10T05:03:59.382ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16150807815380570739 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8392025-01-10T05:03:59.383ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10206841596814025130 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8402025-01-10T05:03:59.426ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8412025-01-10T05:03:59.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34890
8422025-01-10T05:04:01.000ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1343461989832016708 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8432025-01-10T05:04:01.000ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4658672294461489299 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8442025-01-10T05:04:03.806ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_da96efd1-6357-4f76-822a-2ba6728735f8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8452025-01-10T05:04:03.806ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008537 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34890 req_id = f4641f78-655f-4c4d-9f03-7f14385430e3 response_code = 500 uri = /timesync
8462025-01-10T05:04:03.809ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8472025-01-10T05:04:03.991ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8482025-01-10T05:04:03.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54498
8492025-01-10T05:04:04.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54498 req_id = 5f621f25-36f7-4aed-8520-31c131441ce5 response_code = 200 uri = /timesync
8502025-01-10T05:04:04.002ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.096404999 } file = sled-agent/src/rack_setup/service.rs:743
8512025-01-10T05:04:04.002ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8522025-01-10T05:04:04.221ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8532025-01-10T05:04:04.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53950
8542025-01-10T05:04:04.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9047 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53950 req_id = bdac0e9e-77d7-47fb-91c5-daee88782b54 response_code = 200 uri = /timesync
8552025-01-10T05:04:04.233ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.095444657 } file = sled-agent/src/rack_setup/service.rs:743
8562025-01-10T05:04:04.233ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8572025-01-10T05:04:04.435ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8582025-01-10T05:04:04.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55363
8592025-01-10T05:04:04.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8626 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55363 req_id = d8a78dab-4ce4-489d-a96f-bf84a0b14e44 response_code = 200 uri = /timesync
8602025-01-10T05:04:04.446ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.094867364 } file = sled-agent/src/rack_setup/service.rs:743
8612025-01-10T05:04:04.446ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8622025-01-10T05:04:04.888ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8632025-01-10T05:04:04.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39125
8642025-01-10T05:04:04.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7502 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39125 req_id = f502e44f-7145-49cf-9b8f-0c58b7010368 response_code = 200 uri = /timesync
8652025-01-10T05:04:04.897ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.093647182 } file = sled-agent/src/rack_setup/service.rs:743
8662025-01-10T05:04:04.897ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8672025-01-10T05:04:05.351ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16993052371217700160 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8682025-01-10T05:04:05.351ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8214236899682746499 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8692025-01-10T05:04:05.437ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8702025-01-10T05:04:05.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39567
8712025-01-10T05:04:05.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8967 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39567 req_id = 56cf4c59-a970-413b-aa20-b19fa9a91002 response_code = 200 uri = /timesync
8722025-01-10T05:04:05.448ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.092473298 } file = sled-agent/src/rack_setup/service.rs:743
8732025-01-10T05:04:05.448ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8742025-01-10T05:04:05.769ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 135.634082ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8752025-01-10T05:04:05.816ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762025-01-10T05:04:05.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36442
8772025-01-10T05:04:05.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8863 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36442 req_id = 7c2766b9-2df7-40ab-b736-5508f7020cf7 response_code = 200 uri = /timesync
8782025-01-10T05:04:05.827ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.091449544 } file = sled-agent/src/rack_setup/service.rs:743
8792025-01-10T05:04:05.827ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802025-01-10T05:04:06.449ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812025-01-10T05:04:06.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47074
8822025-01-10T05:04:06.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47074 req_id = c6b1b1f4-a661-4697-b203-9b75e9c03325 response_code = 200 uri = /timesync
8832025-01-10T05:04:06.459ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.089749627 } file = sled-agent/src/rack_setup/service.rs:743
8842025-01-10T05:04:06.459ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852025-01-10T05:04:06.814ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8862025-01-10T05:04:06.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52891
8872025-01-10T05:04:06.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8507 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52891 req_id = 2f76f9c4-97b5-419d-ad2c-ea0a779e6703 response_code = 200 uri = /timesync
8882025-01-10T05:04:06.827ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.088760749 } file = sled-agent/src/rack_setup/service.rs:743
8892025-01-10T05:04:06.827ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8902025-01-10T05:04:07.245ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9783228898214164193 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8912025-01-10T05:04:07.334ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8922025-01-10T05:04:07.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33034
8932025-01-10T05:04:07.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8467 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33034 req_id = 15303518-0ad8-443a-ab55-a1f8901b81f7 response_code = 200 uri = /timesync
8942025-01-10T05:04:07.344ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2516061351, ip_addr: 149.248.12.167, stratum: 3, ref_time: 1736485447.240351, correction: 0.087318152 } file = sled-agent/src/rack_setup/service.rs:743
8952025-01-10T05:04:07.344ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8962025-01-10T05:04:07.390ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4115298416508984310 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8972025-01-10T05:04:07.499ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6288407893850951128 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
8982025-01-10T05:04:08.146ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8992025-01-10T05:04:08.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57988
9002025-01-10T05:04:08.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57988 req_id = 903e41d4-2c04-46de-a267-6c6dd63e94ec response_code = 200 uri = /timesync
9012025-01-10T05:04:08.158ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736485447.009534, correction: 0.085122757 } file = sled-agent/src/rack_setup/service.rs:743
9022025-01-10T05:04:08.158ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9032025-01-10T05:04:09.418ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9042025-01-10T05:04:09.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42199
9052025-01-10T05:04:09.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7970 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42199 req_id = 8e54fa42-2f6a-42d2-b34b-4cb5b8ab7b89 response_code = 200 uri = /timesync
9062025-01-10T05:04:09.429ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2516061351, ip_addr: 149.248.12.167, stratum: 3, ref_time: 1736485448.3370335, correction: 0.081655703 } file = sled-agent/src/rack_setup/service.rs:743
9072025-01-10T05:04:09.429ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9082025-01-10T05:04:09.772ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16150807815380570739 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9092025-01-10T05:04:09.772ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10206841596814025130 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9102025-01-10T05:04:10.434ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42871
9112025-01-10T05:04:10.435ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42871 req_id = d67097b4-1180-4d55-a291-1dd703da08b3 response_code = 200 uri = /baseboard
9122025-01-10T05:04:11.224ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9132025-01-10T05:04:11.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64191
9142025-01-10T05:04:11.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64191 req_id = c0d4e1a4-035b-48e4-bae3-3c2a5f9a4ba2 response_code = 200 uri = /timesync
9152025-01-10T05:04:11.235ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2516061351, ip_addr: 149.248.12.167, stratum: 3, ref_time: 1736485449.8534174, correction: 0.076635301 } file = sled-agent/src/rack_setup/service.rs:743
9162025-01-10T05:04:11.235ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9172025-01-10T05:04:11.395ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1343461989832016708 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9182025-01-10T05:04:11.395ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4658672294461489299 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9192025-01-10T05:04:12.540ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9202025-01-10T05:04:12.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54458
9212025-01-10T05:04:12.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8769 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54458 req_id = 8c72fd8c-0be9-49da-bee8-a60324c05123 response_code = 200 uri = /timesync
9222025-01-10T05:04:12.551ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2516061351, ip_addr: 149.248.12.167, stratum: 3, ref_time: 1736485451.565822, correction: 0.072911948 } file = sled-agent/src/rack_setup/service.rs:743
9232025-01-10T05:04:12.551ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9242025-01-10T05:04:14.289ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9252025-01-10T05:04:14.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44101
9262025-01-10T05:04:14.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8418 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44101 req_id = bebe04db-b4bc-4163-80c6-4c89c35099bb response_code = 200 uri = /timesync
9272025-01-10T05:04:14.301ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2516061351, ip_addr: 149.248.12.167, stratum: 3, ref_time: 1736485452.5721085, correction: 0.068231627 } file = sled-agent/src/rack_setup/service.rs:743
9282025-01-10T05:04:14.301ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9292025-01-10T05:04:15.381ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16993052371217700160 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9302025-01-10T05:04:15.381ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8214236899682746499 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9312025-01-10T05:04:15.534ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9322025-01-10T05:04:15.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64851
9332025-01-10T05:04:15.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8679 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64851 req_id = 2c2d8215-dc18-4b8e-9ec7-86b86887837f response_code = 200 uri = /timesync
9342025-01-10T05:04:15.545ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2516061351, ip_addr: 149.248.12.167, stratum: 3, ref_time: 1736485454.501345, correction: 0.065252304 } file = sled-agent/src/rack_setup/service.rs:743
9352025-01-10T05:04:15.545ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9362025-01-10T05:04:17.274ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9783228898214164193 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9372025-01-10T05:04:17.426ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9382025-01-10T05:04:17.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44587
9392025-01-10T05:04:17.427ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4115298416508984310 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9402025-01-10T05:04:17.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8512 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44587 req_id = c44b4cff-154f-4440-8e64-a3f9674b5364 response_code = 200 uri = /timesync
9412025-01-10T05:04:17.438ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2516061351, ip_addr: 149.248.12.167, stratum: 3, ref_time: 1736485456.848846, correction: 0.059853282 } file = sled-agent/src/rack_setup/service.rs:743
9422025-01-10T05:04:17.438ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9432025-01-10T05:04:17.528ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6288407893850951128 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9442025-01-10T05:04:19.802ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16150807815380570739 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9452025-01-10T05:04:19.802ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10206841596814025130 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9462025-01-10T05:04:20.981ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 666.81124ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9472025-01-10T05:04:21.424ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1343461989832016708 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9482025-01-10T05:04:21.424ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4658672294461489299 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
9492025-01-10T05:04:21.482ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9502025-01-10T05:04:21.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33555
9512025-01-10T05:04:21.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20645 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33555 req_id = 91200298-af77-4376-9025-132e680d6199 response_code = 200 uri = /timesync
9522025-01-10T05:04:21.505ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2516061351, ip_addr: 149.248.12.167, stratum: 3, ref_time: 1736485460.9277244, correction: 0.048855178 } file = sled-agent/src/rack_setup/service.rs:743
9532025-01-10T05:04:21.505ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9542025-01-10T05:04:21.534ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: e93887bd-ffe8-46b8-ad6f-92e0665448ab (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3737e73-ceea-4b83-966e-05b55558955a (service), filesystem_pool: Some(ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 53514ca5-28a5-4b76-afd8-362873acf1d4 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: da96efd1-6357-4f76-822a-2ba6728735f8 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1d46ed58-be63-432e-83e6-d9d61cd8a6cf, kind: Service { id: da96efd1-6357-4f76-822a-2ba6728735f8 }, name: Name("ntp-da96efd1-6357-4f76-822a-2ba6728735f8"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 126])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 04c026c5-9627-4c6d-a672-6ebb52fea050 (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 134e1746-916b-44c9-9b6f-68a40e574f62 (service), filesystem_pool: Some(ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3f4f4f64-cf01-4018-a100-47bbaba9b848 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d66e672-0f83-4450-8722-980e8aa96e6f (service), filesystem_pool: Some(ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External } } } }, OmicronZoneConfig { id: 52178f65-5f7a-4610-aa7c-8f39c0b60127 (service), filesystem_pool: Some(ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9552025-01-10T05:04:21.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45974
9562025-01-10T05:04:21.535ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9572025-01-10T05:04:21.535ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9582025-01-10T05:04:21.545ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9592025-01-10T05:04:21.545ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9602025-01-10T05:04:21.555ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9612025-01-10T05:04:21.555ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, responder: ... }
9622025-01-10T05:04:21.564ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9632025-01-10T05:04:21.564ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9642025-01-10T05:04:21.575ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9652025-01-10T05:04:21.575ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9662025-01-10T05:04:21.585ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9672025-01-10T05:04:21.585ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9682025-01-10T05:04:21.594ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9692025-01-10T05:04:21.594ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Cockroach }, responder: ... }
9702025-01-10T05:04:21.604ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9712025-01-10T05:04:21.604ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9722025-01-10T05:04:21.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9732025-01-10T05:04:21.613ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:177
9742025-01-10T05:04:21.613ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:177
9752025-01-10T05:04:21.613ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9762025-01-10T05:04:21.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9772025-01-10T05:04:21.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9782025-01-10T05:04:21.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9792025-01-10T05:04:21.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9802025-01-10T05:04:21.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9812025-01-10T05:04:21.791ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050 file = illumos-utils/src/zone.rs:325
9822025-01-10T05:04:21.795ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127 file = illumos-utils/src/zone.rs:325
9832025-01-10T05:04:21.800ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62 file = illumos-utils/src/zone.rs:325
9842025-01-10T05:04:21.804ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f file = illumos-utils/src/zone.rs:325
9852025-01-10T05:04:21.809ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848 file = illumos-utils/src/zone.rs:325
9862025-01-10T05:04:21.814ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050 file = illumos-utils/src/zone.rs:363
9872025-01-10T05:04:21.818ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127 file = illumos-utils/src/zone.rs:363
9882025-01-10T05:04:21.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62 file = illumos-utils/src/zone.rs:363
9892025-01-10T05:04:21.827ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f file = illumos-utils/src/zone.rs:363
9902025-01-10T05:04:21.831ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848 file = illumos-utils/src/zone.rs:363
9912025-01-10T05:04:26.125ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='04c026c5-9627-4c6d-a672-6ebb52fea050'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9922025-01-10T05:04:26.126ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
9932025-01-10T05:04:26.187ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='52178f65-5f7a-4610-aa7c-8f39c0b60127'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9942025-01-10T05:04:26.187ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
9952025-01-10T05:04:26.201ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3f4f4f64-cf01-4018-a100-47bbaba9b848'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9962025-01-10T05:04:26.202ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
9972025-01-10T05:04:26.237ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='134e1746-916b-44c9-9b6f-68a40e574f62'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9982025-01-10T05:04:26.237ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
9992025-01-10T05:04:26.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 68.566784ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10002025-01-10T05:04:26.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 53.715506ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10012025-01-10T05:04:26.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 57.83011ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10022025-01-10T05:04:26.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 100.176791ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10032025-01-10T05:04:26.392ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7d66e672-0f83-4450-8722-980e8aa96e6f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10042025-01-10T05:04:26.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 66.542945ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10052025-01-10T05:04:26.401ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10062025-01-10T05:04:26.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 116.051293ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10072025-01-10T05:04:26.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 84.928011ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10082025-01-10T05:04:26.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 114.912673ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10092025-01-10T05:04:26.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 104.607681ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10102025-01-10T05:04:26.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 234.638431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10112025-01-10T05:04:26.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 250.142734ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10122025-01-10T05:04:26.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 65.740132ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10132025-01-10T05:04:26.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 119.48051ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10142025-01-10T05:04:26.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 568.644387ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10152025-01-10T05:04:26.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 51.66859ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10162025-01-10T05:04:26.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 236.699511ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10172025-01-10T05:04:26.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 335.816508ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10182025-01-10T05:04:26.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 461.738223ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10192025-01-10T05:04:26.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 573.077311ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10202025-01-10T05:04:26.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 223.679809ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10212025-01-10T05:04:27.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 1.106064621s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10222025-01-10T05:04:27.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 983.440569ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10232025-01-10T05:04:27.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 445.694994ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10242025-01-10T05:04:27.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 880.673158ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10252025-01-10T05:04:27.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 420.997857ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10262025-01-10T05:04:27.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 1.075138271s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10272025-01-10T05:04:27.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 1.38547803s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10282025-01-10T05:04:28.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 916.448326ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10292025-01-10T05:04:28.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 835.701135ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10302025-01-10T05:04:28.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 1.384629878s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10312025-01-10T05:04:28.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 1.175523501s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10322025-01-10T05:04:29.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 604.023907ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10332025-01-10T05:04:29.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 742.770628ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10342025-01-10T05:04:29.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 920.709469ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10352025-01-10T05:04:29.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 1.458926547s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10362025-01-10T05:04:29.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 969.056312ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10372025-01-10T05:04:29.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 1.407556353s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10382025-01-10T05:04:29.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 731.631259ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10392025-01-10T05:04:30.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 928.673256ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10402025-01-10T05:04:30.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 539.224966ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10412025-01-10T05:04:30.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 1.390734383s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10422025-01-10T05:04:31.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 1.319950399s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10432025-01-10T05:04:31.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 672.839226ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10442025-01-10T05:04:31.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 652.105743ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10452025-01-10T05:04:31.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 769.75446ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10462025-01-10T05:04:31.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 918.971185ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10472025-01-10T05:04:31.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 1.10562329s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10482025-01-10T05:04:32.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 648.64761ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10492025-01-10T05:04:32.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 832.239612ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10502025-01-10T05:04:32.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 555.100845ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10512025-01-10T05:04:32.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 683.665727ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10522025-01-10T05:04:32.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 746.677692ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10532025-01-10T05:04:32.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 1.358565075s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10542025-01-10T05:04:32.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 926.549525ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10552025-01-10T05:04:32.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 1.134758852s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10562025-01-10T05:04:33.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 961.337253ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10572025-01-10T05:04:33.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 1.450090424s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10582025-01-10T05:04:33.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 610.205391ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10592025-01-10T05:04:34.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 630.960481ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10602025-01-10T05:04:34.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 1.312876186s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10612025-01-10T05:04:34.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 620.830573ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10622025-01-10T05:04:34.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 935.765764ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10632025-01-10T05:04:34.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 1.217710046s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10642025-01-10T05:04:34.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 830.349426ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10652025-01-10T05:04:35.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 907.840008ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10662025-01-10T05:04:35.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 748.089996ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10672025-01-10T05:04:35.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 1.259131463s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10682025-01-10T05:04:35.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 604.646644ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10692025-01-10T05:04:35.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 756.298851ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10702025-01-10T05:04:35.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 960.110704ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10712025-01-10T05:04:36.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 1.470456703s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10722025-01-10T05:04:36.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 1.017569363s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10732025-01-10T05:04:36.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 844.242963ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10742025-01-10T05:04:36.744ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 875.584476ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
10752025-01-10T05:04:36.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050") failed: Property not found. retry in 1.466787793s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
10762025-01-10T05:04:36.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62") failed: Property not found. retry in 1.478308636s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
10772025-01-10T05:04:37.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127") failed: Property not found. retry in 1.135264557s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
10782025-01-10T05:04:37.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 1.337075659s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10792025-01-10T05:04:37.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 509.270007ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10802025-01-10T05:04:38.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 1.174251811s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10812025-01-10T05:04:38.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 1.327054244s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10822025-01-10T05:04:39.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 1.345248733s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10832025-01-10T05:04:40.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 918.091383ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10842025-01-10T05:04:40.572ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64606
10852025-01-10T05:04:40.573ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64606 req_id = fc15df81-add2-4da7-b8b0-f31ce37873a6 response_code = 200 uri = /baseboard
10862025-01-10T05:04:40.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 645.664363ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10872025-01-10T05:04:41.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 1.379281512s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10882025-01-10T05:04:41.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 1.443423523s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10892025-01-10T05:04:42.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 796.224115ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10902025-01-10T05:04:43.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 1.292823153s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10912025-01-10T05:04:43.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 1.112026511s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10922025-01-10T05:04:44.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 854.602548ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10932025-01-10T05:04:44.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 1.43846304s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10942025-01-10T05:04:45.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 1.388676698s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10952025-01-10T05:04:45.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 813.025889ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10962025-01-10T05:04:46.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 888.835415ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10972025-01-10T05:04:46.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848") failed: Property not found. retry in 1.385473199s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
10982025-01-10T05:04:47.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f") failed: Property not found. retry in 1.132451501s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
10992025-01-10T05:04:48.696ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_04c026c5-9627-4c6d-a672-6ebb52fea050
11002025-01-10T05:04:48.696ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_52178f65-5f7a-4610-aa7c-8f39c0b60127
11012025-01-10T05:04:48.696ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_134e1746-916b-44c9-9b6f-68a40e574f62
11022025-01-10T05:04:48.696ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_7d66e672-0f83-4450-8722-980e8aa96e6f
11032025-01-10T05:04:48.696ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_3f4f4f64-cf01-4018-a100-47bbaba9b848
11042025-01-10T05:04:48.696ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11052025-01-10T05:04:48.696ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11062025-01-10T05:04:48.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27113554 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45974 req_id = 3d2f8021-f34c-4185-921c-13cac8c93bae response_code = 204 uri = /omicron-zones
11072025-01-10T05:04:48.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53293
11082025-01-10T05:04:48.761ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3769
11092025-01-10T05:04:54.195ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.185596619s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
11102025-01-10T05:04:56.764ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
11112025-01-10T05:05:01.255ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3810
11122025-01-10T05:05:01.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12524293 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53293 req_id = 9b96fe17-7a9d-4fb4-9dc9-fc14e676ae8d response_code = 204 uri = /cockroachdb
11132025-01-10T05:05:01.289ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: e93887bd-ffe8-46b8-ad6f-92e0665448ab (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3737e73-ceea-4b83-966e-05b55558955a (service), filesystem_pool: Some(ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 53514ca5-28a5-4b76-afd8-362873acf1d4 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: da96efd1-6357-4f76-822a-2ba6728735f8 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1d46ed58-be63-432e-83e6-d9d61cd8a6cf, kind: Service { id: da96efd1-6357-4f76-822a-2ba6728735f8 }, name: Name("ntp-da96efd1-6357-4f76-822a-2ba6728735f8"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 126])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 04c026c5-9627-4c6d-a672-6ebb52fea050 (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 134e1746-916b-44c9-9b6f-68a40e574f62 (service), filesystem_pool: Some(ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3f4f4f64-cf01-4018-a100-47bbaba9b848 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d66e672-0f83-4450-8722-980e8aa96e6f (service), filesystem_pool: Some(ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External } } } }, OmicronZoneConfig { id: 52178f65-5f7a-4610-aa7c-8f39c0b60127 (service), filesystem_pool: Some(ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External } } } }, OmicronZoneConfig { id: 95b462f2-3c97-4463-9c08-5404518f33d2 (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 30a043aa-79b8-40f0-889b-b1aa4686508a (service), filesystem_pool: Some(ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 (service), filesystem_pool: Some(ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 (service), filesystem_pool: Some(ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: b6508fc7-5132-4a68-971d-9bf335b84514 (service), filesystem_pool: Some(ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: e6ce4210-0f23-4cfc-9be7-8bc44f632517 (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 653c0b72-61fc-4d52-8e8e-4ac6220d9768 (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: a5e3f8c9-1a4c-4dd6-91bd-33871270c301 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 3debd796-c711-439d-9913-b63f30cdc078 (service), filesystem_pool: Some(ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 050374b9-7679-45e4-b9b9-56fea9c35adf (service), filesystem_pool: Some(ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 89fa2dd5-e305-4b39-9ebc-a584ae68a527 (service), filesystem_pool: Some(ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External } } } }, OmicronZoneConfig { id: dc989af8-860c-489e-88d9-597de46e8599 (service), filesystem_pool: Some(ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External } } } }, OmicronZoneConfig { id: d0cdac34-c171-41bf-841f-0a6bd6d4043e (service), filesystem_pool: Some(ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External } } } }, OmicronZoneConfig { id: 12247d32-23a5-4b06-9d82-88befb2806c4 (service), filesystem_pool: Some(ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External } } } }, OmicronZoneConfig { id: e5c899b6-a7d1-43cf-a703-a6bce9598b89 (service), filesystem_pool: Some(ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External } } } }, OmicronZoneConfig { id: f3c833cf-f5bf-4053-a75a-0cb6a1e8867b (service), filesystem_pool: Some(ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 77c85c98-10e2-4051-a768-a78562e932f4 (service), filesystem_pool: Some(ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External } } } }, OmicronZoneConfig { id: a487e9ba-05c6-4204-ac20-687ccdd80387 (service), filesystem_pool: Some(ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11142025-01-10T05:05:01.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33728
11152025-01-10T05:05:01.290ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11162025-01-10T05:05:01.290ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11172025-01-10T05:05:01.305ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11182025-01-10T05:05:01.305ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11192025-01-10T05:05:01.316ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11202025-01-10T05:05:01.316ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: InternalDns }, responder: ... }
11212025-01-10T05:05:01.326ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11222025-01-10T05:05:01.326ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11232025-01-10T05:05:01.334ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11242025-01-10T05:05:01.334ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11252025-01-10T05:05:01.345ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11262025-01-10T05:05:01.345ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Cockroach }, responder: ... }
11272025-01-10T05:05:01.355ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11282025-01-10T05:05:01.355ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Cockroach }, responder: ... }
11292025-01-10T05:05:01.364ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11302025-01-10T05:05:01.364ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11312025-01-10T05:05:01.372ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11322025-01-10T05:05:01.372ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11332025-01-10T05:05:01.382ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11342025-01-10T05:05:01.382ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11352025-01-10T05:05:01.392ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11362025-01-10T05:05:01.392ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11372025-01-10T05:05:01.404ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11382025-01-10T05:05:01.404ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, kind: Crucible }, responder: ... }
11392025-01-10T05:05:01.414ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11402025-01-10T05:05:01.414ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, kind: Crucible }, responder: ... }
11412025-01-10T05:05:01.424ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11422025-01-10T05:05:01.424ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, kind: Crucible }, responder: ... }
11432025-01-10T05:05:01.434ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11442025-01-10T05:05:01.434ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, kind: Crucible }, responder: ... }
11452025-01-10T05:05:01.446ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11462025-01-10T05:05:01.446ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, kind: Crucible }, responder: ... }
11472025-01-10T05:05:01.458ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11482025-01-10T05:05:01.458ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, kind: Crucible }, responder: ... }
11492025-01-10T05:05:01.470ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11502025-01-10T05:05:01.470ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, kind: Crucible }, responder: ... }
11512025-01-10T05:05:01.484ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11522025-01-10T05:05:01.484ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, kind: Crucible }, responder: ... }
11532025-01-10T05:05:01.496ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11542025-01-10T05:05:01.496ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, kind: Crucible }, responder: ... }
11552025-01-10T05:05:01.509ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11562025-01-10T05:05:01.509ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:177
11572025-01-10T05:05:01.509ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:177
11582025-01-10T05:05:01.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11592025-01-10T05:05:01.629ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11602025-01-10T05:05:01.642ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11612025-01-10T05:05:01.644ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11622025-01-10T05:05:01.658ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11632025-01-10T05:05:01.658ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11642025-01-10T05:05:01.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11652025-01-10T05:05:01.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11662025-01-10T05:05:01.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11672025-01-10T05:05:01.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11682025-01-10T05:05:01.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11692025-01-10T05:05:01.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11702025-01-10T05:05:01.878ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11712025-01-10T05:05:01.878ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11722025-01-10T05:05:01.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11732025-01-10T05:05:01.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11742025-01-10T05:05:01.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11752025-01-10T05:05:01.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11762025-01-10T05:05:01.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11772025-01-10T05:05:01.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11782025-01-10T05:05:01.931ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768 file = illumos-utils/src/zone.rs:325
11792025-01-10T05:05:01.936ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e file = illumos-utils/src/zone.rs:325
11802025-01-10T05:05:01.942ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527 file = illumos-utils/src/zone.rs:325
11812025-01-10T05:05:01.947ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517 file = illumos-utils/src/zone.rs:325
11822025-01-10T05:05:01.953ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599 file = illumos-utils/src/zone.rs:325
11832025-01-10T05:05:01.959ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b file = illumos-utils/src/zone.rs:325
11842025-01-10T05:05:01.964ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387 file = illumos-utils/src/zone.rs:325
11852025-01-10T05:05:02.112ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768 file = illumos-utils/src/zone.rs:363
11862025-01-10T05:05:02.118ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e file = illumos-utils/src/zone.rs:363
11872025-01-10T05:05:02.123ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527 file = illumos-utils/src/zone.rs:363
11882025-01-10T05:05:02.127ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517 file = illumos-utils/src/zone.rs:363
11892025-01-10T05:05:02.132ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599 file = illumos-utils/src/zone.rs:363
11902025-01-10T05:05:02.137ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b file = illumos-utils/src/zone.rs:363
11912025-01-10T05:05:02.143ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387 file = illumos-utils/src/zone.rs:363
11922025-01-10T05:05:02.148ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514 file = illumos-utils/src/zone.rs:325
11932025-01-10T05:05:02.153ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf file = illumos-utils/src/zone.rs:325
11942025-01-10T05:05:02.158ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4 file = illumos-utils/src/zone.rs:325
11952025-01-10T05:05:02.164ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89 file = illumos-utils/src/zone.rs:325
11962025-01-10T05:05:02.170ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4 file = illumos-utils/src/zone.rs:325
11972025-01-10T05:05:02.176ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301 file = illumos-utils/src/zone.rs:325
11982025-01-10T05:05:02.184ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078 file = illumos-utils/src/zone.rs:325
11992025-01-10T05:05:02.251ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12002025-01-10T05:05:02.252ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514 file = illumos-utils/src/zone.rs:363
12012025-01-10T05:05:02.273ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf file = illumos-utils/src/zone.rs:363
12022025-01-10T05:05:02.288ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4 file = illumos-utils/src/zone.rs:363
12032025-01-10T05:05:02.298ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89 file = illumos-utils/src/zone.rs:363
12042025-01-10T05:05:02.307ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4 file = illumos-utils/src/zone.rs:363
12052025-01-10T05:05:02.315ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301 file = illumos-utils/src/zone.rs:363
12062025-01-10T05:05:02.324ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078 file = illumos-utils/src/zone.rs:363
12072025-01-10T05:05:02.387ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12082025-01-10T05:05:02.446ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12092025-01-10T05:05:02.505ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12102025-01-10T05:05:02.567ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12112025-01-10T05:05:02.569ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12122025-01-10T05:05:02.569ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12132025-01-10T05:05:02.633ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 240, 231]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12142025-01-10T05:05:02.633ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12152025-01-10T05:05:02.635ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12162025-01-10T05:05:02.635ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12172025-01-10T05:05:02.691ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 227, 129]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12182025-01-10T05:05:02.691ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
12192025-01-10T05:05:02.693ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12202025-01-10T05:05:02.693ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12212025-01-10T05:05:02.751ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 239, 193]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12222025-01-10T05:05:02.751ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12232025-01-10T05:05:02.753ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12242025-01-10T05:05:02.753ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12252025-01-10T05:05:02.811ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 167, 9]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12262025-01-10T05:05:02.811ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
12272025-01-10T05:05:02.816ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12282025-01-10T05:05:02.816ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12292025-01-10T05:05:02.946ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 194, 198]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12302025-01-10T05:05:02.946ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12312025-01-10T05:05:02.947ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12322025-01-10T05:05:02.947ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12332025-01-10T05:05:02.947ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12342025-01-10T05:05:02.947ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12352025-01-10T05:05:02.947ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12362025-01-10T05:05:02.947ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12372025-01-10T05:05:02.951ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12382025-01-10T05:05:02.951ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12392025-01-10T05:05:02.951ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12402025-01-10T05:05:02.951ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12412025-01-10T05:05:02.959ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12422025-01-10T05:05:02.964ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12432025-01-10T05:05:02.974ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12442025-01-10T05:05:02.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12452025-01-10T05:05:02.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12462025-01-10T05:05:02.980ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12472025-01-10T05:05:02.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12482025-01-10T05:05:02.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12492025-01-10T05:05:02.984ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12502025-01-10T05:05:03.385ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12512025-01-10T05:05:03.385ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a file = illumos-utils/src/zone.rs:325
12522025-01-10T05:05:03.693ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 file = illumos-utils/src/zone.rs:325
12532025-01-10T05:05:04.113ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2 file = illumos-utils/src/zone.rs:325
12542025-01-10T05:05:04.122ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44 file = illumos-utils/src/zone.rs:325
12552025-01-10T05:05:04.170ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a file = illumos-utils/src/zone.rs:363
12562025-01-10T05:05:04.177ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 file = illumos-utils/src/zone.rs:363
12572025-01-10T05:05:04.187ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2 file = illumos-utils/src/zone.rs:363
12582025-01-10T05:05:04.194ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44 file = illumos-utils/src/zone.rs:363
12592025-01-10T05:05:04.202ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa file = illumos-utils/src/zone.rs:325
12602025-01-10T05:05:04.234ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa file = illumos-utils/src/zone.rs:363
12612025-01-10T05:05:06.853ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12622025-01-10T05:05:06.854ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12632025-01-10T05:05:06.855ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
12642025-01-10T05:05:06.880ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
12652025-01-10T05:05:08.164ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_721ba211-f349-4837-89b3-f4cf559302bb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e4b1ae6c-44a6-4098-8abb-695bcce517d0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12662025-01-10T05:05:08.164ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1ceb1ad5-1952-4abe-b542-37b814690640/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='25ee0526-d2c3-4f08-b56b-67552a9a94dc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12672025-01-10T05:05:08.166ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5c7c8012-1908-4829-b530-3992d83456e0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='93cf55bc-ff6c-4cb4-9c93-4cad2cda8320'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12682025-01-10T05:05:08.166ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_49894127-b79c-4807-aac5-383699d40578/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ebcd1d2d-5e51-48d5-a451-34b316e4f6ef'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12692025-01-10T05:05:08.167ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_19b37234-d205-4094-b223-ad0e72e9c46e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7f25c87f-bbb9-411d-8d4b-1ae48f1abfcc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12702025-01-10T05:05:08.168ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e311d6a2-73e1-49eb-aaee-6c6402c1e1a9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12712025-01-10T05:05:08.168ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
12722025-01-10T05:05:08.178ZINFOSledAgent (ServiceManager): Booting oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
12732025-01-10T05:05:08.187ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
12742025-01-10T05:05:08.195ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
12752025-01-10T05:05:08.204ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
12762025-01-10T05:05:08.212ZINFOSledAgent (ServiceManager): Booting oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
12772025-01-10T05:05:08.296ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12782025-01-10T05:05:08.296ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='90fb4202-0fb9-4b9f-96c4-9dc4bc05e251'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12792025-01-10T05:05:08.301ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
12802025-01-10T05:05:12.142ZINFOSledAgent (ServiceManager): Booting oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
12812025-01-10T05:05:13.380ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.148775676s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
12822025-01-10T05:05:13.996ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49746
12832025-01-10T05:05:14.354ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96710 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49746 req_id = c22391da-d87e-4566-9e35-9c132ec4069a response_code = 200 uri = /baseboard
12842025-01-10T05:05:20.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 61.030847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
12852025-01-10T05:05:20.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 73.35631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
12862025-01-10T05:05:20.215ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='b6508fc7-5132-4a68-971d-9bf335b84514'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12872025-01-10T05:05:20.221ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='69378f51-51a0-4cb3-aa8a-c804b4c2d4b5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12882025-01-10T05:05:20.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 40.745874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
12892025-01-10T05:05:20.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 61.277241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
12902025-01-10T05:05:20.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 63.589186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
12912025-01-10T05:05:20.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 49.068031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
12922025-01-10T05:05:20.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 49.835232ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
12932025-01-10T05:05:20.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 43.60933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
12942025-01-10T05:05:20.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 26.081733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
12952025-01-10T05:05:20.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 120.819603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
12962025-01-10T05:05:20.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 110.261122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
12972025-01-10T05:05:20.303ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
12982025-01-10T05:05:20.348ZINFOSledAgent (ServiceManager): Booting oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
12992025-01-10T05:05:20.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 55.520017ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
13002025-01-10T05:05:20.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 54.049739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
13012025-01-10T05:05:20.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 77.894446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
13022025-01-10T05:05:20.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 145.242706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
13032025-01-10T05:05:20.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 89.599373ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
13042025-01-10T05:05:20.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 123.747237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
13052025-01-10T05:05:20.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 130.623332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
13062025-01-10T05:05:20.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 71.843816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
13072025-01-10T05:05:20.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 127.493228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
13082025-01-10T05:05:20.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 115.202535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
13092025-01-10T05:05:20.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 199.55684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
13102025-01-10T05:05:20.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 164.524996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
13112025-01-10T05:05:20.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 161.014512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
13122025-01-10T05:05:20.478ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13132025-01-10T05:05:20.478ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13142025-01-10T05:05:20.478ZINFOSledAgent (ServiceManager): Booting oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
13152025-01-10T05:05:20.483ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
13162025-01-10T05:05:20.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 59.693166ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
13172025-01-10T05:05:20.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 152.522229ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
13182025-01-10T05:05:20.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 140.914242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
13192025-01-10T05:05:20.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 52.178629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
13202025-01-10T05:05:20.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 202.214113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
13212025-01-10T05:05:20.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 108.105042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
13222025-01-10T05:05:20.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 103.377031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
13232025-01-10T05:05:20.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 148.230023ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
13242025-01-10T05:05:20.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 517.425714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
13252025-01-10T05:05:20.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 485.505267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
13262025-01-10T05:05:20.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 110.774616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
13272025-01-10T05:05:20.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 212.162248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
13282025-01-10T05:05:20.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 421.140425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
13292025-01-10T05:05:20.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 60.274856ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
13302025-01-10T05:05:20.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 519.777068ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
13312025-01-10T05:05:20.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 64.234679ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
13322025-01-10T05:05:20.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 102.849869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
13332025-01-10T05:05:20.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 319.410475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
13342025-01-10T05:05:20.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 537.033333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
13352025-01-10T05:05:20.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 260.933868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
13362025-01-10T05:05:20.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 168.424065ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
13372025-01-10T05:05:20.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 73.924821ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
13382025-01-10T05:05:20.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 190.917574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
13392025-01-10T05:05:20.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 99.487363ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
13402025-01-10T05:05:20.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 558.357489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
13412025-01-10T05:05:20.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 567.535039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
13422025-01-10T05:05:20.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 275.891561ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
13432025-01-10T05:05:20.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 958.716629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
13442025-01-10T05:05:20.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 215.33912ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
13452025-01-10T05:05:20.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 326.282121ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
13462025-01-10T05:05:20.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 443.871795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
13472025-01-10T05:05:21.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.174341155s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
13482025-01-10T05:05:21.004ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13492025-01-10T05:05:21.004ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
13502025-01-10T05:05:21.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 482.269426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
13512025-01-10T05:05:21.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 499.428146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
13522025-01-10T05:05:21.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 942.976747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
13532025-01-10T05:05:21.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 531.295727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
13542025-01-10T05:05:21.109ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4eca0c37-9613-4951-95ae-1493d52e66ef'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552025-01-10T05:05:21.109ZINFOSledAgent (ServiceManager): Booting oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
13562025-01-10T05:05:21.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 315.287413ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
13572025-01-10T05:05:21.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 453.977854ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
13582025-01-10T05:05:21.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 27.418338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
13592025-01-10T05:05:21.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 533.19739ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
13602025-01-10T05:05:21.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 50.806246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
13612025-01-10T05:05:21.239ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13622025-01-10T05:05:21.239ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
13632025-01-10T05:05:21.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 1.16783476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
13642025-01-10T05:05:21.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 1.055943237s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
13652025-01-10T05:05:21.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 50.805801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
13662025-01-10T05:05:21.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 239.612729ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
13672025-01-10T05:05:21.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 70.201297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
13682025-01-10T05:05:21.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 456.792682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
13692025-01-10T05:05:21.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 1.126476638s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
13702025-01-10T05:05:21.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 160.195237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
13712025-01-10T05:05:21.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 930.765755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
13722025-01-10T05:05:21.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 49.010053ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
13732025-01-10T05:05:21.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 1.159665895s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
13742025-01-10T05:05:21.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 1.471061089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
13752025-01-10T05:05:21.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 86.475416ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
13762025-01-10T05:05:21.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 473.324484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
13772025-01-10T05:05:21.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 253.542072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
13782025-01-10T05:05:21.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 1.267462387s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
13792025-01-10T05:05:21.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 801.501604ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
13802025-01-10T05:05:21.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 122.481847ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
13812025-01-10T05:05:21.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 1.357148272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
13822025-01-10T05:05:21.686ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13832025-01-10T05:05:21.687ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
13842025-01-10T05:05:21.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 711.70944ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
13852025-01-10T05:05:21.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 447.115415ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
13862025-01-10T05:05:21.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 607.965061ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
13872025-01-10T05:05:21.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 601.912869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
13882025-01-10T05:05:21.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 883.739847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
13892025-01-10T05:05:21.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 29.459148ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
13902025-01-10T05:05:22.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 816.846304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
13912025-01-10T05:05:22.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 70.480135ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
13922025-01-10T05:05:22.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 1.292615526s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
13932025-01-10T05:05:22.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 157.852337ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
13942025-01-10T05:05:22.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.387565613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
13952025-01-10T05:05:22.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 784.442485ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
13962025-01-10T05:05:22.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 357.404387ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
13972025-01-10T05:05:22.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 1.156417453s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
13982025-01-10T05:05:22.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 580.8703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
13992025-01-10T05:05:22.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 583.444914ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
14002025-01-10T05:05:22.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 562.580476ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
14012025-01-10T05:05:22.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 529.117584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
14022025-01-10T05:05:22.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 943.620639ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
14032025-01-10T05:05:22.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 663.042113ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
14042025-01-10T05:05:22.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 632.63002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
14052025-01-10T05:05:22.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 1.024226057s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
14062025-01-10T05:05:22.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 435.9085ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
14072025-01-10T05:05:22.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 1.432140893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
14082025-01-10T05:05:22.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 809.445277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
14092025-01-10T05:05:22.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 1.246570864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
14102025-01-10T05:05:22.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 1.019284594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
14112025-01-10T05:05:23.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 919.509806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
14122025-01-10T05:05:23.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 641.104058ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
14132025-01-10T05:05:23.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 572.309947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
14142025-01-10T05:05:23.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 823.073431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
14152025-01-10T05:05:23.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 1.375793724s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
14162025-01-10T05:05:23.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 534.699955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
14172025-01-10T05:05:23.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 999.277086ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
14182025-01-10T05:05:23.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 699.672838ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
14192025-01-10T05:05:23.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 595.638921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
14202025-01-10T05:05:23.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 1.487373251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
14212025-01-10T05:05:23.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 1.44725732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
14222025-01-10T05:05:23.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 654.63367ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
14232025-01-10T05:05:23.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 502.242677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
14242025-01-10T05:05:23.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 809.988828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
14252025-01-10T05:05:23.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 1.108838198s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
14262025-01-10T05:05:23.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 1.46819256s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
14272025-01-10T05:05:23.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 1.477613842s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
14282025-01-10T05:05:23.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 533.054806ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
14292025-01-10T05:05:23.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 1.158316344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
14302025-01-10T05:05:23.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 1.459256611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
14312025-01-10T05:05:23.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 1.242120023s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
14322025-01-10T05:05:23.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 810.929256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
14332025-01-10T05:05:24.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 1.000341131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
14342025-01-10T05:05:24.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.129334622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
14352025-01-10T05:05:24.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 612.667355ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
14362025-01-10T05:05:24.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 865.899423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
14372025-01-10T05:05:24.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 1.211109904s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
14382025-01-10T05:05:24.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 1.291797304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
14392025-01-10T05:05:24.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 1.119654511s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
14402025-01-10T05:05:24.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 694.229175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
14412025-01-10T05:05:24.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 1.171301742s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
14422025-01-10T05:05:24.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 1.209276439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
14432025-01-10T05:05:24.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 583.593708ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
14442025-01-10T05:05:24.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 984.028349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
14452025-01-10T05:05:24.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 781.116968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
14462025-01-10T05:05:24.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 502.584281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
14472025-01-10T05:05:24.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 721.35142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
14482025-01-10T05:05:25.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 1.473159748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
14492025-01-10T05:05:25.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 1.076753774s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
14502025-01-10T05:05:25.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 727.903204ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
14512025-01-10T05:05:25.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 696.078981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
14522025-01-10T05:05:25.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 983.509793ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
14532025-01-10T05:05:25.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 984.975158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
14542025-01-10T05:05:25.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.084044801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
14552025-01-10T05:05:25.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 957.84203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
14562025-01-10T05:05:25.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 584.812571ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
14572025-01-10T05:05:25.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 891.640187ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
14582025-01-10T05:05:25.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 919.720622ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
14592025-01-10T05:05:25.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 1.154353605s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
14602025-01-10T05:05:25.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 895.260521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
14612025-01-10T05:05:25.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 1.1208189s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
14622025-01-10T05:05:25.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 750.059992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
14632025-01-10T05:05:25.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 718.550163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
14642025-01-10T05:05:25.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 985.956611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
14652025-01-10T05:05:25.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 1.179067367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
14662025-01-10T05:05:25.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 1.391983384s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
14672025-01-10T05:05:25.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 1.477880418s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
14682025-01-10T05:05:26.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 1.477539223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
14692025-01-10T05:05:26.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 1.479831092s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
14702025-01-10T05:05:26.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 1.240720746s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
14712025-01-10T05:05:26.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 833.498335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
14722025-01-10T05:05:26.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 932.890923ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
14732025-01-10T05:05:26.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 670.130435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
14742025-01-10T05:05:26.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 1.433593744s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
14752025-01-10T05:05:26.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.37842509s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
14762025-01-10T05:05:26.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 947.25084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
14772025-01-10T05:05:26.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 854.043314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
14782025-01-10T05:05:26.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 615.935971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
14792025-01-10T05:05:26.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 1.439569662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
14802025-01-10T05:05:26.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 700.174904ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
14812025-01-10T05:05:26.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 1.19695516s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
14822025-01-10T05:05:26.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 1.141518948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
14832025-01-10T05:05:27.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 1.332938156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
14842025-01-10T05:05:27.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 679.620309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
14852025-01-10T05:05:27.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 757.21523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
14862025-01-10T05:05:27.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 1.259623148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
14872025-01-10T05:05:27.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 988.137649ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
14882025-01-10T05:05:27.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 695.413942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
14892025-01-10T05:05:27.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 537.122911ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
14902025-01-10T05:05:27.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 851.466693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
14912025-01-10T05:05:27.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 872.556059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
14922025-01-10T05:05:27.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 1.014932755s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
14932025-01-10T05:05:27.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 578.887147ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
14942025-01-10T05:05:27.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 1.416976807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
14952025-01-10T05:05:27.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 528.50661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
14962025-01-10T05:05:27.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 626.319104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
14972025-01-10T05:05:27.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.317723654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
14982025-01-10T05:05:27.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 1.471028403s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
14992025-01-10T05:05:27.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 1.421316987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
15002025-01-10T05:05:27.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 1.35318842s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
15012025-01-10T05:05:27.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 804.708506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
15022025-01-10T05:05:27.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 501.904992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
15032025-01-10T05:05:27.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 725.07221ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
15042025-01-10T05:05:28.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 641.136826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
15052025-01-10T05:05:28.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 1.371624677s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
15062025-01-10T05:05:28.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 689.985881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
15072025-01-10T05:05:28.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 626.202013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
15082025-01-10T05:05:28.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 1.115984649s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
15092025-01-10T05:05:28.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 1.31622059s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
15102025-01-10T05:05:28.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 1.085859451s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
15112025-01-10T05:05:28.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 693.963795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
15122025-01-10T05:05:28.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 1.374886267s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
15132025-01-10T05:05:28.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 1.072656864s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
15142025-01-10T05:05:28.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 973.672487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
15152025-01-10T05:05:28.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 1.327915802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
15162025-01-10T05:05:28.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 933.502852ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
15172025-01-10T05:05:28.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 1.397082532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
15182025-01-10T05:05:28.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 718.0301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
15192025-01-10T05:05:28.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 1.055698663s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
15202025-01-10T05:05:28.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 886.789179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
15212025-01-10T05:05:29.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 991.525067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
15222025-01-10T05:05:29.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 728.076648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
15232025-01-10T05:05:29.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 888.676434ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
15242025-01-10T05:05:29.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 609.486685ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
15252025-01-10T05:05:29.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 913.679878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
15262025-01-10T05:05:29.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 981.82195ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
15272025-01-10T05:05:29.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 919.160753ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
15282025-01-10T05:05:29.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 602.39663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
15292025-01-10T05:05:29.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 1.234554549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
15302025-01-10T05:05:29.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 1.475576531s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
15312025-01-10T05:05:29.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 815.18934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
15322025-01-10T05:05:29.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 763.623958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
15332025-01-10T05:05:29.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 1.37731763s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
15342025-01-10T05:05:29.748ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15352025-01-10T05:05:29.748ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
15362025-01-10T05:05:29.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 524.997452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
15372025-01-10T05:05:29.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 522.016707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
15382025-01-10T05:05:29.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 1.216121581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
15392025-01-10T05:05:29.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 922.815658ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
15402025-01-10T05:05:29.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 41.410835ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
15412025-01-10T05:05:29.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 999.396166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
15422025-01-10T05:05:29.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 146.479454ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
15432025-01-10T05:05:29.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 1.070958001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
15442025-01-10T05:05:30.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 706.620871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
15452025-01-10T05:05:30.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 653.861767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
15462025-01-10T05:05:30.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 278.671051ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
15472025-01-10T05:05:30.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 1.111053813s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
15482025-01-10T05:05:30.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 1.066313772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
15492025-01-10T05:05:30.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 736.133768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
15502025-01-10T05:05:30.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 1.427012688s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
15512025-01-10T05:05:30.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 705.296253ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
15522025-01-10T05:05:30.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 722.179415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
15532025-01-10T05:05:30.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 1.313495984s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
15542025-01-10T05:05:30.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 542.681164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
15552025-01-10T05:05:30.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 1.206136553s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
15562025-01-10T05:05:30.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 567.343255ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
15572025-01-10T05:05:30.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 777.811055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
15582025-01-10T05:05:30.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.464660041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
15592025-01-10T05:05:30.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 1.483588891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
15602025-01-10T05:05:30.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 590.70506ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
15612025-01-10T05:05:30.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 853.103686ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
15622025-01-10T05:05:30.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 1.484584481s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
15632025-01-10T05:05:30.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 1.075859237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
15642025-01-10T05:05:31.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 856.176998ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
15652025-01-10T05:05:31.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 798.724844ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
15662025-01-10T05:05:31.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 701.031633ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
15672025-01-10T05:05:31.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 1.045384554s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
15682025-01-10T05:05:31.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 1.28941001s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
15692025-01-10T05:05:31.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 529.862362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
15702025-01-10T05:05:31.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 708.670788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
15712025-01-10T05:05:31.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 755.546831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
15722025-01-10T05:05:31.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 690.9927ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
15732025-01-10T05:05:31.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 548.588183ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
15742025-01-10T05:05:31.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 1.122958079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
15752025-01-10T05:05:31.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 634.819955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
15762025-01-10T05:05:31.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 519.77535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
15772025-01-10T05:05:31.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 799.70916ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
15782025-01-10T05:05:31.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 948.855923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
15792025-01-10T05:05:31.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 873.664943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
15802025-01-10T05:05:31.775ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.628558181s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
15812025-01-10T05:05:31.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 1.031794425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
15822025-01-10T05:05:31.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 1.459590589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
15832025-01-10T05:05:31.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 892.646664ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
15842025-01-10T05:05:31.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 914.83409ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
15852025-01-10T05:05:31.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 897.741128ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
15862025-01-10T05:05:31.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 610.850324ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
15872025-01-10T05:05:32.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 781.323282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
15882025-01-10T05:05:32.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 1.345869313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
15892025-01-10T05:05:32.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 921.066625ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
15902025-01-10T05:05:32.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 839.751041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
15912025-01-10T05:05:32.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 648.896199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
15922025-01-10T05:05:32.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 1.114996917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
15932025-01-10T05:05:32.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 1.478804619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
15942025-01-10T05:05:32.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 1.378805479s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
15952025-01-10T05:05:32.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 564.809116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
15962025-01-10T05:05:32.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 543.905824ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
15972025-01-10T05:05:32.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 1.403529501s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
15982025-01-10T05:05:32.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387") failed: Property not found. retry in 1.268660624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
15992025-01-10T05:05:32.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 1.0267088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
16002025-01-10T05:05:32.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 982.792052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
16012025-01-10T05:05:32.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 807.816107ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
16022025-01-10T05:05:32.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 1.363531257s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
16032025-01-10T05:05:32.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 862.851993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
16042025-01-10T05:05:32.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 1.459694765s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
16052025-01-10T05:05:32.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.398782584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
16062025-01-10T05:05:32.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 1.192156466s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
16072025-01-10T05:05:33.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 975.982731ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
16082025-01-10T05:05:33.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 1.444133802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
16092025-01-10T05:05:33.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 1.238565667s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
16102025-01-10T05:05:33.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 719.420253ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
16112025-01-10T05:05:33.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 806.769768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
16122025-01-10T05:05:33.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 1.113923057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
16132025-01-10T05:05:33.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 992.208343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
16142025-01-10T05:05:33.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 722.015964ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
16152025-01-10T05:05:33.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 783.033215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
16162025-01-10T05:05:33.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 1.141368249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
16172025-01-10T05:05:33.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 738.753078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
16182025-01-10T05:05:33.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 860.103322ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
16192025-01-10T05:05:33.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 1.388699038s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
16202025-01-10T05:05:33.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 933.984786ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
16212025-01-10T05:05:33.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 1.448107762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
16222025-01-10T05:05:34.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 1.416773132s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
16232025-01-10T05:05:34.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 1.325225327s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
16242025-01-10T05:05:34.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 1.038687898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
16252025-01-10T05:05:34.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 1.069586223s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
16262025-01-10T05:05:34.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 1.070009355s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
16272025-01-10T05:05:34.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 869.031969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
16282025-01-10T05:05:34.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 1.391781579s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
16292025-01-10T05:05:34.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 538.332613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
16302025-01-10T05:05:34.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 725.260779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
16312025-01-10T05:05:34.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 624.301122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
16322025-01-10T05:05:34.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 1.02257606s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
16332025-01-10T05:05:34.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 697.509176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
16342025-01-10T05:05:34.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 842.945261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
16352025-01-10T05:05:34.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 1.445471682s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
16362025-01-10T05:05:34.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 710.270416ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
16372025-01-10T05:05:34.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 879.003631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
16382025-01-10T05:05:34.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 786.391326ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
16392025-01-10T05:05:35.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4") failed: Property not found. retry in 1.306617317s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
16402025-01-10T05:05:35.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 670.702012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
16412025-01-10T05:05:35.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768") failed: Property not found. retry in 1.484432581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
16422025-01-10T05:05:35.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527") failed: Property not found. retry in 1.237387206s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
16432025-01-10T05:05:35.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.256470014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
16442025-01-10T05:05:35.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89") failed: Property not found. retry in 1.024718144s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
16452025-01-10T05:05:35.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 1.410999895s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
16462025-01-10T05:05:35.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf") failed: Property not found. retry in 1.480108112s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
16472025-01-10T05:05:35.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8") failed: Property not found. retry in 1.235401121s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
16482025-01-10T05:05:35.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 551.65933ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
16492025-01-10T05:05:35.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 616.493372ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
16502025-01-10T05:05:35.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa") failed: Property not found. retry in 1.493273537s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
16512025-01-10T05:05:35.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 814.357379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
16522025-01-10T05:05:35.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 739.812716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
16532025-01-10T05:05:35.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301") failed: Property not found. retry in 700.840289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
16542025-01-10T05:05:35.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 559.602493ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
16552025-01-10T05:05:35.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599") failed: Property not found. retry in 1.294015061s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
16562025-01-10T05:05:35.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b") failed: Property not found. retry in 1.362744245s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
16572025-01-10T05:05:35.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514") failed: Property not found. retry in 1.200939482s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
16582025-01-10T05:05:36.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a") failed: Property not found. retry in 829.502186ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
16592025-01-10T05:05:36.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44") failed: Property not found. retry in 1.430611244s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
16602025-01-10T05:05:36.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4") failed: Property not found. retry in 1.311075037s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
16612025-01-10T05:05:36.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2") failed: Property not found. retry in 1.008930041s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
16622025-01-10T05:05:36.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e") failed: Property not found. retry in 734.803937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
16632025-01-10T05:05:36.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078") failed: Property not found. retry in 1.388898347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
16642025-01-10T05:05:36.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 721.784608ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
16652025-01-10T05:05:37.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 1.412211645s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
16662025-01-10T05:05:38.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 1.356596609s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
16672025-01-10T05:05:40.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 1.259313885s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
16682025-01-10T05:05:41.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517") failed: Property not found. retry in 1.19607917s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
16692025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_a5a77b64-bc6f-4038-bc69-a5f388ab2baa
16702025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_30a043aa-79b8-40f0-889b-b1aa4686508a
16712025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8
16722025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_653c0b72-61fc-4d52-8e8e-4ac6220d9768
16732025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_95b462f2-3c97-4463-9c08-5404518f33d2
16742025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_d0cdac34-c171-41bf-841f-0a6bd6d4043e
16752025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_89fa2dd5-e305-4b39-9ebc-a584ae68a527
16762025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_clickhouse_e6ce4210-0f23-4cfc-9be7-8bc44f632517
16772025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_dc989af8-860c-489e-88d9-597de46e8599
16782025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_f3c833cf-f5bf-4053-a75a-0cb6a1e8867b
16792025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_a487e9ba-05c6-4204-ac20-687ccdd80387
16802025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_oximeter_b6508fc7-5132-4a68-971d-9bf335b84514
16812025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_36b3525a-4d18-4be7-8420-a6b90a955a44
16822025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_050374b9-7679-45e4-b9b9-56fea9c35adf
16832025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_12247d32-23a5-4b06-9d82-88befb2806c4
16842025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_e5c899b6-a7d1-43cf-a703-a6bce9598b89
16852025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_77c85c98-10e2-4051-a768-a78562e932f4
16862025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_a5e3f8c9-1a4c-4dd6-91bd-33871270c301
16872025-01-10T05:05:42.724ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_3debd796-c711-439d-9913-b63f30cdc078
16882025-01-10T05:05:42.762ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16892025-01-10T05:05:42.846ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16902025-01-10T05:05:43.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41725263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33728 req_id = 0da12160-748c-43ce-9e08-37e17d43f606 response_code = 204 uri = /omicron-zones
16912025-01-10T05:05:43.209ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16922025-01-10T05:05:43.303ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16932025-01-10T05:05:43.319ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:803
16942025-01-10T05:05:43.403ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
16952025-01-10T05:05:43.456ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/79fde928-482f-41ab-aee3-3f2478145f08/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16962025-01-10T05:05:43.461ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 14.373369192s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
16972025-01-10T05:05:43.533ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/79fde928-482f-41ab-aee3-3f2478145f08/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16982025-01-10T05:05:43.676ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/79fde928-482f-41ab-aee3-3f2478145f08/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16992025-01-10T05:05:43.778ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/79fde928-482f-41ab-aee3-3f2478145f08/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17002025-01-10T05:05:43.992ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/79fde928-482f-41ab-aee3-3f2478145f08/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17012025-01-10T05:05:44.142ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/79fde928-482f-41ab-aee3-3f2478145f08/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17022025-01-10T05:05:44.418ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52299
17032025-01-10T05:05:44.430ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10874 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52299 req_id = 5ea27b37-0b4a-4413-9fc3-ce07dc0e97bf response_code = 200 uri = /baseboard
17042025-01-10T05:05:44.477ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/79fde928-482f-41ab-aee3-3f2478145f08/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17052025-01-10T05:05:47.478ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5388ddb9-6a71-4efa-bae3-c8437f7c2a15", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"79fde928-482f-41ab-aee3-3f2478145f08\"", request_id: "5388ddb9-6a71-4efa-bae3-c8437f7c2a15" } file = sled-agent/src/rack_setup/service.rs:1079
17062025-01-10T05:05:49.169ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7e1a3fd3-cd13-4421-9862-6e5edf29dee6", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"79fde928-482f-41ab-aee3-3f2478145f08\"", request_id: "7e1a3fd3-cd13-4421-9862-6e5edf29dee6" } file = sled-agent/src/rack_setup/service.rs:1079
17072025-01-10T05:05:49.818ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f795982e-f099-48d0-8395-55588e0b7e28", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"79fde928-482f-41ab-aee3-3f2478145f08\"", request_id: "f795982e-f099-48d0-8395-55588e0b7e28" } file = sled-agent/src/rack_setup/service.rs:1079
17082025-01-10T05:05:50.607ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d9e0968f-42d4-430c-8952-66d1b32ac48b", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"79fde928-482f-41ab-aee3-3f2478145f08\"", request_id: "d9e0968f-42d4-430c-8952-66d1b32ac48b" } file = sled-agent/src/rack_setup/service.rs:1079
17092025-01-10T05:05:51.156ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "966d9478-fac6-428e-a2e4-d769afde9805", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"79fde928-482f-41ab-aee3-3f2478145f08\"", request_id: "966d9478-fac6-428e-a2e4-d769afde9805" } file = sled-agent/src/rack_setup/service.rs:1079
17102025-01-10T05:05:51.985ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "87571f34-7f4e-46bd-8e50-1359d97346f7", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"79fde928-482f-41ab-aee3-3f2478145f08\"", request_id: "87571f34-7f4e-46bd-8e50-1359d97346f7" } file = sled-agent/src/rack_setup/service.rs:1079
17112025-01-10T05:05:54.368ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "07d6f441-e0d4-49ce-b7c8-ade1b2e4acad", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59\"", request_id: "07d6f441-e0d4-49ce-b7c8-ade1b2e4acad" } file = sled-agent/src/rack_setup/service.rs:1079
17122025-01-10T05:05:56.009ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "fa434aae-aaac-4f10-a618-43601abba0fe", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59\"", request_id: "fa434aae-aaac-4f10-a618-43601abba0fe" } file = sled-agent/src/rack_setup/service.rs:1079
17132025-01-10T05:05:57.127ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "16fd6464-1f39-434e-9932-6341c64c5dfa", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59\"", request_id: "16fd6464-1f39-434e-9932-6341c64c5dfa" } file = sled-agent/src/rack_setup/service.rs:1079
17142025-01-10T05:05:59.295ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5b664e8f-65a7-4539-b227-0ce2da532ea2", "content-length": "173", "date": "Fri, 10 Jan 2025 05:05:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59\"", request_id: "5b664e8f-65a7-4539-b227-0ce2da532ea2" } file = sled-agent/src/rack_setup/service.rs:1079
17152025-01-10T05:06:02.165ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ea960e8c-2ee5-47e2-a8f8-78b756eb607b", "content-length": "173", "date": "Fri, 10 Jan 2025 05:06:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59\"", request_id: "ea960e8c-2ee5-47e2-a8f8-78b756eb607b" } file = sled-agent/src/rack_setup/service.rs:1079
17162025-01-10T05:06:05.018ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7828214b-32b0-40c2-b676-340b133194cd", "content-length": "173", "date": "Fri, 10 Jan 2025 05:06:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59\"", request_id: "7828214b-32b0-40c2-b676-340b133194cd" } file = sled-agent/src/rack_setup/service.rs:1079
17172025-01-10T05:06:06.279ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
17182025-01-10T05:06:06.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59255
17192025-01-10T05:06:06.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17202025-01-10T05:06:06.372ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17212025-01-10T05:06:06.372ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:177
17222025-01-10T05:06:06.375ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:177
17232025-01-10T05:06:06.394ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17242025-01-10T05:06:06.394ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1
17252025-01-10T05:06:06.426ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17262025-01-10T05:06:06.426ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ceb1ad5-1952-4abe-b542-37b814690640
17272025-01-10T05:06:06.450ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17282025-01-10T05:06:06.450ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f
17292025-01-10T05:06:06.474ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17302025-01-10T05:06:06.474ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_721ba211-f349-4837-89b3-f4cf559302bb
17312025-01-10T05:06:06.498ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17322025-01-10T05:06:06.498ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49
17332025-01-10T05:06:06.520ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17342025-01-10T05:06:06.520ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_19b37234-d205-4094-b223-ad0e72e9c46e
17352025-01-10T05:06:06.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17362025-01-10T05:06:06.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c7c8012-1908-4829-b530-3992d83456e0
17372025-01-10T05:06:06.565ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17382025-01-10T05:06:06.565ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794
17392025-01-10T05:06:06.587ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17402025-01-10T05:06:06.587ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_49894127-b79c-4807-aac5-383699d40578
17412025-01-10T05:06:06.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59255 req_id = 57063c8c-25ee-4a38-9732-9a2103859c43 response_code = 200 uri = /inventory
17422025-01-10T05:06:09.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51176
17432025-01-10T05:06:09.681ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17442025-01-10T05:06:09.681ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17452025-01-10T05:06:09.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17462025-01-10T05:06:09.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17472025-01-10T05:06:09.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17482025-01-10T05:06:09.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17492025-01-10T05:06:09.682ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17502025-01-10T05:06:09.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8990 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51176 req_id = 511eb4ed-be1a-4070-b867-c5f1a7619c7b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17512025-01-10T05:06:09.685ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
17522025-01-10T05:06:09.689ZINFOSledAgent (RSS): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17532025-01-10T05:06:09.689ZINFOSledAgent (RSS): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17542025-01-10T05:06:09.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61488
17552025-01-10T05:06:09.915ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17562025-01-10T05:06:09.915ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17572025-01-10T05:06:09.915ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:177
17582025-01-10T05:06:09.917ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:177
17592025-01-10T05:06:09.929ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17602025-01-10T05:06:09.929ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1
17612025-01-10T05:06:09.968ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17622025-01-10T05:06:09.969ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ceb1ad5-1952-4abe-b542-37b814690640
17632025-01-10T05:06:09.994ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17642025-01-10T05:06:09.994ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f
17652025-01-10T05:06:10.016ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17662025-01-10T05:06:10.016ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_721ba211-f349-4837-89b3-f4cf559302bb
17672025-01-10T05:06:10.037ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17682025-01-10T05:06:10.037ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49
17692025-01-10T05:06:10.058ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17702025-01-10T05:06:10.058ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_19b37234-d205-4094-b223-ad0e72e9c46e
17712025-01-10T05:06:10.078ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17722025-01-10T05:06:10.078ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c7c8012-1908-4829-b530-3992d83456e0
17732025-01-10T05:06:10.098ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17742025-01-10T05:06:10.098ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794
17752025-01-10T05:06:10.119ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17762025-01-10T05:06:10.119ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_49894127-b79c-4807-aac5-383699d40578
17772025-01-10T05:06:10.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61488 req_id = afcf5395-80d6-4120-86e8-836de04a7cfe response_code = 200 uri = /inventory
17782025-01-10T05:06:11.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38448
17792025-01-10T05:06:11.272ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17802025-01-10T05:06:11.272ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17812025-01-10T05:06:11.272ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17822025-01-10T05:06:11.272ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17832025-01-10T05:06:11.272ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17842025-01-10T05:06:11.272ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17852025-01-10T05:06:11.272ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17862025-01-10T05:06:11.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38448 req_id = f509fff5-116b-43cf-ae05-a866b0799798 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17872025-01-10T05:06:11.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61046
17882025-01-10T05:06:11.346ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17892025-01-10T05:06:11.346ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17902025-01-10T05:06:11.346ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17912025-01-10T05:06:11.346ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17922025-01-10T05:06:11.346ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17932025-01-10T05:06:11.346ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17942025-01-10T05:06:11.346ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17952025-01-10T05:06:11.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61046 req_id = 766f41d3-4d9b-4a5f-8c44-fea318f27e5a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17962025-01-10T05:06:11.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60492
17972025-01-10T05:06:11.366ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17982025-01-10T05:06:11.366ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17992025-01-10T05:06:11.366ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18002025-01-10T05:06:11.366ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18012025-01-10T05:06:11.366ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18022025-01-10T05:06:11.366ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18032025-01-10T05:06:11.366ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18042025-01-10T05:06:11.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60492 req_id = addde320-e420-4377-8ee8-2a86da5aa974 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18052025-01-10T05:06:14.490ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62830
18062025-01-10T05:06:14.490ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62830 req_id = 390f8f1d-799b-4113-8c69-1a483072e62d response_code = 200 uri = /baseboard
18072025-01-10T05:06:15.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41400
18082025-01-10T05:06:15.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1677 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41400 req_id = 57573032-4f42-42e1-9c13-5eb5f0425530 response_code = 200 uri = /vpc-routes
18092025-01-10T05:06:15.794ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
18102025-01-10T05:06:15.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1485 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41400 req_id = ec1c9cb7-c966-4099-92ce-253ee8267ac2 response_code = 204 uri = /eip-gateways
18112025-01-10T05:06:15.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41400 req_id = 43f8cf5f-6534-4a83-9fa8-caae226c0484 response_code = 204 uri = /vpc-routes
18122025-01-10T05:06:22.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63992
18132025-01-10T05:06:22.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63992 req_id = 719e5bd8-d233-4c9a-98f1-f0c578904583 response_code = 200 uri = /vpc-routes
18142025-01-10T05:06:22.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
18152025-01-10T05:06:22.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63992 req_id = 236feaf4-3047-435e-929a-e16198e29d18 response_code = 204 uri = /eip-gateways
18162025-01-10T05:06:22.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39498
18172025-01-10T05:06:22.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1475 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39498 req_id = e9af6fdc-804a-441b-962d-f85e0ad926d5 response_code = 200 uri = /v2p
18182025-01-10T05:06:22.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61025
18192025-01-10T05:06:22.495ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18202025-01-10T05:06:22.586ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18212025-01-10T05:06:22.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152007 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61025 req_id = 013713f3-72cd-48b9-834f-eaf83897d7f3 response_code = 204 uri = /switch-ports
18222025-01-10T05:06:22.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63992 req_id = 4d5bff6d-5757-4897-aaef-09b171995714 response_code = 204 uri = /vpc-routes
18232025-01-10T05:06:22.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3820 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61025 req_id = 5355116d-7973-4805-adc1-1abafb21d3e2 response_code = 200 uri = /network-bootstore-config
18242025-01-10T05:06:22.702ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18252025-01-10T05:06:22.702ZINFOSledAgent (bootstore): Writing ledger to /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18262025-01-10T05:06:22.704ZINFOSledAgent (bootstore): Writing ledger to /pool/int/03344b71-863f-4057-bb5e-476456797573/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18272025-01-10T05:06:22.705ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18282025-01-10T05:06:22.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5913 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61025 req_id = 0b5c4d76-e286-401c-9734-129a57e33111 response_code = 204 uri = /network-bootstore-config
18292025-01-10T05:06:22.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37978
18302025-01-10T05:06:22.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37978 req_id = 3ddaa19b-9198-40f7-ae62-55aaef58ba08 response_code = 200 uri = /vpc-routes
18312025-01-10T05:06:23.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48631
18322025-01-10T05:06:23.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48631 req_id = 4ad24cf9-8473-44f9-aea3-82be05973343 response_code = 200 uri = /v2p
18332025-01-10T05:06:23.009ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
18342025-01-10T05:06:23.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37978 req_id = 53198507-841b-476e-bcd9-c960543c36e4 response_code = 204 uri = /eip-gateways
18352025-01-10T05:06:23.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37978 req_id = 5ee8c6d9-d73a-4233-87e7-4689743ff7d3 response_code = 204 uri = /vpc-routes
18362025-01-10T05:06:23.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36337
18372025-01-10T05:06:23.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36337 req_id = 0b17324d-bda4-435a-a540-f9f6f3eaa224 response_code = 200 uri = /vpc-routes
18382025-01-10T05:06:23.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
18392025-01-10T05:06:23.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36337 req_id = f57a5bfb-c1ce-46f6-9334-21be615c4b7e response_code = 204 uri = /eip-gateways
18402025-01-10T05:06:23.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35829
18412025-01-10T05:06:23.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35829 req_id = cb7ce6c4-c2ed-4f85-b984-50aed292a6b2 response_code = 200 uri = /v2p
18422025-01-10T05:06:23.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50351
18432025-01-10T05:06:23.195ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18442025-01-10T05:06:23.232ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18452025-01-10T05:06:23.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50351 req_id = d2fc1c47-8a16-43f2-827b-61c40a4592f1 response_code = 204 uri = /switch-ports
18462025-01-10T05:06:23.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50351 req_id = 36f7fc08-afcb-4f33-9e7b-94fc10a462dd response_code = 200 uri = /network-bootstore-config
18472025-01-10T05:06:23.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 391 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36337 req_id = 5371ca03-f9ab-4366-9374-e8624a08cfef response_code = 204 uri = /vpc-routes
18482025-01-10T05:06:23.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46971
18492025-01-10T05:06:23.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18502025-01-10T05:06:23.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18512025-01-10T05:06:23.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46971 req_id = 04c9ad66-c1c6-4426-aa04-8b93f3602c24 response_code = 204 uri = /switch-ports
18522025-01-10T05:06:23.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46971 req_id = 16da7894-274f-46fe-bb12-b0d65b12a5ea response_code = 200 uri = /network-bootstore-config
18532025-01-10T05:06:37.563ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:61625 remote_addr = [fd00:1122:3344:101::d]:37615 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
18542025-01-10T05:06:37.598ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33769 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 2cb138ca-0013-42bd-b362-8090f4dc4b40 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
18552025-01-10T05:06:44.523ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44854
18562025-01-10T05:06:44.523ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44854 req_id = 1060efc2-07cf-4018-8a7e-d0dfcc9b62d5 response_code = 200 uri = /baseboard
18572025-01-10T05:06:52.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58258
18582025-01-10T05:06:52.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58258 req_id = 7e1f40d3-bc3a-49e5-99cb-3f59c03b1a20 response_code = 200 uri = /vpc-routes
18592025-01-10T05:06:52.293ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
18602025-01-10T05:06:52.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58258 req_id = dec6ad29-bfa4-4660-b69b-be33d9f2e3f1 response_code = 204 uri = /eip-gateways
18612025-01-10T05:06:52.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58258 req_id = 9c04f88f-9b27-4174-bf45-cdf225e97bf9 response_code = 204 uri = /vpc-routes
18622025-01-10T05:06:52.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40274
18632025-01-10T05:06:52.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40274 req_id = db753ebe-516a-48e7-8829-e2046ea00446 response_code = 200 uri = /v2p
18642025-01-10T05:06:52.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64484
18652025-01-10T05:06:52.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18662025-01-10T05:06:52.772ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18672025-01-10T05:06:52.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64484 req_id = a497e378-0867-49d3-8d53-509a0fee63da response_code = 204 uri = /switch-ports
18682025-01-10T05:06:52.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64484 req_id = cc54efe1-9818-471d-b185-6d7e7a98a98f response_code = 200 uri = /network-bootstore-config
18692025-01-10T05:06:52.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42762
18702025-01-10T05:06:52.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42762 req_id = 369f6a98-f40e-48f3-ac63-2d2a084804eb response_code = 200 uri = /vpc-routes
18712025-01-10T05:06:53.105ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
18722025-01-10T05:06:53.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42762 req_id = b91245f5-62d6-40a4-bf68-dd0c4a40aede response_code = 204 uri = /eip-gateways
18732025-01-10T05:06:53.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59382
18742025-01-10T05:06:53.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59382 req_id = 564f9576-ad0c-4b90-aec1-ed680aee294d response_code = 200 uri = /v2p
18752025-01-10T05:06:53.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42762 req_id = f3b52c63-e711-49b2-8475-ccf28730003a response_code = 204 uri = /vpc-routes
18762025-01-10T05:06:53.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61465
18772025-01-10T05:06:53.164ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18782025-01-10T05:06:53.198ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18792025-01-10T05:06:53.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82292 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61465 req_id = dc7dbad0-b2af-4ee2-a1b4-c987c5cf1528 response_code = 204 uri = /switch-ports
18802025-01-10T05:06:53.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51043
18812025-01-10T05:06:53.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51043 req_id = e43e0c97-05b8-4973-a19f-2a3b7201ffc8 response_code = 200 uri = /vpc-routes
18822025-01-10T05:06:53.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61465 req_id = bf5f209d-3a83-488a-995c-7298a6ddd830 response_code = 200 uri = /network-bootstore-config
18832025-01-10T05:06:53.263ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
18842025-01-10T05:06:53.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51043 req_id = e9243bad-07c3-4d0a-aa8f-4abda9ea2776 response_code = 204 uri = /eip-gateways
18852025-01-10T05:06:53.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50602
18862025-01-10T05:06:53.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50602 req_id = 0bcba5e6-2194-4177-8454-613b13124781 response_code = 200 uri = /v2p
18872025-01-10T05:06:53.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51043 req_id = 93eb5b4c-6778-45e5-b69b-f41242f909b8 response_code = 204 uri = /vpc-routes
18882025-01-10T05:06:53.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57503
18892025-01-10T05:06:53.553ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18902025-01-10T05:06:53.590ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18912025-01-10T05:06:53.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91982 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57503 req_id = af714784-640c-4be0-ba66-a8db2b5348bf response_code = 204 uri = /switch-ports
18922025-01-10T05:06:53.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57503 req_id = 337c22a1-ba66-4fe5-aa3f-4330cd7a7903 response_code = 200 uri = /network-bootstore-config
18932025-01-10T05:07:07.568ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6939 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = a94f17d6-414c-448c-aa60-9590824ef4d4 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
18942025-01-10T05:07:14.557ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51432
18952025-01-10T05:07:14.557ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51432 req_id = 5ec8df33-57f6-4f30-acc9-e90d5394e0dc response_code = 200 uri = /baseboard
18962025-01-10T05:07:22.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39374
18972025-01-10T05:07:22.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39374 req_id = 60826c61-ded1-4db8-aeae-124f858f6094 response_code = 200 uri = /vpc-routes
18982025-01-10T05:07:22.472ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
18992025-01-10T05:07:22.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39374 req_id = 58a3b559-1934-4671-b809-5e89d049c9a5 response_code = 204 uri = /eip-gateways
19002025-01-10T05:07:22.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39374 req_id = 96a18982-4c8b-428a-9d17-3111f521cbe7 response_code = 204 uri = /vpc-routes
19012025-01-10T05:07:22.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45924
19022025-01-10T05:07:22.712ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19032025-01-10T05:07:22.756ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19042025-01-10T05:07:22.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108115 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45924 req_id = 99c84247-1ab5-4a10-95b3-d985b2fe7922 response_code = 204 uri = /switch-ports
19052025-01-10T05:07:22.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45924 req_id = ad688f2b-0399-47ad-a753-15541c8c72b7 response_code = 200 uri = /network-bootstore-config
19062025-01-10T05:07:22.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39551
19072025-01-10T05:07:22.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39551 req_id = 3fd34981-9be8-441f-aec5-a1549e578f21 response_code = 200 uri = /v2p
19082025-01-10T05:07:23.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51911
19092025-01-10T05:07:23.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51911 req_id = c50b77f5-abc5-49c0-bf49-9ec3829e1c96 response_code = 200 uri = /vpc-routes
19102025-01-10T05:07:23.052ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
19112025-01-10T05:07:23.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51911 req_id = ae221ccd-8484-4ead-9c64-1b232c9cc873 response_code = 204 uri = /eip-gateways
19122025-01-10T05:07:23.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49194
19132025-01-10T05:07:23.057ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19142025-01-10T05:07:23.098ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19152025-01-10T05:07:23.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100305 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49194 req_id = 83f227c4-093e-41b5-af4f-799970151fd1 response_code = 204 uri = /switch-ports
19162025-01-10T05:07:23.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44737
19172025-01-10T05:07:23.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63709
19182025-01-10T05:07:23.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49194 req_id = f83f2b62-e0e5-4664-87c5-cbd0ce71fedb response_code = 200 uri = /network-bootstore-config
19192025-01-10T05:07:23.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51911 req_id = 32a58fb3-ef32-4ff9-8601-cc1b57e8d841 response_code = 204 uri = /vpc-routes
19202025-01-10T05:07:23.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44737 req_id = 574e8c79-bcaa-4abd-8ee3-1552875f0e38 response_code = 200 uri = /vpc-routes
19212025-01-10T05:07:23.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63709 req_id = 90736904-716a-4b69-93d8-d9e53e81e961 response_code = 200 uri = /v2p
19222025-01-10T05:07:23.205ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
19232025-01-10T05:07:23.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44737 req_id = df2151a7-f9ef-4321-88bf-a1b56300b8fd response_code = 204 uri = /eip-gateways
19242025-01-10T05:07:23.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44737 req_id = bd7b16af-5725-4aa3-b28a-66a797279dd2 response_code = 204 uri = /vpc-routes
19252025-01-10T05:07:23.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34663
19262025-01-10T05:07:23.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34663 req_id = 99753a89-a5ba-4bfe-8661-e0dcf64b0deb response_code = 200 uri = /v2p
19272025-01-10T05:07:23.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52938
19282025-01-10T05:07:23.468ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19292025-01-10T05:07:23.506ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19302025-01-10T05:07:23.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93040 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52938 req_id = 6ea11351-e5bd-488f-a375-75370b34281c response_code = 204 uri = /switch-ports
19312025-01-10T05:07:23.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52938 req_id = bd59847c-1ecc-4412-a50e-ddf7db3aaf27 response_code = 200 uri = /network-bootstore-config
19322025-01-10T05:07:37.567ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6497 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = bb2e6d7d-0ad2-4c7e-98c2-ed71ad5dfdcc response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
19332025-01-10T05:07:44.589ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61235
19342025-01-10T05:07:44.589ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61235 req_id = 2a93839d-3b3d-401e-9f4f-8de8fb47d6d6 response_code = 200 uri = /baseboard
19352025-01-10T05:07:52.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48781
19362025-01-10T05:07:52.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48781 req_id = c3076d36-cae6-47a0-b2af-5fb3771d8542 response_code = 200 uri = /vpc-routes
19372025-01-10T05:07:52.407ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
19382025-01-10T05:07:52.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48781 req_id = 62f41354-2eb7-42eb-9573-db2aefe053b5 response_code = 204 uri = /eip-gateways
19392025-01-10T05:07:52.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33437
19402025-01-10T05:07:52.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33437 req_id = c95196ca-53a1-4eed-a34e-57abb8507b88 response_code = 200 uri = /v2p
19412025-01-10T05:07:52.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48781 req_id = 7d7f5924-e85d-4d42-ba1a-f316d3cee412 response_code = 204 uri = /vpc-routes
19422025-01-10T05:07:53.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52358
19432025-01-10T05:07:53.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52358 req_id = b7fb6119-7f07-4079-a3f2-e35c1d001833 response_code = 200 uri = /vpc-routes
19442025-01-10T05:07:53.098ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
19452025-01-10T05:07:53.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52358 req_id = 5f29d165-813d-4592-b6ee-8c0ee4f479ba response_code = 204 uri = /eip-gateways
19462025-01-10T05:07:53.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63075
19472025-01-10T05:07:53.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63075 req_id = 3f8a6a72-b2d2-49ab-9bca-e5537cd76b80 response_code = 200 uri = /v2p
19482025-01-10T05:07:53.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52358 req_id = d0fedfcf-a5d3-411e-93cc-d266ec9dc89c response_code = 204 uri = /vpc-routes
19492025-01-10T05:07:53.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63721
19502025-01-10T05:07:53.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63721 req_id = e21d7908-7490-4787-9fb0-4cacb3517a4a response_code = 200 uri = /v2p
19512025-01-10T05:07:53.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36549
19522025-01-10T05:07:53.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36549 req_id = 9d4de42d-be8a-4f79-a1dd-f8bac77a7f5c response_code = 200 uri = /vpc-routes
19532025-01-10T05:07:53.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53324
19542025-01-10T05:07:53.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19552025-01-10T05:07:53.247ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19562025-01-10T05:07:53.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116755 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53324 req_id = 9063e97c-7825-4824-8802-17a07d573f9b response_code = 204 uri = /switch-ports
19572025-01-10T05:07:53.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36390
19582025-01-10T05:07:53.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3501 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53324 req_id = 6c57209a-81ce-4dda-90d2-4a65f47281f7 response_code = 200 uri = /network-bootstore-config
19592025-01-10T05:07:53.318ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19602025-01-10T05:07:53.318ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
19612025-01-10T05:07:53.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3938 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36549 req_id = b2c1b69c-1a3c-48b1-9749-f1bff693d138 response_code = 204 uri = /eip-gateways
19622025-01-10T05:07:53.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36549 req_id = 2d38a3a9-72a9-44bb-bf44-d14fa26b0c77 response_code = 204 uri = /vpc-routes
19632025-01-10T05:07:53.358ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19642025-01-10T05:07:53.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97750 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36390 req_id = 274d81dc-410f-469c-bd14-edd9cc32efb6 response_code = 204 uri = /switch-ports
19652025-01-10T05:07:53.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36390 req_id = b917f518-330b-4cc1-9063-d19e6efe3425 response_code = 200 uri = /network-bootstore-config
19662025-01-10T05:07:53.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57552
19672025-01-10T05:07:53.543ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19682025-01-10T05:07:53.579ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19692025-01-10T05:07:53.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57552 req_id = 6e558430-a2a5-46e1-b457-177f253b92d6 response_code = 204 uri = /switch-ports
19702025-01-10T05:07:53.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57552 req_id = c5e5dbe3-de78-47d5-974d-29d5f059c9d3 response_code = 200 uri = /network-bootstore-config
19712025-01-10T05:08:07.568ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7687 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = a4431bc6-0499-4be5-a279-8478e0a9fbaf response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
19722025-01-10T05:08:14.622ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64590
19732025-01-10T05:08:14.622ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64590 req_id = fa66df2d-53ad-4310-8c9a-73c298339605 response_code = 200 uri = /baseboard
19742025-01-10T05:08:22.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49320
19752025-01-10T05:08:22.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49320 req_id = 682da464-ad69-43e6-9f29-995457f99da2 response_code = 200 uri = /vpc-routes
19762025-01-10T05:08:22.516ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
19772025-01-10T05:08:22.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49320 req_id = 34d8b1e5-0bf4-475d-b7c7-589b08e5e816 response_code = 204 uri = /eip-gateways
19782025-01-10T05:08:22.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49320 req_id = 26b39217-3073-4574-b9e2-31a10585ea92 response_code = 204 uri = /vpc-routes
19792025-01-10T05:08:22.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33923
19802025-01-10T05:08:22.554ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19812025-01-10T05:08:22.595ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19822025-01-10T05:08:22.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96868 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33923 req_id = bce40bb4-9d39-4818-8b96-c6b0c1e85fea response_code = 204 uri = /switch-ports
19832025-01-10T05:08:22.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33923 req_id = ed08ef3d-323b-4f4a-ac24-c0f6b320f58c response_code = 200 uri = /network-bootstore-config
19842025-01-10T05:08:22.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45305
19852025-01-10T05:08:22.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45305 req_id = 4da943eb-50b2-4de0-82a7-aa82eccde491 response_code = 200 uri = /v2p
19862025-01-10T05:08:22.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61399
19872025-01-10T05:08:22.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61399 req_id = 0ae81b58-df3f-40e9-8e2d-b8612dec9bad response_code = 200 uri = /vpc-routes
19882025-01-10T05:08:22.913ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
19892025-01-10T05:08:22.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61399 req_id = 4d0ae980-ab56-4ba0-991b-1c2583e8c0c1 response_code = 204 uri = /eip-gateways
19902025-01-10T05:08:22.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61399 req_id = 0088b340-d7c7-4484-8721-e9ff9225e0bf response_code = 204 uri = /vpc-routes
19912025-01-10T05:08:23.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58695
19922025-01-10T05:08:23.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58695 req_id = 3f979a73-eca4-4567-82fc-3a37d78153f4 response_code = 200 uri = /v2p
19932025-01-10T05:08:23.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33385
19942025-01-10T05:08:23.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33385 req_id = c96a77c4-b417-45c1-960e-bbd1b69a3a51 response_code = 200 uri = /vpc-routes
19952025-01-10T05:08:23.106ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
19962025-01-10T05:08:23.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33385 req_id = eaedd458-8984-47d9-962b-bb2f129ae57a response_code = 204 uri = /eip-gateways
19972025-01-10T05:08:23.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33385 req_id = 256f4ad7-bf91-4ba2-9c04-9f00bdea0791 response_code = 204 uri = /vpc-routes
19982025-01-10T05:08:23.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34588
19992025-01-10T05:08:23.160ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20002025-01-10T05:08:23.199ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20012025-01-10T05:08:23.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97705 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34588 req_id = a71a3390-3506-45a9-abe9-19060db62fd6 response_code = 204 uri = /switch-ports
20022025-01-10T05:08:23.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63668
20032025-01-10T05:08:23.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64472
20042025-01-10T05:08:23.258ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20052025-01-10T05:08:23.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3392 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64472 req_id = e24728cd-00fc-4230-90f6-f91d1413a7fa response_code = 200 uri = /v2p
20062025-01-10T05:08:23.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3612 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34588 req_id = e0aa1eef-f2b5-4115-a75c-ea2852305568 response_code = 200 uri = /network-bootstore-config
20072025-01-10T05:08:23.294ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20082025-01-10T05:08:23.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92683 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63668 req_id = 705c7ede-404d-4cc9-9a35-851f0a97075e response_code = 204 uri = /switch-ports
20092025-01-10T05:08:23.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63668 req_id = 90b8b86d-0d72-49ef-bfc2-6d122eec0942 response_code = 200 uri = /network-bootstore-config
20102025-01-10T05:08:34.802ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20112025-01-10T05:08:37.568ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7098 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = c62cccf4-68ba-4ebb-9e49-e931fec8c94a response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
20122025-01-10T05:08:44.654ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56468
20132025-01-10T05:08:44.654ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56468 req_id = dc252b81-baba-4d2e-a5ba-4f36ba86e549 response_code = 200 uri = /baseboard
20142025-01-10T05:08:52.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49262
20152025-01-10T05:08:52.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49262 req_id = 82d0ed55-89a4-4b5e-80a8-893b6a74d3bf response_code = 200 uri = /vpc-routes
20162025-01-10T05:08:52.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57344
20172025-01-10T05:08:52.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57344 req_id = 207b8cc9-ac5b-4976-b87e-1b765ac5b4e9 response_code = 200 uri = /v2p
20182025-01-10T05:08:52.744ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
20192025-01-10T05:08:52.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49262 req_id = d9afed2a-16ac-405f-addb-0d6949d90e8d response_code = 204 uri = /eip-gateways
20202025-01-10T05:08:52.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49262 req_id = 4f5b5c35-b530-40fc-8a1f-b8c4ee6fa9c8 response_code = 204 uri = /vpc-routes
20212025-01-10T05:08:52.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50977
20222025-01-10T05:08:52.796ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20232025-01-10T05:08:52.835ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20242025-01-10T05:08:52.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133708 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50977 req_id = 8480d49f-7b13-4a94-a043-c13633bc99ed response_code = 204 uri = /switch-ports
20252025-01-10T05:08:52.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50977 req_id = 4527da3c-c000-4508-aa63-ef41231b9e1c response_code = 200 uri = /network-bootstore-config
20262025-01-10T05:08:53.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42337
20272025-01-10T05:08:53.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42337 req_id = f3b19ecf-3a20-41b5-93a8-7357b52f36c5 response_code = 200 uri = /v2p
20282025-01-10T05:08:53.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53304
20292025-01-10T05:08:53.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53304 req_id = b628fe5a-0272-4729-89f1-3d5b189d9d8f response_code = 200 uri = /vpc-routes
20302025-01-10T05:08:53.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
20312025-01-10T05:08:53.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53304 req_id = dfcfff89-7d3f-4e78-92ec-b4c3a9800519 response_code = 204 uri = /eip-gateways
20322025-01-10T05:08:53.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53304 req_id = 93110edd-a054-4df8-a29f-1b38e26e1306 response_code = 204 uri = /vpc-routes
20332025-01-10T05:08:53.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61651
20342025-01-10T05:08:53.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61651 req_id = afc85ab2-e514-484f-9892-7057c935b47d response_code = 200 uri = /vpc-routes
20352025-01-10T05:08:53.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41903
20362025-01-10T05:08:53.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20372025-01-10T05:08:53.258ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20382025-01-10T05:08:53.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41903 req_id = 3585dab3-e570-403b-9fe2-a691f667dc35 response_code = 204 uri = /switch-ports
20392025-01-10T05:08:53.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42396
20402025-01-10T05:08:53.315ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
20412025-01-10T05:08:53.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42396 req_id = 2c6f4e30-d95c-49e6-a9e5-6adc885298ea response_code = 200 uri = /v2p
20422025-01-10T05:08:53.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61651 req_id = 85a3ccb6-ae42-4ed9-ad11-d2a509029964 response_code = 204 uri = /eip-gateways
20432025-01-10T05:08:53.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41903 req_id = 60f6df45-d7e8-4531-aa66-0d5ec216ddc4 response_code = 200 uri = /network-bootstore-config
20442025-01-10T05:08:53.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61651 req_id = f46673a3-2cf4-4f1a-8beb-961817fd90aa response_code = 204 uri = /vpc-routes
20452025-01-10T05:08:53.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41044
20462025-01-10T05:08:53.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20472025-01-10T05:08:53.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20482025-01-10T05:08:53.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41044 req_id = 7bf22ee2-e6b4-4451-afba-6334e33704e5 response_code = 204 uri = /switch-ports
20492025-01-10T05:08:53.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41044 req_id = 39d14af1-5028-4dba-b193-3434983b1e2e response_code = 200 uri = /network-bootstore-config
20502025-01-10T05:09:07.567ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7158 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = ca795c88-4eb7-4509-8d45-9233e8d2e0f6 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
20512025-01-10T05:09:14.687ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47807
20522025-01-10T05:09:14.687ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47807 req_id = a1757c76-5472-4ec4-b583-ed168bc1b60f response_code = 200 uri = /baseboard
20532025-01-10T05:09:22.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56279
20542025-01-10T05:09:22.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56279 req_id = 202920b2-1d45-4e5f-9970-41c6170295c0 response_code = 200 uri = /vpc-routes
20552025-01-10T05:09:22.345ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
20562025-01-10T05:09:22.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56279 req_id = 53893295-ef5b-425a-9a51-4c6ec0820e3b response_code = 204 uri = /eip-gateways
20572025-01-10T05:09:22.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56279 req_id = 9f532343-dc8c-49c7-8a3c-9fcecc4cd86a response_code = 204 uri = /vpc-routes
20582025-01-10T05:09:22.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39254
20592025-01-10T05:09:22.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39254 req_id = e01ac62d-f0ae-45a7-9836-f5d34f901aef response_code = 200 uri = /v2p
20602025-01-10T05:09:22.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37025
20612025-01-10T05:09:22.418ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20622025-01-10T05:09:22.453ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20632025-01-10T05:09:22.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86023 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37025 req_id = 9bcf0e01-ac74-41db-be9f-9ed284e14696 response_code = 204 uri = /switch-ports
20642025-01-10T05:09:22.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37025 req_id = 748512a2-f99a-47a1-b9cf-d6e7312ad3d7 response_code = 200 uri = /network-bootstore-config
20652025-01-10T05:09:22.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54001
20662025-01-10T05:09:22.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54001 req_id = b411fbcd-e6f3-4ece-9e7f-6b6077fe2ccf response_code = 200 uri = /v2p
20672025-01-10T05:09:22.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43714
20682025-01-10T05:09:22.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43714 req_id = 8566e90a-bea3-4615-a1c3-e85a7966af14 response_code = 200 uri = /vpc-routes
20692025-01-10T05:09:22.895ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
20702025-01-10T05:09:22.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43714 req_id = d61d2df2-6715-40cf-89d0-834a65f0b7ac response_code = 204 uri = /eip-gateways
20712025-01-10T05:09:22.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43714 req_id = 266f9673-a66b-4943-8215-c08c9a13add9 response_code = 204 uri = /vpc-routes
20722025-01-10T05:09:22.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56503
20732025-01-10T05:09:22.968ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20742025-01-10T05:09:23.005ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20752025-01-10T05:09:23.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91330 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56503 req_id = 29f9a383-5a20-40e7-89df-99cacabf2e17 response_code = 204 uri = /switch-ports
20762025-01-10T05:09:23.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62679
20772025-01-10T05:09:23.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62679 req_id = 8f20ccdb-eacd-4503-ba65-e3fe406b4802 response_code = 200 uri = /vpc-routes
20782025-01-10T05:09:23.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56503 req_id = e10afbbe-d175-4613-9a07-0f91c73ee642 response_code = 200 uri = /network-bootstore-config
20792025-01-10T05:09:23.106ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
20802025-01-10T05:09:23.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62679 req_id = db40ba5d-bb9d-409e-b0af-5b3ca4a442be response_code = 204 uri = /eip-gateways
20812025-01-10T05:09:23.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41603
20822025-01-10T05:09:23.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41603 req_id = 095d2151-2e80-498f-9ba2-bb43e2162d50 response_code = 200 uri = /v2p
20832025-01-10T05:09:23.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62679 req_id = 7fbcbe03-3b52-4d89-b1cf-961ba36ee46e response_code = 204 uri = /vpc-routes
20842025-01-10T05:09:23.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41536
20852025-01-10T05:09:23.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20862025-01-10T05:09:23.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20872025-01-10T05:09:23.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41536 req_id = 5b3941fd-faa8-4e58-b83a-e9bf9fcd5a78 response_code = 204 uri = /switch-ports
20882025-01-10T05:09:23.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41536 req_id = 26ed8eb3-c1ed-4c18-b264-68477777c410 response_code = 200 uri = /network-bootstore-config
20892025-01-10T05:09:37.566ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7140 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 30c3d130-581e-4fb4-b133-e07afaca8ec0 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
20902025-01-10T05:09:44.720ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56873
20912025-01-10T05:09:44.720ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56873 req_id = 66eb52e4-ff6e-42d7-bc88-513b4f49fb7a response_code = 200 uri = /baseboard
20922025-01-10T05:09:52.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51688
20932025-01-10T05:09:52.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51688 req_id = 63915f62-aeba-427d-8fa0-9bd2cb47086d response_code = 200 uri = /vpc-routes
20942025-01-10T05:09:52.384ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
20952025-01-10T05:09:52.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51688 req_id = eb10486c-a779-44ba-b335-cfe3bc6fcefa response_code = 204 uri = /eip-gateways
20962025-01-10T05:09:52.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51688 req_id = c181ebbb-dd13-4ecf-8318-a878498a5fb6 response_code = 204 uri = /vpc-routes
20972025-01-10T05:09:52.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51798
20982025-01-10T05:09:52.586ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20992025-01-10T05:09:52.626ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21002025-01-10T05:09:52.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102787 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51798 req_id = c98e9755-1538-46ae-a47b-a7cd562b4ea9 response_code = 204 uri = /switch-ports
21012025-01-10T05:09:52.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54483
21022025-01-10T05:09:52.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51798 req_id = c832f2f8-f0fb-41e5-b052-374168dec1cd response_code = 200 uri = /network-bootstore-config
21032025-01-10T05:09:52.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54483 req_id = 269e436a-3157-4387-b9de-7df95f05313d response_code = 200 uri = /v2p
21042025-01-10T05:09:52.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40531
21052025-01-10T05:09:52.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40531 req_id = 3175a2b0-764c-49e3-b196-8e006af3df83 response_code = 200 uri = /v2p
21062025-01-10T05:09:53.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54471
21072025-01-10T05:09:53.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54471 req_id = a5018516-6c01-454a-9caa-20dd95fc1dfb response_code = 200 uri = /vpc-routes
21082025-01-10T05:09:53.049ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
21092025-01-10T05:09:53.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54471 req_id = 210015f6-e07f-4968-87e9-46bb6014b5f8 response_code = 204 uri = /eip-gateways
21102025-01-10T05:09:53.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54471 req_id = 59a4d0f9-bbcd-4f4e-8709-6d0dd2e56302 response_code = 204 uri = /vpc-routes
21112025-01-10T05:09:53.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55157
21122025-01-10T05:09:53.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21132025-01-10T05:09:53.146ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21142025-01-10T05:09:53.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94921 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55157 req_id = ea656f68-1a2f-4d4c-be76-21a510b4084d response_code = 204 uri = /switch-ports
21152025-01-10T05:09:53.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55157 req_id = 19844be8-a355-45e9-90e7-6d664428dba4 response_code = 200 uri = /network-bootstore-config
21162025-01-10T05:09:53.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34048
21172025-01-10T05:09:53.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34048 req_id = f4776f77-6c64-4f6e-97c9-d10386f66fb3 response_code = 200 uri = /v2p
21182025-01-10T05:09:53.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42265
21192025-01-10T05:09:53.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42265 req_id = 47b93569-6994-4269-8b35-8a2f10804e9c response_code = 200 uri = /vpc-routes
21202025-01-10T05:09:53.408ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
21212025-01-10T05:09:53.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42265 req_id = 0149b760-b937-4c99-b73f-cb741cb80226 response_code = 204 uri = /eip-gateways
21222025-01-10T05:09:53.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42265 req_id = e60dc8d0-9041-4566-9bd7-49ee2c2a29ac response_code = 204 uri = /vpc-routes
21232025-01-10T05:09:53.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61745
21242025-01-10T05:09:53.573ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21252025-01-10T05:09:53.609ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21262025-01-10T05:09:53.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85938 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61745 req_id = 7e32e262-fa93-414e-bf24-4cf4e69d808d response_code = 204 uri = /switch-ports
21272025-01-10T05:09:53.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61745 req_id = 3a14ff9a-b928-4bc8-8275-91ccf8676727 response_code = 200 uri = /network-bootstore-config
21282025-01-10T05:10:07.567ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7870 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 99596967-b8ec-4873-bfef-6e1f461037e2 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
21292025-01-10T05:10:14.752ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53320
21302025-01-10T05:10:14.752ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53320 req_id = e66d77e4-09ec-4522-9683-47f5d2712bed response_code = 200 uri = /baseboard
21312025-01-10T05:10:22.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41287
21322025-01-10T05:10:22.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41287 req_id = bb7a734f-7931-4400-b74f-22c9809ff80c response_code = 200 uri = /vpc-routes
21332025-01-10T05:10:22.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45766
21342025-01-10T05:10:22.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45766 req_id = 60d3fabb-a7b8-4c2d-bf40-63b44a48aaba response_code = 200 uri = /v2p
21352025-01-10T05:10:22.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47751
21362025-01-10T05:10:22.376ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21372025-01-10T05:10:22.413ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21382025-01-10T05:10:22.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47751 req_id = a5e98f65-4c50-4019-a4e7-1f6deb8f0859 response_code = 204 uri = /switch-ports
21392025-01-10T05:10:22.467ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
21402025-01-10T05:10:22.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41287 req_id = 0ee9d62f-0384-4577-be36-bf691a6323fb response_code = 204 uri = /eip-gateways
21412025-01-10T05:10:22.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47751 req_id = ac47c5e3-ab8d-4a33-8212-7344a97544be response_code = 200 uri = /network-bootstore-config
21422025-01-10T05:10:22.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41287 req_id = 91e1f591-69c9-47ab-9d0a-e82b4f09d0de response_code = 204 uri = /vpc-routes
21432025-01-10T05:10:22.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37166
21442025-01-10T05:10:22.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37166 req_id = ecf1e699-3cc1-45ee-976f-24fd01115172 response_code = 200 uri = /vpc-routes
21452025-01-10T05:10:22.929ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
21462025-01-10T05:10:22.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37166 req_id = 598ee335-f0d8-4f91-8de9-983fe0c23b4c response_code = 204 uri = /eip-gateways
21472025-01-10T05:10:23.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61935
21482025-01-10T05:10:23.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61935 req_id = fae75c73-b4fe-4f86-90d5-f8dad9b0b0eb response_code = 200 uri = /vpc-routes
21492025-01-10T05:10:23.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
21502025-01-10T05:10:23.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61935 req_id = eb9ce59f-3868-4a4f-a865-dbca1d7fbabc response_code = 204 uri = /eip-gateways
21512025-01-10T05:10:23.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62061
21522025-01-10T05:10:23.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62061 req_id = 7032ebe0-d530-4211-bf1a-d11aaa9374bf response_code = 200 uri = /v2p
21532025-01-10T05:10:23.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37166 req_id = 5ffc11e5-887c-431c-befc-fac04d64ba81 response_code = 204 uri = /vpc-routes
21542025-01-10T05:10:23.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65520
21552025-01-10T05:10:23.124ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21562025-01-10T05:10:23.168ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21572025-01-10T05:10:23.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101371 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65520 req_id = c43c55a7-b149-4e5a-ad4c-b7c8ca9bf275 response_code = 204 uri = /switch-ports
21582025-01-10T05:10:23.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55943
21592025-01-10T05:10:23.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61935 req_id = d9402f02-b17f-42a0-88d0-7b577cdb005d response_code = 204 uri = /vpc-routes
21602025-01-10T05:10:23.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65520 req_id = d6502228-f3e9-4f60-a4f0-dd58395bd2b9 response_code = 200 uri = /network-bootstore-config
21612025-01-10T05:10:23.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55943 req_id = d07507d4-e0b1-418c-8bde-e579859224d4 response_code = 200 uri = /v2p
21622025-01-10T05:10:23.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56631
21632025-01-10T05:10:23.251ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21642025-01-10T05:10:23.287ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21652025-01-10T05:10:23.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56631 req_id = 5dc71cc5-7e61-4ed6-a03b-915e848f996f response_code = 204 uri = /switch-ports
21662025-01-10T05:10:23.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56631 req_id = 27416717-7235-408f-a7d2-1cda29b741ec response_code = 200 uri = /network-bootstore-config
21672025-01-10T05:10:37.565ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7038 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 33974fc0-9afb-4685-874f-6dabff214575 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
21682025-01-10T05:10:44.785ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56126
21692025-01-10T05:10:44.785ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56126 req_id = ee4091ff-883e-4da3-be1c-db1839aefcf1 response_code = 200 uri = /baseboard
21702025-01-10T05:10:52.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47368
21712025-01-10T05:10:52.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47368 req_id = 884622c3-f566-4490-9113-988e17c1f5e7 response_code = 200 uri = /vpc-routes
21722025-01-10T05:10:52.498ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
21732025-01-10T05:10:52.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47368 req_id = ecc018e4-2c0f-4550-bf1b-145b85c56ea0 response_code = 204 uri = /eip-gateways
21742025-01-10T05:10:52.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47368 req_id = f0bb82ae-f132-4edc-9eb3-6ef3254265b1 response_code = 204 uri = /vpc-routes
21752025-01-10T05:10:52.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35519
21762025-01-10T05:10:52.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35519 req_id = 7a680c65-cfb2-4350-81ec-c4097307dc95 response_code = 200 uri = /v2p
21772025-01-10T05:10:52.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42346
21782025-01-10T05:10:52.644ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21792025-01-10T05:10:52.644ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21802025-01-10T05:10:52.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21812025-01-10T05:10:52.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21822025-01-10T05:10:52.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21832025-01-10T05:10:52.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21842025-01-10T05:10:52.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21852025-01-10T05:10:52.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42346 req_id = 17c0817a-1669-43b0-aa42-3239074c6e17 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21862025-01-10T05:10:52.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44009
21872025-01-10T05:10:52.755ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21882025-01-10T05:10:52.803ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21892025-01-10T05:10:52.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44009 req_id = a35569b9-1c50-4d1d-9cd2-77c65284fb47 response_code = 204 uri = /switch-ports
21902025-01-10T05:10:52.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44009 req_id = 457f4e35-a73e-4fe7-a596-e73fed2edc09 response_code = 200 uri = /network-bootstore-config
21912025-01-10T05:10:53.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41507
21922025-01-10T05:10:53.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41507 req_id = 99b87797-1d90-4b63-bf8b-95273cc81ed4 response_code = 200 uri = /vpc-routes
21932025-01-10T05:10:53.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48309
21942025-01-10T05:10:53.187ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21952025-01-10T05:10:53.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21962025-01-10T05:10:53.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21972025-01-10T05:10:53.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21982025-01-10T05:10:53.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21992025-01-10T05:10:53.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22002025-01-10T05:10:53.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22012025-01-10T05:10:53.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48309 req_id = 6d613e37-64ee-458c-b39b-f4c3ebef644e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22022025-01-10T05:10:53.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61851
22032025-01-10T05:10:53.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61851 req_id = 4d0ca557-1b65-46f7-9a11-f396f784df1d response_code = 200 uri = /vpc-routes
22042025-01-10T05:10:53.253ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
22052025-01-10T05:10:53.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61851 req_id = 73121a00-0221-462e-aa55-025391d7182f response_code = 204 uri = /eip-gateways
22062025-01-10T05:10:53.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61851 req_id = 70bd83a2-38fa-4e8e-82f5-891b24def21c response_code = 204 uri = /vpc-routes
22072025-01-10T05:10:53.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60803
22082025-01-10T05:10:53.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60803 req_id = c4d1eafb-9c97-4cca-81fb-c8cef3fb5182 response_code = 200 uri = /v2p
22092025-01-10T05:10:53.294ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
22102025-01-10T05:10:53.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41507 req_id = b6c91bff-7b4d-4ff7-b5fc-e5ec34892a7e response_code = 204 uri = /eip-gateways
22112025-01-10T05:10:53.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41507 req_id = 8e7bb1d2-abeb-4352-8a83-fe12656e8f1b response_code = 204 uri = /vpc-routes
22122025-01-10T05:10:53.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56921
22132025-01-10T05:10:53.308ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22142025-01-10T05:10:53.347ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22152025-01-10T05:10:53.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56921 req_id = ff83cab0-f1ff-4836-9a9f-7ca4e5919b24 response_code = 204 uri = /switch-ports
22162025-01-10T05:10:53.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36440
22172025-01-10T05:10:53.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46897
22182025-01-10T05:10:53.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56921 req_id = 8352299f-2cf4-4df7-8e20-e4f204716c2a response_code = 200 uri = /network-bootstore-config
22192025-01-10T05:10:53.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36440 req_id = 0406af46-7efe-480d-b128-f5954b0bb214 response_code = 200 uri = /v2p
22202025-01-10T05:10:53.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22212025-01-10T05:10:53.442ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22222025-01-10T05:10:53.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87910 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46897 req_id = 8841981e-7773-4555-9dfa-47de2e6bfaf3 response_code = 204 uri = /switch-ports
22232025-01-10T05:10:53.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46897 req_id = 0422cc37-7723-401f-8a2f-aee28b9a88fe response_code = 200 uri = /network-bootstore-config
22242025-01-10T05:10:53.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55402
22252025-01-10T05:10:53.538ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22262025-01-10T05:10:53.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22272025-01-10T05:10:53.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22282025-01-10T05:10:53.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22292025-01-10T05:10:53.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22302025-01-10T05:10:53.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22312025-01-10T05:10:53.538ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22322025-01-10T05:10:53.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55402 req_id = a0a80840-1744-4bba-ac08-5ee400d874e0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22332025-01-10T05:11:07.566ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7867 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 15c58e58-3129-4f96-b56e-7961b8319891 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
22342025-01-10T05:11:14.817ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57332
22352025-01-10T05:11:14.817ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57332 req_id = 2d909b99-db74-4d07-a2f3-f61494fce43d response_code = 200 uri = /baseboard
22362025-01-10T05:11:22.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50050
22372025-01-10T05:11:22.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50050 req_id = fe024c3d-7612-49c7-808e-980d1b37a2ff response_code = 200 uri = /vpc-routes
22382025-01-10T05:11:22.315ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
22392025-01-10T05:11:22.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50050 req_id = ec056857-653e-4ca4-8a76-9a604cca9351 response_code = 204 uri = /eip-gateways
22402025-01-10T05:11:22.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50050 req_id = f17b588f-2a36-4025-bc39-308eeb77b30b response_code = 204 uri = /vpc-routes
22412025-01-10T05:11:22.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40208
22422025-01-10T05:11:22.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40208 req_id = fafdf8d9-f7b4-4b53-81ea-1a1d519dcae6 response_code = 200 uri = /v2p
22432025-01-10T05:11:22.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48630
22442025-01-10T05:11:22.515ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22452025-01-10T05:11:22.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22462025-01-10T05:11:22.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96419 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48630 req_id = fc63db6b-44c1-4451-b651-c5d4bed53334 response_code = 204 uri = /switch-ports
22472025-01-10T05:11:22.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48630 req_id = 05f0868a-ad09-44bc-9c6d-1c01261b9a04 response_code = 200 uri = /network-bootstore-config
22482025-01-10T05:11:22.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56881
22492025-01-10T05:11:22.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56881 req_id = 5bc2463a-4784-4d14-88cb-4917d9067977 response_code = 200 uri = /vpc-routes
22502025-01-10T05:11:22.862ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
22512025-01-10T05:11:22.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56881 req_id = 0c64fa1c-04ca-45ea-a168-71937f07804d response_code = 204 uri = /eip-gateways
22522025-01-10T05:11:22.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56881 req_id = af5ffc67-7251-4f5d-9a6c-0c5f72d0c4f6 response_code = 204 uri = /vpc-routes
22532025-01-10T05:11:22.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48373
22542025-01-10T05:11:22.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48373 req_id = 871830f1-9187-421e-88e7-b534daa34589 response_code = 200 uri = /v2p
22552025-01-10T05:11:22.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33266
22562025-01-10T05:11:22.979ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22572025-01-10T05:11:23.021ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22582025-01-10T05:11:23.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98916 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33266 req_id = da29a278-4493-4dbe-9d13-82eaf6910539 response_code = 204 uri = /switch-ports
22592025-01-10T05:11:23.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33266 req_id = e5a3416d-fa96-4a02-b4ea-c731897ab81b response_code = 200 uri = /network-bootstore-config
22602025-01-10T05:11:23.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35132
22612025-01-10T05:11:23.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35132 req_id = 37ac0251-9d1d-4676-b201-61e473d19240 response_code = 200 uri = /vpc-routes
22622025-01-10T05:11:23.155ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
22632025-01-10T05:11:23.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35132 req_id = 603e29d6-ccff-4278-94ad-9feeb06cbfa5 response_code = 204 uri = /eip-gateways
22642025-01-10T05:11:23.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35132 req_id = 32b49e9b-0fe9-442f-9675-1f6a59dd61de response_code = 204 uri = /vpc-routes
22652025-01-10T05:11:23.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40082
22662025-01-10T05:11:23.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40082 req_id = cbdc7683-6502-49d1-a8ef-d214ea6d67a2 response_code = 200 uri = /v2p
22672025-01-10T05:11:23.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45101
22682025-01-10T05:11:23.298ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22692025-01-10T05:11:23.336ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22702025-01-10T05:11:23.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91218 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45101 req_id = 8ae21d41-1a9b-4fb3-becb-bc72ebeedb27 response_code = 204 uri = /switch-ports
22712025-01-10T05:11:23.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45101 req_id = d0d7c667-6e52-4336-a38f-f055708ec5ad response_code = 200 uri = /network-bootstore-config
22722025-01-10T05:11:37.566ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7744 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 86e0f446-1d24-4907-b84c-083755e26a9d response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
22732025-01-10T05:11:44.849ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56290
22742025-01-10T05:11:44.849ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56290 req_id = a4d4850f-919d-405d-b52a-b1c222a1379d response_code = 200 uri = /baseboard
22752025-01-10T05:11:52.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40356
22762025-01-10T05:11:52.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40356 req_id = 59e978fc-39b6-4c73-9934-77a446a1e4ef response_code = 200 uri = /vpc-routes
22772025-01-10T05:11:52.494ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
22782025-01-10T05:11:52.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40356 req_id = 6250a526-8824-47cb-adae-b2d10b7767e7 response_code = 204 uri = /eip-gateways
22792025-01-10T05:11:52.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40356 req_id = fe969031-6ff4-4843-91b4-faa4636575f0 response_code = 204 uri = /vpc-routes
22802025-01-10T05:11:52.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50120
22812025-01-10T05:11:52.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50120 req_id = 31a8e65c-e504-4a6c-b4e7-ac360937c454 response_code = 200 uri = /v2p
22822025-01-10T05:11:52.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50112
22832025-01-10T05:11:52.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22842025-01-10T05:11:52.793ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22852025-01-10T05:11:52.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132066 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50112 req_id = e639040b-2a94-4b72-b2fc-b315a74c1c23 response_code = 204 uri = /switch-ports
22862025-01-10T05:11:52.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50112 req_id = 7bb6b8b6-3db2-47f7-afd1-8a98539d447e response_code = 200 uri = /network-bootstore-config
22872025-01-10T05:11:53.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40114
22882025-01-10T05:11:53.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40114 req_id = c44f6eb4-fd58-4e28-816f-f9905d91d37b response_code = 200 uri = /vpc-routes
22892025-01-10T05:11:53.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
22902025-01-10T05:11:53.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40114 req_id = b351ead7-56ee-4bd4-87cc-0f4428981814 response_code = 204 uri = /eip-gateways
22912025-01-10T05:11:53.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58686
22922025-01-10T05:11:53.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58686 req_id = 26cdcc2d-d845-40b7-8425-c200508bbc97 response_code = 200 uri = /v2p
22932025-01-10T05:11:53.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40114 req_id = c0614d31-e4e6-498b-8fb7-f7b45e90c912 response_code = 204 uri = /vpc-routes
22942025-01-10T05:11:53.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37122
22952025-01-10T05:11:53.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37122 req_id = 02e8b637-c374-456f-bcef-da48da57585c response_code = 200 uri = /vpc-routes
22962025-01-10T05:11:53.159ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
22972025-01-10T05:11:53.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37122 req_id = 20614ddf-dfc7-4b7c-857f-4a65513c45ec response_code = 204 uri = /eip-gateways
22982025-01-10T05:11:53.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37122 req_id = d54ab4bf-7f1c-4047-8192-8da786c7f4b9 response_code = 204 uri = /vpc-routes
22992025-01-10T05:11:53.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47263
23002025-01-10T05:11:53.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23012025-01-10T05:11:53.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23022025-01-10T05:11:53.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101417 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47263 req_id = 74e4c9eb-c632-4915-be76-2a0ad7a8389d response_code = 204 uri = /switch-ports
23032025-01-10T05:11:53.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47263 req_id = 7a9f6ab5-bd06-4084-9c34-2f2ec3147ccb response_code = 200 uri = /network-bootstore-config
23042025-01-10T05:11:53.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36435
23052025-01-10T05:11:53.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36435 req_id = 72d8c24c-0028-432d-bd97-b3423ad17819 response_code = 200 uri = /v2p
23062025-01-10T05:11:53.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53422
23072025-01-10T05:11:53.493ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23082025-01-10T05:11:53.532ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23092025-01-10T05:11:53.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53422 req_id = c6991be1-fdae-4503-b60a-20eca429804b response_code = 204 uri = /switch-ports
23102025-01-10T05:11:53.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53422 req_id = ccac0d52-289a-4381-a67e-3fa0b5954a38 response_code = 200 uri = /network-bootstore-config
23112025-01-10T05:12:07.564ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6637 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 05556e49-da86-4712-94d5-b73153edb750 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
23122025-01-10T05:12:14.880ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43322
23132025-01-10T05:12:14.880ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43322 req_id = aff36393-a750-4416-8e07-370dd7d650a1 response_code = 200 uri = /baseboard
23142025-01-10T05:12:22.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57688
23152025-01-10T05:12:22.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57688 req_id = 7a053db0-37f3-430f-b952-10e998dbd8df response_code = 200 uri = /vpc-routes
23162025-01-10T05:12:22.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
23172025-01-10T05:12:22.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57688 req_id = a18df7e6-a364-458d-8575-5cc412ba53a7 response_code = 204 uri = /eip-gateways
23182025-01-10T05:12:22.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57688 req_id = 026bbff9-d44a-4cb2-9600-788c71cf8edb response_code = 204 uri = /vpc-routes
23192025-01-10T05:12:22.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32904
23202025-01-10T05:12:22.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32904 req_id = 4f714d73-8251-4446-be03-420a28b7e907 response_code = 200 uri = /v2p
23212025-01-10T05:12:22.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59300
23222025-01-10T05:12:22.562ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23232025-01-10T05:12:22.602ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23242025-01-10T05:12:22.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100853 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59300 req_id = ddffd250-2c5e-4a97-af5e-4a6cc43e7128 response_code = 204 uri = /switch-ports
23252025-01-10T05:12:22.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59300 req_id = 14420638-9663-406d-b7aa-25f8037abab3 response_code = 200 uri = /network-bootstore-config
23262025-01-10T05:12:22.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40888
23272025-01-10T05:12:22.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40888 req_id = aa63fac2-779f-4bea-a526-8da65713ce0f response_code = 200 uri = /vpc-routes
23282025-01-10T05:12:22.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
23292025-01-10T05:12:22.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40888 req_id = 9e9d065f-90d4-447f-a18b-01c6db1f5ed6 response_code = 204 uri = /eip-gateways
23302025-01-10T05:12:22.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40888 req_id = 450b86d4-8544-4a9c-b032-6a8ac1668a3d response_code = 204 uri = /vpc-routes
23312025-01-10T05:12:22.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35943
23322025-01-10T05:12:22.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35943 req_id = 785c98f2-189c-4b61-b87a-634a2f30d9eb response_code = 200 uri = /v2p
23332025-01-10T05:12:22.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37989
23342025-01-10T05:12:22.975ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23352025-01-10T05:12:23.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23362025-01-10T05:12:23.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94716 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37989 req_id = 246c80eb-65f1-4471-abb7-331151ea7102 response_code = 204 uri = /switch-ports
23372025-01-10T05:12:23.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62558
23382025-01-10T05:12:23.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62558 req_id = 2cc89915-60d9-4556-b4ac-00da55d976da response_code = 200 uri = /vpc-routes
23392025-01-10T05:12:23.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37989 req_id = 4105c62b-759d-45ee-b008-4b55848d5b98 response_code = 200 uri = /network-bootstore-config
23402025-01-10T05:12:23.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64553
23412025-01-10T05:12:23.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64553 req_id = a93660c0-0f83-4ba3-aaae-6d7394769982 response_code = 200 uri = /v2p
23422025-01-10T05:12:23.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48046
23432025-01-10T05:12:23.130ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23442025-01-10T05:12:23.170ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23452025-01-10T05:12:23.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48046 req_id = 486baf47-4b17-4254-9ac2-a81add56bc1f response_code = 204 uri = /switch-ports
23462025-01-10T05:12:23.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
23472025-01-10T05:12:23.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62558 req_id = 1f3dab84-cf09-4eaf-88a9-3a58baa2e96e response_code = 204 uri = /eip-gateways
23482025-01-10T05:12:23.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48046 req_id = 98401bb9-b7cd-4735-99ee-00063fd11196 response_code = 200 uri = /network-bootstore-config
23492025-01-10T05:12:23.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62558 req_id = 95fd263d-d195-4094-8ccb-8d2b4d00ec40 response_code = 204 uri = /vpc-routes
23502025-01-10T05:12:37.566ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8512 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = d07b4e06-f7f1-4c22-8928-b9a922d6d22b response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
23512025-01-10T05:12:44.914ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62837
23522025-01-10T05:12:44.914ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62837 req_id = c77aaf02-415b-4af2-bc8a-ce4eab771541 response_code = 200 uri = /baseboard
23532025-01-10T05:12:52.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61083
23542025-01-10T05:12:52.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61083 req_id = acdddb7c-418e-48fc-b8fc-8c41d603d6da response_code = 200 uri = /vpc-routes
23552025-01-10T05:12:52.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
23562025-01-10T05:12:52.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61083 req_id = b99cb539-4dda-49f8-9412-b8edf6c3bd75 response_code = 204 uri = /eip-gateways
23572025-01-10T05:12:52.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61083 req_id = 6d0bd8df-821b-4e0c-b0b7-03d00a6aaa37 response_code = 204 uri = /vpc-routes
23582025-01-10T05:12:52.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37043
23592025-01-10T05:12:52.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37043 req_id = d05d8562-28a2-4d3d-a907-f91dbbe64e68 response_code = 200 uri = /v2p
23602025-01-10T05:12:52.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34915
23612025-01-10T05:12:52.791ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23622025-01-10T05:12:52.830ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23632025-01-10T05:12:52.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131914 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34915 req_id = a01b4433-31fa-4be3-ad91-131a4d0edad3 response_code = 204 uri = /switch-ports
23642025-01-10T05:12:52.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34915 req_id = c3115708-efd4-4cc6-a98e-bb0fb652c77f response_code = 200 uri = /network-bootstore-config
23652025-01-10T05:12:52.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46283
23662025-01-10T05:12:52.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46283 req_id = 03aa00b9-d0df-45be-88df-d6da2cf5d790 response_code = 200 uri = /vpc-routes
23672025-01-10T05:12:53.007ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
23682025-01-10T05:12:53.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46283 req_id = f6365e1b-4c0a-4370-bfbc-41d820c0166f response_code = 204 uri = /eip-gateways
23692025-01-10T05:12:53.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46283 req_id = 03f5556f-103c-459a-bc51-04dd5430ed58 response_code = 204 uri = /vpc-routes
23702025-01-10T05:12:53.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32990
23712025-01-10T05:12:53.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32990 req_id = b7383c37-660a-4617-a722-5bc57bf068e4 response_code = 200 uri = /v2p
23722025-01-10T05:12:53.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56857
23732025-01-10T05:12:53.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23742025-01-10T05:12:53.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23752025-01-10T05:12:53.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92608 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56857 req_id = 234fed45-8b82-4936-8323-b3d216e21f1f response_code = 204 uri = /switch-ports
23762025-01-10T05:12:53.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56224
23772025-01-10T05:12:53.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56224 req_id = 08b09f63-b80f-4764-987a-36bf065cacd8 response_code = 200 uri = /vpc-routes
23782025-01-10T05:12:53.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56857 req_id = d074de32-33ea-4022-8faf-8aa78ef0d2e2 response_code = 200 uri = /network-bootstore-config
23792025-01-10T05:12:53.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55721
23802025-01-10T05:12:53.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55721 req_id = b9425e4f-521a-4fe2-8cdc-60f8dab5c1b1 response_code = 200 uri = /v2p
23812025-01-10T05:12:53.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
23822025-01-10T05:12:53.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56224 req_id = fc5f645a-b03c-495c-916f-96478d465a93 response_code = 204 uri = /eip-gateways
23832025-01-10T05:12:53.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56224 req_id = e915e4b5-ce2e-4c65-9dea-3360b66606da response_code = 204 uri = /vpc-routes
23842025-01-10T05:12:53.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44516
23852025-01-10T05:12:53.320ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23862025-01-10T05:12:53.355ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23872025-01-10T05:12:53.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87830 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44516 req_id = eaf9c033-b5ed-4ac6-9281-a24ba856dfcf response_code = 204 uri = /switch-ports
23882025-01-10T05:12:53.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44516 req_id = f4042b15-160c-42a4-8fe2-beea39a4ddbd response_code = 200 uri = /network-bootstore-config
23892025-01-10T05:13:07.565ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7719 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = bd8a0582-bbda-4ab0-82a2-3a022b5593a9 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
23902025-01-10T05:13:14.946ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36541
23912025-01-10T05:13:14.947ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36541 req_id = f901a87a-7367-4fb2-a133-a80becb4a508 response_code = 200 uri = /baseboard
23922025-01-10T05:13:20.237ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23932025-01-10T05:13:20.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23942025-01-10T05:13:20.283ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 27410, tv_nsec: 787599835 } time_to_next_cleanup = 599.999995909s
23952025-01-10T05:13:22.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52633
23962025-01-10T05:13:22.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52633 req_id = 3ada195b-b223-40f3-b234-59c3e7ec96cf response_code = 200 uri = /vpc-routes
23972025-01-10T05:13:22.330ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
23982025-01-10T05:13:22.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52633 req_id = fd7c47fa-51e4-46a1-9518-0436262822c9 response_code = 204 uri = /eip-gateways
23992025-01-10T05:13:22.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52633 req_id = 5a80b9c3-1929-44cb-bcee-07ed39a92d94 response_code = 204 uri = /vpc-routes
24002025-01-10T05:13:22.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39642
24012025-01-10T05:13:22.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24022025-01-10T05:13:22.408ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24032025-01-10T05:13:22.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99217 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39642 req_id = 6a7704ea-6dbb-4e10-a806-20d415c66535 response_code = 204 uri = /switch-ports
24042025-01-10T05:13:22.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39642 req_id = 10591a45-7dc5-439b-afc1-4b8e927b1663 response_code = 200 uri = /network-bootstore-config
24052025-01-10T05:13:22.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58507
24062025-01-10T05:13:22.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58507 req_id = 797cfb22-8b89-4f90-89dd-7bd31610287f response_code = 200 uri = /v2p
24072025-01-10T05:13:22.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46404
24082025-01-10T05:13:22.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46404 req_id = c1fd8f70-03c0-4e5a-8cd8-84737743e8d9 response_code = 200 uri = /vpc-routes
24092025-01-10T05:13:22.823ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
24102025-01-10T05:13:22.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46404 req_id = f9a05e53-26d3-4960-8ad6-4ff425df9d03 response_code = 204 uri = /eip-gateways
24112025-01-10T05:13:22.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46404 req_id = 600d667a-8817-4959-95c9-7caf7c3cf3c3 response_code = 204 uri = /vpc-routes
24122025-01-10T05:13:22.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51618
24132025-01-10T05:13:22.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24142025-01-10T05:13:22.977ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24152025-01-10T05:13:23.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51618 req_id = 350f7866-e1d6-47c4-81dc-3b58f343fe11 response_code = 204 uri = /switch-ports
24162025-01-10T05:13:23.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48334
24172025-01-10T05:13:23.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51618 req_id = b7e9f258-3b8e-462b-8ff7-f51194add99d response_code = 200 uri = /network-bootstore-config
24182025-01-10T05:13:23.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48334 req_id = 30a50004-0969-4fdd-a142-413d08c4da1d response_code = 200 uri = /v2p
24192025-01-10T05:13:23.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34541
24202025-01-10T05:13:23.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34541 req_id = 8157bc2e-411d-4055-936e-9ac48fa4d2ed response_code = 200 uri = /v2p
24212025-01-10T05:13:23.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53684
24222025-01-10T05:13:23.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53684 req_id = 0ee91620-0b51-4939-85cd-f953d5f03378 response_code = 200 uri = /vpc-routes
24232025-01-10T05:13:23.082ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
24242025-01-10T05:13:23.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53684 req_id = 9d3e64b4-3c4d-441c-a62e-2a0cd84724db response_code = 204 uri = /eip-gateways
24252025-01-10T05:13:23.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53684 req_id = 27d5d94b-3bf9-45b2-95b8-5b8cd509e86c response_code = 204 uri = /vpc-routes
24262025-01-10T05:13:23.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43859
24272025-01-10T05:13:23.154ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24282025-01-10T05:13:23.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24292025-01-10T05:13:23.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94962 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43859 req_id = 806a4a78-5383-4029-a82a-bbe510900c21 response_code = 204 uri = /switch-ports
24302025-01-10T05:13:23.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43859 req_id = 34c78286-6f97-441b-916b-3a6e696244fe response_code = 200 uri = /network-bootstore-config
24312025-01-10T05:13:34.800ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24322025-01-10T05:13:37.563ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6206 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 7428ce68-85f2-4f8b-b602-d5f861e5debb response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
24332025-01-10T05:13:44.980ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45310
24342025-01-10T05:13:44.980ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45310 req_id = e1afe1af-92a9-418c-8d3b-ce107bfb59b5 response_code = 200 uri = /baseboard
24352025-01-10T05:13:52.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37996
24362025-01-10T05:13:52.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37996 req_id = 163953ba-3202-4996-b6b7-b2d61fa642c7 response_code = 200 uri = /vpc-routes
24372025-01-10T05:13:52.483ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
24382025-01-10T05:13:52.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37996 req_id = 4a391c50-67c6-4a5b-b158-dc0d8b294008 response_code = 204 uri = /eip-gateways
24392025-01-10T05:13:52.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37996 req_id = 2bac7970-1022-4017-b6f4-9bc6da3caea4 response_code = 204 uri = /vpc-routes
24402025-01-10T05:13:52.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47537
24412025-01-10T05:13:52.536ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24422025-01-10T05:13:52.573ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24432025-01-10T05:13:52.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47537 req_id = 48ffdcf7-452c-4877-a02d-ef2ac4a76384 response_code = 204 uri = /switch-ports
24442025-01-10T05:13:52.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33625
24452025-01-10T05:13:52.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47537 req_id = aaf2295c-91a0-4100-a2a4-189270c632c4 response_code = 200 uri = /network-bootstore-config
24462025-01-10T05:13:52.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33625 req_id = a523272e-8dd5-46ac-81a1-c7fd33bb4fb4 response_code = 200 uri = /v2p
24472025-01-10T05:13:52.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65463
24482025-01-10T05:13:52.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65463 req_id = 5d708e50-abde-45e2-914b-1f9670beafe0 response_code = 200 uri = /vpc-routes
24492025-01-10T05:13:53.043ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
24502025-01-10T05:13:53.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65463 req_id = 7705d1b9-778c-439f-bd20-2bb304b4414d response_code = 204 uri = /eip-gateways
24512025-01-10T05:13:53.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65463 req_id = f55a4877-2f39-4f3f-b870-ef6a51a777b2 response_code = 204 uri = /vpc-routes
24522025-01-10T05:13:53.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53837
24532025-01-10T05:13:53.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53837 req_id = 1a133bf0-88d4-4226-b0cb-b0b2bb5d4447 response_code = 200 uri = /v2p
24542025-01-10T05:13:53.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44531
24552025-01-10T05:13:53.160ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24562025-01-10T05:13:53.196ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24572025-01-10T05:13:53.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44531 req_id = ce580e4d-5d21-4128-93e5-503eb9b0bada response_code = 204 uri = /switch-ports
24582025-01-10T05:13:53.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46765
24592025-01-10T05:13:53.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44531 req_id = e17b5e5d-6091-44e2-aeb8-f357d5ca0d0f response_code = 200 uri = /network-bootstore-config
24602025-01-10T05:13:53.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46765 req_id = b4ae0f73-749f-4150-8f43-776338bc3d1f response_code = 200 uri = /vpc-routes
24612025-01-10T05:13:53.308ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
24622025-01-10T05:13:53.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46765 req_id = 658fc8e2-0dac-4b17-85e9-5c2d29500101 response_code = 204 uri = /eip-gateways
24632025-01-10T05:13:53.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46765 req_id = a83d19e0-c35a-432a-b4f9-2cacdcf5b864 response_code = 204 uri = /vpc-routes
24642025-01-10T05:13:53.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61471
24652025-01-10T05:13:53.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61471 req_id = 282d4182-25b8-417c-a8b4-6bafcf3c6fab response_code = 200 uri = /v2p
24662025-01-10T05:13:53.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56371
24672025-01-10T05:13:53.424ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24682025-01-10T05:13:53.462ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24692025-01-10T05:13:53.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56371 req_id = 6055ba07-1380-457b-b5fa-064913e379f3 response_code = 204 uri = /switch-ports
24702025-01-10T05:13:53.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56371 req_id = a74e562e-5e05-46e1-b589-f9dd4542bc0a response_code = 200 uri = /network-bootstore-config
24712025-01-10T05:14:07.563ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6883 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 3bda4864-e414-48f7-a28a-4460296b470c response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
24722025-01-10T05:14:15.014ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54103
24732025-01-10T05:14:15.014ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54103 req_id = 99bc400e-13a5-4061-8f95-360179c1835e response_code = 200 uri = /baseboard
24742025-01-10T05:14:22.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45567
24752025-01-10T05:14:22.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45567 req_id = 28dd58a4-0be2-4979-b605-113befb96ce3 response_code = 200 uri = /vpc-routes
24762025-01-10T05:14:22.339ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
24772025-01-10T05:14:22.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45567 req_id = 9a5be1f3-adeb-4716-ae15-b62f94f6702f response_code = 204 uri = /eip-gateways
24782025-01-10T05:14:22.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45567 req_id = 7c762da2-9dec-449a-8a51-125729473a89 response_code = 204 uri = /vpc-routes
24792025-01-10T05:14:22.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38959
24802025-01-10T05:14:22.376ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24812025-01-10T05:14:22.420ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24822025-01-10T05:14:22.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38959 req_id = 7bf63781-c86a-427f-b5e0-b2d077d6193c response_code = 204 uri = /switch-ports
24832025-01-10T05:14:22.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54931
24842025-01-10T05:14:22.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54931 req_id = 363ea42b-50f1-4f82-bd38-b33e739fdcde response_code = 200 uri = /v2p
24852025-01-10T05:14:22.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38959 req_id = bd6db675-229b-4060-bd63-9d96f4ff3bcd response_code = 200 uri = /network-bootstore-config
24862025-01-10T05:14:22.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40795
24872025-01-10T05:14:22.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40795 req_id = d51a0bd9-e3bc-4116-8ed5-f49edd4aebe6 response_code = 200 uri = /vpc-routes
24882025-01-10T05:14:22.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
24892025-01-10T05:14:22.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40795 req_id = b099506c-8b30-4b36-b2ba-d50668a1ca21 response_code = 204 uri = /eip-gateways
24902025-01-10T05:14:22.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50539
24912025-01-10T05:14:22.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24922025-01-10T05:14:22.979ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24932025-01-10T05:14:23.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108205 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50539 req_id = a33e7f96-f49e-4465-b768-247928db2b39 response_code = 204 uri = /switch-ports
24942025-01-10T05:14:23.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56399
24952025-01-10T05:14:23.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50539 req_id = 55c37dc9-e924-4bf8-b0ed-2718c512f771 response_code = 200 uri = /network-bootstore-config
24962025-01-10T05:14:23.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40795 req_id = bcad4eae-8c35-4337-b806-6f13791744fb response_code = 204 uri = /vpc-routes
24972025-01-10T05:14:23.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56399 req_id = 23cc6d7a-14c7-4d1a-915e-d1c0fc97d92a response_code = 200 uri = /v2p
24982025-01-10T05:14:23.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48270
24992025-01-10T05:14:23.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48270 req_id = 1a88821a-9aad-409e-8f02-f4ee6a945c73 response_code = 200 uri = /vpc-routes
25002025-01-10T05:14:23.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38766
25012025-01-10T05:14:23.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38766 req_id = 438dbe54-39c5-40ae-bcd3-793fc01d074c response_code = 200 uri = /v2p
25022025-01-10T05:14:23.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
25032025-01-10T05:14:23.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48270 req_id = f87f22a6-eae9-4e83-baea-4af025b3f54c response_code = 204 uri = /eip-gateways
25042025-01-10T05:14:23.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48270 req_id = 7fcb7987-625f-4685-9b1f-25c079612c0b response_code = 204 uri = /vpc-routes
25052025-01-10T05:14:23.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34164
25062025-01-10T05:14:23.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25072025-01-10T05:14:23.216ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25082025-01-10T05:14:23.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85622 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34164 req_id = bba26b8a-5972-42d9-8d65-6c5463ac2f5a response_code = 204 uri = /switch-ports
25092025-01-10T05:14:23.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34164 req_id = a54e5233-eb68-4cdf-a77c-78ad9fa0512d response_code = 200 uri = /network-bootstore-config
25102025-01-10T05:14:37.564ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7841 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = e27f2cb2-3153-4533-b776-5d2ab4f36923 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
25112025-01-10T05:14:45.046ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50761
25122025-01-10T05:14:45.047ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50761 req_id = 0866da26-d866-48fe-9a0e-fd63e0512839 response_code = 200 uri = /baseboard
25132025-01-10T05:14:52.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45105
25142025-01-10T05:14:52.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45105 req_id = 2089f24d-9d3d-42ca-8760-7084e66c389a response_code = 200 uri = /vpc-routes
25152025-01-10T05:14:52.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52633
25162025-01-10T05:14:52.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52633 req_id = 5252e107-73a5-461f-b92d-37179f9e233f response_code = 200 uri = /v2p
25172025-01-10T05:14:52.613ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
25182025-01-10T05:14:52.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45105 req_id = 636d7085-b656-486a-9880-adebcc2557d4 response_code = 204 uri = /eip-gateways
25192025-01-10T05:14:52.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45105 req_id = 0d7e32bd-0755-4ffd-aced-79d8bbb0197f response_code = 204 uri = /vpc-routes
25202025-01-10T05:14:52.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41218
25212025-01-10T05:14:52.768ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25222025-01-10T05:14:52.817ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25232025-01-10T05:14:52.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41218 req_id = f59f5378-47d9-4456-bf5b-553a1bc42f50 response_code = 204 uri = /switch-ports
25242025-01-10T05:14:52.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41218 req_id = e3f78fc2-5e30-4835-9317-4e7454d39b47 response_code = 200 uri = /network-bootstore-config
25252025-01-10T05:14:52.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58988
25262025-01-10T05:14:52.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58988 req_id = e4cf4498-c616-46e4-9636-b8a04c3fbe96 response_code = 200 uri = /vpc-routes
25272025-01-10T05:14:52.990ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
25282025-01-10T05:14:52.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58988 req_id = 4d06333a-d969-41ee-a931-7bb705a570e2 response_code = 204 uri = /eip-gateways
25292025-01-10T05:14:53.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58988 req_id = c0c9c037-1a40-4385-be04-646f5c3789e0 response_code = 204 uri = /vpc-routes
25302025-01-10T05:14:53.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47411
25312025-01-10T05:14:53.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47411 req_id = df645018-2281-4a1f-bf2f-232799f6e6ee response_code = 200 uri = /v2p
25322025-01-10T05:14:53.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37621
25332025-01-10T05:14:53.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37621 req_id = 6eb81de0-74fa-4fc5-a835-522e4c14189b response_code = 200 uri = /vpc-routes
25342025-01-10T05:14:53.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58678
25352025-01-10T05:14:53.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25362025-01-10T05:14:53.231ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25372025-01-10T05:14:53.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96649 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58678 req_id = b4ddc32c-397d-47a1-a088-c1c1cb81a546 response_code = 204 uri = /switch-ports
25382025-01-10T05:14:53.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55476
25392025-01-10T05:14:53.286ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
25402025-01-10T05:14:53.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37621 req_id = 5fdaa892-6da9-4a92-8272-a9ad22538f20 response_code = 204 uri = /eip-gateways
25412025-01-10T05:14:53.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46919
25422025-01-10T05:14:53.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55476 req_id = 707a1652-f54c-4eae-aabb-f4e69501cb39 response_code = 200 uri = /v2p
25432025-01-10T05:14:53.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58678 req_id = e670a806-ee52-4fb5-b111-6b74440478c3 response_code = 200 uri = /network-bootstore-config
25442025-01-10T05:14:53.286ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25452025-01-10T05:14:53.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37621 req_id = b131b443-b963-45d5-810e-e8e9d838c29c response_code = 204 uri = /vpc-routes
25462025-01-10T05:14:53.320ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25472025-01-10T05:14:53.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81526 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46919 req_id = f781b87f-3e45-40c7-9ffb-a75347fa0888 response_code = 204 uri = /switch-ports
25482025-01-10T05:14:53.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46919 req_id = 5030e960-2182-4916-b3ed-159c5b2b33fa response_code = 200 uri = /network-bootstore-config
25492025-01-10T05:15:07.561ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5897 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = ddcc866e-0815-4cd5-827f-91ad9a2bb183 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
25502025-01-10T05:15:15.081ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37893
25512025-01-10T05:15:15.081ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37893 req_id = 2fbc9b96-4ee7-4d69-912d-ddb1358fe845 response_code = 200 uri = /baseboard
25522025-01-10T05:15:22.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54638
25532025-01-10T05:15:22.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54638 req_id = b69735b7-413f-4e75-aaa1-c233c5e0fc5c response_code = 200 uri = /vpc-routes
25542025-01-10T05:15:22.376ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
25552025-01-10T05:15:22.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54638 req_id = 97e58d75-5c5b-430d-812a-d06110f776a1 response_code = 204 uri = /eip-gateways
25562025-01-10T05:15:22.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54638 req_id = 5dfd50b5-3f32-4eb6-b130-2de75a35c314 response_code = 204 uri = /vpc-routes
25572025-01-10T05:15:22.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44217
25582025-01-10T05:15:22.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25592025-01-10T05:15:22.438ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25602025-01-10T05:15:22.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95768 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44217 req_id = abcd4f97-c091-4499-921b-06e475760af4 response_code = 204 uri = /switch-ports
25612025-01-10T05:15:22.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42782
25622025-01-10T05:15:22.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44217 req_id = 0381f62b-46bc-413d-b783-0882bdde589a response_code = 200 uri = /network-bootstore-config
25632025-01-10T05:15:22.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42782 req_id = 6843ba32-50fc-487d-83e1-c163b8fd4bea response_code = 200 uri = /v2p
25642025-01-10T05:15:22.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44309
25652025-01-10T05:15:22.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44309 req_id = e9772c7b-58cf-4cac-967a-7a08a681852f response_code = 200 uri = /v2p
25662025-01-10T05:15:22.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46696
25672025-01-10T05:15:22.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46696 req_id = a76b4d98-f790-4f01-ac9b-16d7eb1f211f response_code = 200 uri = /vpc-routes
25682025-01-10T05:15:22.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60261
25692025-01-10T05:15:22.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60261 req_id = 89581c63-f56b-4cdf-af83-6c1c088ef090 response_code = 200 uri = /vpc-routes
25702025-01-10T05:15:23.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
25712025-01-10T05:15:23.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46696 req_id = 9d880618-85c9-43c5-8194-efd1672cf9c6 response_code = 204 uri = /eip-gateways
25722025-01-10T05:15:23.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46696 req_id = 2aa9d070-31b6-4dc3-b84f-c1c0e1be53ad response_code = 204 uri = /vpc-routes
25732025-01-10T05:15:23.012ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
25742025-01-10T05:15:23.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60261 req_id = c31cc80a-b2b3-40f3-b167-1ad67920adea response_code = 204 uri = /eip-gateways
25752025-01-10T05:15:23.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52405
25762025-01-10T05:15:23.038ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25772025-01-10T05:15:23.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25782025-01-10T05:15:23.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100264 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52405 req_id = d86236a1-7df6-4ef4-a03a-9401cbc863dc response_code = 204 uri = /switch-ports
25792025-01-10T05:15:23.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54289
25802025-01-10T05:15:23.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52405 req_id = a3d0b104-72c2-4883-93a9-ad9f893ca9c7 response_code = 200 uri = /network-bootstore-config
25812025-01-10T05:15:23.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54289 req_id = 82e8f996-8fbc-475a-b4cc-f14f2bfd4c32 response_code = 200 uri = /v2p
25822025-01-10T05:15:23.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60261 req_id = 7b919402-0b19-492b-af15-df7079c9d670 response_code = 204 uri = /vpc-routes
25832025-01-10T05:15:23.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62302
25842025-01-10T05:15:23.164ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25852025-01-10T05:15:23.202ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25862025-01-10T05:15:23.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62302 req_id = b9d501c7-9649-422c-87ff-1b0ce69948fd response_code = 204 uri = /switch-ports
25872025-01-10T05:15:23.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62302 req_id = 1d82419d-c839-4d7c-89a8-4549441bce34 response_code = 200 uri = /network-bootstore-config
25882025-01-10T05:15:37.567ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12470 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 8f9dce15-06d9-43fd-abcc-92e67f5f5130 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
25892025-01-10T05:15:45.113ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42026
25902025-01-10T05:15:45.113ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42026 req_id = dc989f81-6133-4508-b4db-3ee1b9a21041 response_code = 200 uri = /baseboard
25912025-01-10T05:15:52.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45102
25922025-01-10T05:15:52.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45102 req_id = 7fd20f1f-4749-4da8-8f86-07d6ec7d49bc response_code = 200 uri = /vpc-routes
25932025-01-10T05:15:52.617ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
25942025-01-10T05:15:52.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45102 req_id = 2a044eb9-e765-494d-9910-1c6aa3ff7303 response_code = 204 uri = /eip-gateways
25952025-01-10T05:15:52.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45102 req_id = 89466f28-f88b-465b-98fa-bcca689922a0 response_code = 204 uri = /vpc-routes
25962025-01-10T05:15:52.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55297
25972025-01-10T05:15:52.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55297 req_id = 37fc654e-b3da-45a6-a018-30aac2285960 response_code = 200 uri = /v2p
25982025-01-10T05:15:52.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45454
25992025-01-10T05:15:52.945ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26002025-01-10T05:15:53.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26012025-01-10T05:15:53.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120020 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45454 req_id = bbdcb76c-8601-4a18-b33b-f4a9742f55ab response_code = 204 uri = /switch-ports
26022025-01-10T05:15:53.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52841
26032025-01-10T05:15:53.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54725
26042025-01-10T05:15:53.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54725 req_id = 8d1c3d6a-3901-46ce-bddd-19b0d2cb9ce4 response_code = 200 uri = /vpc-routes
26052025-01-10T05:15:53.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45454 req_id = eaec856a-3d4e-4bff-ab48-87be2f76ffa0 response_code = 200 uri = /network-bootstore-config
26062025-01-10T05:15:53.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26072025-01-10T05:15:53.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26082025-01-10T05:15:53.066ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:177
26092025-01-10T05:15:53.066ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:177
26102025-01-10T05:15:53.080ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26112025-01-10T05:15:53.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1
26122025-01-10T05:15:53.085ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
26132025-01-10T05:15:53.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54725 req_id = dd9d2fd0-4e7f-415d-9300-ad50e1158db8 response_code = 204 uri = /eip-gateways
26142025-01-10T05:15:53.103ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26152025-01-10T05:15:53.103ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ceb1ad5-1952-4abe-b542-37b814690640
26162025-01-10T05:15:53.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57862
26172025-01-10T05:15:53.111ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26182025-01-10T05:15:53.111ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26192025-01-10T05:15:53.111ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26202025-01-10T05:15:53.111ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26212025-01-10T05:15:53.111ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26222025-01-10T05:15:53.111ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26232025-01-10T05:15:53.111ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26242025-01-10T05:15:53.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 461 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57862 req_id = b6c2f356-3c99-4e7a-bcfb-4c8d6ceb29ac response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26252025-01-10T05:15:53.126ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26262025-01-10T05:15:53.126ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f
26272025-01-10T05:15:53.145ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26282025-01-10T05:15:53.145ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_721ba211-f349-4837-89b3-f4cf559302bb
26292025-01-10T05:15:53.163ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26302025-01-10T05:15:53.163ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49
26312025-01-10T05:15:53.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44702
26322025-01-10T05:15:53.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32847
26332025-01-10T05:15:53.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32847 req_id = 62e65c51-645b-4e83-adb8-070502bb7acc response_code = 200 uri = /v2p
26342025-01-10T05:15:53.176ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26352025-01-10T05:15:53.176ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26362025-01-10T05:15:53.176ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:177
26372025-01-10T05:15:53.182ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:177
26382025-01-10T05:15:53.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 999 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54725 req_id = a158bcb0-2d7c-429b-ba70-af386ad5166d response_code = 204 uri = /vpc-routes
26392025-01-10T05:15:53.189ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26402025-01-10T05:15:53.189ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_19b37234-d205-4094-b223-ad0e72e9c46e
26412025-01-10T05:15:53.203ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26422025-01-10T05:15:53.203ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1
26432025-01-10T05:15:53.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59349
26442025-01-10T05:15:53.229ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26452025-01-10T05:15:53.232ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26462025-01-10T05:15:53.233ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ceb1ad5-1952-4abe-b542-37b814690640
26472025-01-10T05:15:53.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58482
26482025-01-10T05:15:53.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45096
26492025-01-10T05:15:53.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45096 req_id = e8f5a5f7-2325-42a7-907d-7ebe81b267ca response_code = 200 uri = /vpc-routes
26502025-01-10T05:15:53.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58482 req_id = 0edf44e5-4a26-4335-9091-cdf823839990 response_code = 200 uri = /v2p
26512025-01-10T05:15:53.252ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26522025-01-10T05:15:53.252ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c7c8012-1908-4829-b530-3992d83456e0
26532025-01-10T05:15:53.269ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26542025-01-10T05:15:53.269ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f
26552025-01-10T05:15:53.274ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26562025-01-10T05:15:53.286ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26572025-01-10T05:15:53.286ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794
26582025-01-10T05:15:53.293ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
26592025-01-10T05:15:53.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45096 req_id = 50996ca5-920b-41fe-8e42-a52ab12ea3de response_code = 204 uri = /eip-gateways
26602025-01-10T05:15:53.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37725
26612025-01-10T05:15:53.294ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26622025-01-10T05:15:53.294ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26632025-01-10T05:15:53.294ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26642025-01-10T05:15:53.294ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26652025-01-10T05:15:53.294ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26662025-01-10T05:15:53.294ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26672025-01-10T05:15:53.294ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26682025-01-10T05:15:53.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 526 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37725 req_id = 4897b593-7a88-41c7-8e2a-f4172409c6ab response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26692025-01-10T05:15:53.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63738
26702025-01-10T05:15:53.310ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26712025-01-10T05:15:53.310ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_49894127-b79c-4807-aac5-383699d40578
26722025-01-10T05:15:53.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45096 req_id = 7fcd17fc-8093-443d-be40-ce6e13d9ea65 response_code = 204 uri = /vpc-routes
26732025-01-10T05:15:53.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26742025-01-10T05:15:53.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26752025-01-10T05:15:53.325ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26762025-01-10T05:15:53.325ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_721ba211-f349-4837-89b3-f4cf559302bb
26772025-01-10T05:15:53.325ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/config/omicron-zones.json file = common/src/ledger.rs:177
26782025-01-10T05:15:53.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52841 req_id = ccaa0892-dcf9-43e0-8446-396e5f8ded7a response_code = 200 uri = /inventory
26792025-01-10T05:15:53.331ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/03344b71-863f-4057-bb5e-476456797573/config/omicron-zones.json file = common/src/ledger.rs:177
26802025-01-10T05:15:53.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17b3267b-a8ff-4b77-a964-e10c10bac8b1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26812025-01-10T05:15:53.346ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17b3267b-a8ff-4b77-a964-e10c10bac8b1
26822025-01-10T05:15:53.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122403 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59349 req_id = 1f43068e-c292-4e7a-b5cb-2f626b3decac response_code = 204 uri = /switch-ports
26832025-01-10T05:15:53.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59349 req_id = 6629c1b5-1bec-4da5-8be8-1bc1e076b0ca response_code = 200 uri = /network-bootstore-config
26842025-01-10T05:15:53.366ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26852025-01-10T05:15:53.367ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49
26862025-01-10T05:15:53.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55843
26872025-01-10T05:15:53.373ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26882025-01-10T05:15:53.397ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26892025-01-10T05:15:53.397ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_19b37234-d205-4094-b223-ad0e72e9c46e
26902025-01-10T05:15:53.413ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1ceb1ad5-1952-4abe-b542-37b814690640 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26912025-01-10T05:15:53.413ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1ceb1ad5-1952-4abe-b542-37b814690640
26922025-01-10T05:15:53.420ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26932025-01-10T05:15:53.429ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26942025-01-10T05:15:53.433ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c7c8012-1908-4829-b530-3992d83456e0
26952025-01-10T05:15:53.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61800
26962025-01-10T05:15:53.446ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 677a3534-34ba-4230-bb45-84a07cadda91, kind: Service { id: 95b462f2-3c97-4463-9c08-5404518f33d2 }, name: Name("external-dns-95b462f2-3c97-4463-9c08-5404518f33d2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 9])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a7579baa-4dc6-41c4-aa40-d1574c336fc8, kind: Service { id: 30a043aa-79b8-40f0-889b-b1aa4686508a }, name: Name("external-dns-30a043aa-79b8-40f0-889b-b1aa4686508a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6b77252c-3753-4653-a12d-8d9cf4b8b034, kind: Service { id: 3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8 }, name: Name("nexus-3ca89dd1-7ada-4fe6-8600-a84d41dfa9d8"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 239, 193])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 88ecb166-c6e5-4bcc-886a-a1c3a146d28d, kind: Service { id: a5a77b64-bc6f-4038-bc69-a5f388ab2baa }, name: Name("nexus-a5a77b64-bc6f-4038-bc69-a5f388ab2baa"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 231])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf07848a-01b0-4d7b-822b-aef5c0a3de3f, kind: Service { id: 36b3525a-4d18-4be7-8420-a6b90a955a44 }, name: Name("nexus-36b3525a-4d18-4be7-8420-a6b90a955a44"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26972025-01-10T05:15:53.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26982025-01-10T05:15:53.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26992025-01-10T05:15:53.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27002025-01-10T05:15:53.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27012025-01-10T05:15:53.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27022025-01-10T05:15:53.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27032025-01-10T05:15:53.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 420 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61800 req_id = a9bfc242-1a3f-4eb7-8339-3dfbfaa9789e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27042025-01-10T05:15:53.447ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ba1d376f-c39e-456d-b5d1-c4907acd036f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27052025-01-10T05:15:53.447ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ba1d376f-c39e-456d-b5d1-c4907acd036f
27062025-01-10T05:15:53.472ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 721ba211-f349-4837-89b3-f4cf559302bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27072025-01-10T05:15:53.472ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_721ba211-f349-4837-89b3-f4cf559302bb
27082025-01-10T05:15:53.488ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27092025-01-10T05:15:53.488ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794
27102025-01-10T05:15:53.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119484 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55843 req_id = b36a8517-62a3-4340-bed9-6e7c1a0f78d3 response_code = 204 uri = /switch-ports
27112025-01-10T05:15:53.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 708 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55843 req_id = c9b890a3-9181-4a3a-bbbc-241fc8d6faba response_code = 200 uri = /network-bootstore-config
27122025-01-10T05:15:53.506ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a96a825e-8563-4a2e-a036-ecbdf8df1b49 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27132025-01-10T05:15:53.506ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a96a825e-8563-4a2e-a036-ecbdf8df1b49
27142025-01-10T05:15:53.521ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27152025-01-10T05:15:53.521ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_49894127-b79c-4807-aac5-383699d40578
27162025-01-10T05:15:53.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364031 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44702 req_id = 6e6dd43f-d147-4552-b781-793a4da1bd1f response_code = 200 uri = /inventory
27172025-01-10T05:15:53.543ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 19b37234-d205-4094-b223-ad0e72e9c46e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27182025-01-10T05:15:53.543ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_19b37234-d205-4094-b223-ad0e72e9c46e
27192025-01-10T05:15:53.565ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c7c8012-1908-4829-b530-3992d83456e0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27202025-01-10T05:15:53.565ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c7c8012-1908-4829-b530-3992d83456e0
27212025-01-10T05:15:53.586ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 60c3c183-7bfc-44a7-9cb5-82e776c32794 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27222025-01-10T05:15:53.586ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_60c3c183-7bfc-44a7-9cb5-82e776c32794
27232025-01-10T05:15:53.607ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 49894127-b79c-4807-aac5-383699d40578 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27242025-01-10T05:15:53.607ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_49894127-b79c-4807-aac5-383699d40578
27252025-01-10T05:15:53.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305541 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63738 req_id = 508f4c92-7041-4595-9d5a-8a0381dd12b2 response_code = 200 uri = /inventory
27262025-01-10T05:16:07.562ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7454 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = 28218f2a-7a2a-43df-a190-57ceb28ad608 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
27272025-01-10T05:16:15.146ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39158
27282025-01-10T05:16:15.146ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39158 req_id = fe7a6ef1-87b6-4a8d-953c-1c3b3f72cc28 response_code = 200 uri = /baseboard
27292025-01-10T05:16:22.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54848
27302025-01-10T05:16:22.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54848 req_id = a8d8988d-de39-405c-a605-865230511252 response_code = 200 uri = /vpc-routes
27312025-01-10T05:16:22.350ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
27322025-01-10T05:16:22.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54848 req_id = e39dbaae-e947-47d5-9423-c85b52777037 response_code = 204 uri = /eip-gateways
27332025-01-10T05:16:22.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54848 req_id = 6e6226a5-bf40-4e97-9152-22fee312f586 response_code = 204 uri = /vpc-routes
27342025-01-10T05:16:22.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52266
27352025-01-10T05:16:22.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52266 req_id = d6681c90-728d-4840-9e89-271c65790eaa response_code = 200 uri = /v2p
27362025-01-10T05:16:22.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60372
27372025-01-10T05:16:22.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27382025-01-10T05:16:22.657ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27392025-01-10T05:16:22.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60372 req_id = f2ca2ecb-b32e-4a7f-94fe-8ee02e98ffc2 response_code = 204 uri = /switch-ports
27402025-01-10T05:16:22.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60372 req_id = 71840241-bd2b-46c3-94a4-9a8ae4fd65cc response_code = 200 uri = /network-bootstore-config
27412025-01-10T05:16:22.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54165
27422025-01-10T05:16:22.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54165 req_id = 0f6ad001-2ee8-4a39-800c-b4bedd9de811 response_code = 200 uri = /vpc-routes
27432025-01-10T05:16:22.906ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
27442025-01-10T05:16:22.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54165 req_id = 813702cf-1969-4499-b157-5f9d24839cbc response_code = 204 uri = /eip-gateways
27452025-01-10T05:16:22.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62079
27462025-01-10T05:16:22.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62079 req_id = 8f335488-87b1-4d3d-81a2-a9f148df9ab4 response_code = 200 uri = /v2p
27472025-01-10T05:16:22.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54165 req_id = 7a7a9c6b-029d-4e2e-ac33-4bf3472f9816 response_code = 204 uri = /vpc-routes
27482025-01-10T05:16:22.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48168
27492025-01-10T05:16:22.985ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27502025-01-10T05:16:23.022ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27512025-01-10T05:16:23.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48168 req_id = fcb3063e-07a7-4759-80a1-916824e8854a response_code = 204 uri = /switch-ports
27522025-01-10T05:16:23.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53680
27532025-01-10T05:16:23.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53680 req_id = 5484cfb4-bfdc-4f15-a7da-0aace866b961 response_code = 200 uri = /vpc-routes
27542025-01-10T05:16:23.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48168 req_id = f9e248a3-5f54-469c-bbda-c55aa4f5a0bf response_code = 200 uri = /network-bootstore-config
27552025-01-10T05:16:23.123ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
27562025-01-10T05:16:23.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53680 req_id = e8bfecf5-17c9-4df1-953f-adf1d3e933b5 response_code = 204 uri = /eip-gateways
27572025-01-10T05:16:23.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55201
27582025-01-10T05:16:23.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55201 req_id = 3c578573-f82f-43e1-8e06-87146417dab7 response_code = 200 uri = /v2p
27592025-01-10T05:16:23.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53680 req_id = a68e2ca2-a27b-48fc-8887-92bd4b910568 response_code = 204 uri = /vpc-routes
27602025-01-10T05:16:23.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45009
27612025-01-10T05:16:23.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27622025-01-10T05:16:23.230ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27632025-01-10T05:16:23.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94215 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45009 req_id = 162c9906-0a90-499d-a09a-a8e4195cb538 response_code = 204 uri = /switch-ports
27642025-01-10T05:16:23.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45009 req_id = 63d02153-d23f-4e72-8a50-462ce3997912 response_code = 200 uri = /network-bootstore-config
27652025-01-10T05:16:27.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54151
27662025-01-10T05:16:27.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54151 req_id = 6242371a-f945-4243-90eb-33cd942576a6 response_code = 200 uri = /v2p
27672025-01-10T05:16:27.135ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6445912) }
27682025-01-10T05:16:27.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54151 req_id = 127be5e3-db7f-4dae-9b89-aeda1d7e9b23 response_code = 204 uri = /v2p
27692025-01-10T05:16:27.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44415
27702025-01-10T05:16:27.362ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: ba175292-1bb0-46be-b0eb-886eb79f1ba3, kind: Instance { id: 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6445912), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ba175292-1bb0-46be-b0eb-886eb79f1ba3, kind: Instance { id: 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6445912), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ba175292-1bb0-46be-b0eb-886eb79f1ba3, kind: Instance { id: 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6445912), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6445912))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ba175292-1bb0-46be-b0eb-886eb79f1ba3, kind: Instance { id: 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6445912), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: adf23a23-8a5d-41d7-b517-a6ad0312f0f0, slot: 0, read_only: false, vcr_json: .., name: "disk-99476e0b938" }], boot_settings: Some(InstanceBootSettings { order: [adf23a23-8a5d-41d7-b517-a6ad0312f0f0] }), cloud_init_bytes: Some(..) } instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 metadata = InstanceMetadata { silo_id: 48a76ac8-2f94-4847-be0f-1cb4bfb661aa, project_id: ebd2ddb5-c822-49b8-ac1e-6111502736b6 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-10T05:16:27.348684717Z }
27712025-01-10T05:16:27.362ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 migration_id = None propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
27722025-01-10T05:16:27.362ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 migration_id = None propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: ba175292-1bb0-46be-b0eb-886eb79f1ba3, kind: Instance { id: 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6445912), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ba175292-1bb0-46be-b0eb-886eb79f1ba3, kind: Instance { id: 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6445912), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ba175292-1bb0-46be-b0eb-886eb79f1ba3, kind: Instance { id: 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6445912), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6445912))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ba175292-1bb0-46be-b0eb-886eb79f1ba3, kind: Instance { id: 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6445912), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: adf23a23-8a5d-41d7-b517-a6ad0312f0f0, slot: 0, read_only: false, vcr_json: .., name: "disk-99476e0b938" }], boot_settings: Some(InstanceBootSettings { order: [adf23a23-8a5d-41d7-b517-a6ad0312f0f0] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-10T05:16:27.348684717Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27732025-01-10T05:16:27.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44415 req_id = dabc6953-21d6-4ab8-b34c-b03b2c9d6a28 response_code = 200 uri = /vmms/94045aaa-6f77-4209-bb66-cde829bf3dd0
27742025-01-10T05:16:27.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35073
27752025-01-10T05:16:27.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35073 req_id = c6316552-adfe-4ff7-96a6-3e29cec46967 response_code = 200 uri = /vmms/94045aaa-6f77-4209-bb66-cde829bf3dd0/state
27762025-01-10T05:16:27.490ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 6445912 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27772025-01-10T05:16:27.491ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27782025-01-10T05:16:27.530ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0 file = illumos-utils/src/zone.rs:325 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
27792025-01-10T05:16:27.555ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0 file = illumos-utils/src/zone.rs:363 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
27802025-01-10T05:16:27.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45364
27812025-01-10T05:16:27.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45364 req_id = c9698ffc-7e6e-4ca9-ad1f-b80391199d37 response_code = 200 uri = /vpc-routes
27822025-01-10T05:16:27.587ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {ba175292-1bb0-46be-b0eb-886eb79f1ba3: {10.151.2.175: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}, 10.151.2.176: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}}} }
27832025-01-10T05:16:29.307ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
27842025-01-10T05:16:29.307ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27852025-01-10T05:16:29.509ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 27.129462ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27862025-01-10T05:16:29.546ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 129.854119ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27872025-01-10T05:16:29.694ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 196.772785ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27882025-01-10T05:16:29.910ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 349.82665ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27892025-01-10T05:16:30.272ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 523.435234ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27902025-01-10T05:16:30.806ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 1.4900805s file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27912025-01-10T05:16:32.308ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 627.865575ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27922025-01-10T05:16:32.947ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 661.264432ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27932025-01-10T05:16:33.620ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 758.459673ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 zone = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
27942025-01-10T05:16:34.410ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0 file = sled-agent/src/instance.rs:2067 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
27952025-01-10T05:16:34.421ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 60.543742ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
27962025-01-10T05:16:34.492ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 82.33087ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
27972025-01-10T05:16:34.585ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 160.804009ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
27982025-01-10T05:16:34.758ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0") failed: Property not found. retry in 255.217847ms file = illumos-utils/src/svc.rs:36 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
27992025-01-10T05:16:35.024ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28002025-01-10T05:16:35.065ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28012025-01-10T05:16:35.221ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28022025-01-10T05:16:35.223ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
28032025-01-10T05:16:35.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7636855 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45364 req_id = 903345a7-30a0-4638-b226-1e22bf51d8f3 response_code = 204 uri = /eip-gateways
28042025-01-10T05:16:35.225ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-10T05:16:35.223996618Z } file = sled-agent/src/instance.rs:780 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28052025-01-10T05:16:35.225ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-10T05:16:35.223996618Z } propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28062025-01-10T05:16:35.225ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-10T05:16:35.223996618Z }, migration_in: None, migration_out: None }
28072025-01-10T05:16:35.260ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-10T05:16:35.260656668Z } file = sled-agent/src/instance.rs:780 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28082025-01-10T05:16:35.260ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-10T05:16:35.260656668Z } propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28092025-01-10T05:16:35.260ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-10T05:16:35.260656668Z }, migration_in: None, migration_out: None }
28102025-01-10T05:16:35.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 773 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45364 req_id = 192ca172-cdc4-4727-bc8c-0cd1ae52afbe response_code = 204 uri = /vpc-routes
28112025-01-10T05:16:37.561ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6971 local_addr = [fd00:1122:3344:101::1]:61625 method = GET remote_addr = [fd00:1122:3344:101::d]:37615 req_id = cf346d0b-1eac-439e-a55e-946cefaf0a93 response_code = 200 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 uri = /a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
28122025-01-10T05:16:45.178ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53654
28132025-01-10T05:16:45.178ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53654 req_id = 087ca854-6abe-441c-80c9-db02d60dd6ed response_code = 200 uri = /baseboard
28142025-01-10T05:16:50.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37042
28152025-01-10T05:16:50.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37042 req_id = 6b031b05-fd28-41f6-b065-f349f32b7f16 response_code = 200 uri = /vmms/94045aaa-6f77-4209-bb66-cde829bf3dd0/state
28162025-01-10T05:16:50.789ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-10T05:16:50.789265364Z } file = sled-agent/src/instance.rs:780 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28172025-01-10T05:16:50.789ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-10T05:16:50.789265364Z } propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28182025-01-10T05:16:50.789ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-10T05:16:50.789265364Z }, migration_in: None, migration_out: None }
28192025-01-10T05:16:50.871ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-10T05:16:50.871188413Z } file = sled-agent/src/instance.rs:780 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28202025-01-10T05:16:50.871ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-10T05:16:50.871188413Z } propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28212025-01-10T05:16:50.871ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28222025-01-10T05:16:50.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28232025-01-10T05:16:50.871ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 13283849021683869490 n_samples = 6 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
28242025-01-10T05:16:50.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28252025-01-10T05:16:50.871ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/03344b71-863f-4057-bb5e-476456797573/debug/bundle/zone", "/pool/int/18bf51d7-5505-48c1-a181-3dfd285cd8e8/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/17b3267b-a8ff-4b77-a964-e10c10bac8b1/crypt/debug", "/pool/ext/1ceb1ad5-1952-4abe-b542-37b814690640/crypt/debug", "/pool/ext/ba1d376f-c39e-456d-b5d1-c4907acd036f/crypt/debug", "/pool/ext/721ba211-f349-4837-89b3-f4cf559302bb/crypt/debug", "/pool/ext/a96a825e-8563-4a2e-a036-ecbdf8df1b49/crypt/debug", "/pool/ext/19b37234-d205-4094-b223-ad0e72e9c46e/crypt/debug", "/pool/ext/5c7c8012-1908-4829-b530-3992d83456e0/crypt/debug", "/pool/ext/60c3c183-7bfc-44a7-9cb5-82e776c32794/crypt/debug", "/pool/ext/49894127-b79c-4807-aac5-383699d40578/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0
28262025-01-10T05:16:50.871ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 15958686079370216477 n_samples = 6 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
28272025-01-10T05:16:51.506ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0", bundle_id: 668517b1-c877-4e2b-a785-f3a794057e23 }, time_created: 2025-01-10T05:16:50.872001109Z, version: 0, cause: TerminatedInstance }
28282025-01-10T05:16:51.506ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_94045aaa-6f77-4209-bb66-cde829bf3dd0 file = sled-agent/src/instance.rs:1313 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28292025-01-10T05:16:52.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57306
28302025-01-10T05:16:52.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57306 req_id = cbb027f2-949d-4085-b689-388b6e0dcde5 response_code = 200 uri = /vpc-routes
28312025-01-10T05:16:52.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57175
28322025-01-10T05:16:52.456ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {ba175292-1bb0-46be-b0eb-886eb79f1ba3: {10.151.2.176: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}, 10.151.2.175: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}}} }
28332025-01-10T05:16:52.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57306 req_id = 166bbfae-d5c2-49a7-b814-9b67011bf9c9 response_code = 204 uri = /eip-gateways
28342025-01-10T05:16:52.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57306 req_id = c53c03f2-e058-4eb6-86f1-1683ae974123 response_code = 204 uri = /vpc-routes
28352025-01-10T05:16:52.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37415
28362025-01-10T05:16:52.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37415 req_id = fb31c76d-f84c-4788-8961-4324af2ee03f response_code = 200 uri = /v2p
28372025-01-10T05:16:52.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61025
28382025-01-10T05:16:52.649ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28392025-01-10T05:16:52.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28402025-01-10T05:16:52.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61025 req_id = 58dcacda-b8ee-4785-9831-b7724606343b response_code = 204 uri = /switch-ports
28412025-01-10T05:16:52.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61025 req_id = 1ba39f27-3733-46f7-bf0a-3e870098f300 response_code = 200 uri = /network-bootstore-config
28422025-01-10T05:16:52.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36658
28432025-01-10T05:16:53.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63583
28442025-01-10T05:16:53.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56032
28452025-01-10T05:16:53.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56032 req_id = 15b0a388-acec-415b-8b54-2aff53acb15b response_code = 200 uri = /vpc-routes
28462025-01-10T05:16:53.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63133
28472025-01-10T05:16:53.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63133 req_id = 85a56fab-b962-4438-8be0-4dc02362166a response_code = 200 uri = /vpc-routes
28482025-01-10T05:16:53.247ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {ba175292-1bb0-46be-b0eb-886eb79f1ba3: {10.151.2.176: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}, 10.151.2.175: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}}} }
28492025-01-10T05:16:53.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56032 req_id = 2baa65a5-12a0-4ac5-932e-1fbb92b294c2 response_code = 204 uri = /eip-gateways
28502025-01-10T05:16:53.262ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {ba175292-1bb0-46be-b0eb-886eb79f1ba3: {10.151.2.176: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}, 10.151.2.175: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}}} }
28512025-01-10T05:16:53.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63133 req_id = 3f0e6c51-794d-4caf-84e9-cfdc9448aba0 response_code = 204 uri = /eip-gateways
28522025-01-10T05:16:53.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63133 req_id = aae6eab3-4cb2-4c46-8ca6-c43de26e26c4 response_code = 204 uri = /vpc-routes
28532025-01-10T05:16:53.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53847
28542025-01-10T05:16:53.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53847 req_id = 3c814f5e-555d-48f9-a724-b41155c8fa4c response_code = 200 uri = /v2p
28552025-01-10T05:16:53.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56032 req_id = fee03e2d-fbdb-4215-8b86-de6b6444f2e5 response_code = 204 uri = /vpc-routes
28562025-01-10T05:16:53.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39838
28572025-01-10T05:16:53.339ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28582025-01-10T05:16:53.380ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28592025-01-10T05:16:53.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39838 req_id = 409d2a5a-e229-4106-847b-684fc2655e14 response_code = 204 uri = /switch-ports
28602025-01-10T05:16:53.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33981
28612025-01-10T05:16:53.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47318
28622025-01-10T05:16:53.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39838 req_id = 3edced8b-dc3f-44c7-b5c1-f68af3eec60d response_code = 200 uri = /network-bootstore-config
28632025-01-10T05:16:53.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47318 req_id = dafd9f5e-a138-4665-98d4-bf71f4073ad6 response_code = 200 uri = /v2p
28642025-01-10T05:16:53.439ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28652025-01-10T05:16:53.457ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28662025-01-10T05:16:53.477ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6445912), kind: System }
28672025-01-10T05:16:53.477ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6445912), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28682025-01-10T05:16:53.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28692025-01-10T05:16:53.481ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-10T05:16:53.479318696Z }, migration_in: None, migration_out: None }
28702025-01-10T05:16:53.532ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-10T05:16:53.479318696Z }, migration_in: None, migration_out: None }
28712025-01-10T05:16:53.536ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = 7bf94b83-d698-4a23-bd13-e9fb4af61dd4 propolis_id = 94045aaa-6f77-4209-bb66-cde829bf3dd0
28722025-01-10T05:16:53.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549002 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36658 req_id = 4d965a09-92d0-4a05-83a3-124097a3d3a5 response_code = 200 uri = /vmms/94045aaa-6f77-4209-bb66-cde829bf3dd0/state
28732025-01-10T05:16:53.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1135776 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57175 req_id = 80f1162c-d708-4df7-b542-1948fdab7bef response_code = 200 uri = /vmms/94045aaa-6f77-4209-bb66-cde829bf3dd0/state
28742025-01-10T05:16:53.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 450735 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63583 req_id = 3652a1f7-67a7-4587-a8a9-e72a76b6d0f6 response_code = 200 uri = /vmms/94045aaa-6f77-4209-bb66-cde829bf3dd0/state
28752025-01-10T05:16:53.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33981 req_id = 1ff164de-9358-47bf-8d1e-d8d3db1a3f18 response_code = 204 uri = /switch-ports
28762025-01-10T05:16:53.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33981 req_id = c1460dba-a2c1-4a9b-869d-5b907e8a9ebc response_code = 200 uri = /network-bootstore-config
28772025-01-10T05:16:54.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45826
28782025-01-10T05:16:54.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45826 req_id = be1cc4ba-e35d-4eca-8b1f-26c60665d6a1 response_code = 200 uri = /vpc-routes
28792025-01-10T05:16:54.062ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {ba175292-1bb0-46be-b0eb-886eb79f1ba3: {10.151.2.176: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}, 10.151.2.175: {6703c9a8-9630-4196-98b7-6fd428c2a9e7}}} }
28802025-01-10T05:16:54.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45826 req_id = 0c9e6b9c-10b5-4b3b-a7c7-de0338db77b5 response_code = 204 uri = /eip-gateways
28812025-01-10T05:16:54.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45826 req_id = ad1e0286-6939-4c41-a602-e30e341cf187 response_code = 204 uri = /vpc-routes
28822025-01-10T05:16:54.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52602
28832025-01-10T05:16:54.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52602 req_id = c60c6271-53b2-4572-b87b-7dc357dd0f4c response_code = 200 uri = /v2p
28842025-01-10T05:16:55.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64515
28852025-01-10T05:16:55.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64515 req_id = e41eba7e-7202-460d-97fc-f5527884b3f6 response_code = 200 uri = /v2p
28862025-01-10T05:16:55.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61638
28872025-01-10T05:16:55.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61638 req_id = efd44971-390b-4eef-844c-82fdacd2ec78 response_code = 200 uri = /vpc-routes
28882025-01-10T05:16:55.495ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
28892025-01-10T05:16:55.495ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59
28902025-01-10T05:16:55.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61638 req_id = e17a81b1-62aa-4140-a5d4-de526b8d346a response_code = 204 uri = /eip-gateways
28912025-01-10T05:16:55.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61638 req_id = ce8ce1f4-b240-4c1e-8f00-a1161000eeec response_code = 204 uri = /vpc-routes
28922025-01-10T05:16:56.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53302
28932025-01-10T05:16:56.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53302 req_id = 51676eaa-2903-4fc1-917e-323ee35d0b1f response_code = 200 uri = /vpc-routes
28942025-01-10T05:16:56.181ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = a85eeb1a-bbdd-4901-9cfb-db76e1cf9b59 values = ExternalIpGatewayMap { mappings: {} }
28952025-01-10T05:16:56.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53302 req_id = 2ef2f20d-0d00-4dc4-b510-36bef563fb02 response_code = 204 uri = /eip-gateways
28962025-01-10T05:16:56.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53302 req_id = 529550a5-8031-4e04-8bf2-9a8b856ca523 response_code = 204 uri = /vpc-routes