Max level shown:
1 [ Jan 27 09:29:21 Enabled. ]
2 [ Jan 27 09:29:21 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 27 09:29:21 Method "start" exited with status 0. ]
4 [ Jan 27 09:29:21 Rereading configuration. ]
5 [ Jan 27 09:29:21 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-27T09:29:21.490ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-27T09:29:21.491ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-27T09:29:21.543ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-27T09:29:21.543ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-27T09:29:21.659ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-27T09:29:21.669ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-27T09:29:21.676ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-27T09:29:22.277ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-27T09:29:22.416ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-27T09:29:22.416ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-27T09:29:22.416ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-27T09:29:22.416ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
192025-01-27T09:29:22.416ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202025-01-27T09:29:22.416ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-27T09:29:22.419ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-27T09:29:22.419ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-27T09:29:22.419ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-27T09:29:22.419ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-27T09:29:22.419ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-27T09:29:22.419ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-27T09:29:22.419ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-27T09:29:22.419ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-27T09:29:22.419ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-27T09:29:22.431ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-27T09:29:22.431ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool)
322025-01-27T09:29:22.529ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal }
332025-01-27T09:29:22.879ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-27T09:29:22.879ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-27T09:29:22.879ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-27T09:29:22.879ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-27T09:29:22.879ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-27T09:29:22.879ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-27T09:29:22.879ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-27T09:29:22.888ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-27T09:29:22.888ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool)
422025-01-27T09:29:22.976ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal }
432025-01-27T09:29:23.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-27T09:29:23.336ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-27T09:29:23.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
472025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482025-01-27T09:29:23.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-27T09:29:23.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-27T09:29:23.336ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-27T09:29:23.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-27T09:29:23.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-27T09:29:23.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-27T09:29:23.336ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-27T09:29:23.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582025-01-27T09:29:23.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612025-01-27T09:29:23.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-27T09:29:23.336ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-27T09:29:23.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-27T09:29:23.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-27T09:29:23.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-27T09:29:23.336ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-27T09:29:23.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-27T09:29:23.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-27T09:29:23.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-27T09:29:23.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
752025-01-27T09:29:23.336ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
762025-01-27T09:29:23.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792025-01-27T09:29:23.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-27T09:29:23.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-01-27T09:29:23.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-01-27T09:29:23.336ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-01-27T09:29:23.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-27T09:29:23.336ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882025-01-27T09:29:23.336ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892025-01-27T09:29:23.336ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902025-01-27T09:29:23.336ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912025-01-27T09:29:23.336ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-27T09:29:23.336ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-01-27T09:29:23.337ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942025-01-27T09:29:23.337ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952025-01-27T09:29:23.337ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-01-27T09:29:23.337ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972025-01-27T09:29:23.337ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-27T09:29:23.337ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-27T09:29:23.337ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-01-27T09:29:23.337ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-01-27T09:29:23.337ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-01-27T09:29:23.337ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-27T09:29:23.337ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-27T09:29:23.337ZINFOSledAgent (bootstore): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-27T09:29:23.337ZINFOSledAgent (bootstore): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-27T09:29:23.337ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-27T09:29:23.337ZINFOSledAgent (bootstore): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-27T09:29:23.337ZINFOSledAgent (bootstore): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-27T09:29:23.337ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-27T09:29:23.337ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-27T09:29:23.337ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-27T09:29:23.348ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-27T09:29:23.348ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 111378, tv_nsec: 332968778 } time_to_next_cleanup = 599.999910358s
1142025-01-27T09:29:23.348ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-27T09:29:23.351ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-27T09:29:23.351ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-27T09:29:23.351ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-27T09:29:23.351ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-27T09:29:23.353ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-27T09:29:23.353ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-27T09:29:23.353ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-27T09:29:23.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-27T09:29:23.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-27T09:29:23.353ZINFOSledAgent (RSS): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-27T09:29:23.353ZINFOSledAgent (RSS): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-27T09:29:23.353ZINFOSledAgent (RSS): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-27T09:29:23.353ZINFOSledAgent (RSS): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-27T09:29:23.353ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-27T09:29:23.353ZINFOSledAgent (RSS): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-27T09:29:23.354ZINFOSledAgent (RSS): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-27T09:29:23.354ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-27T09:29:23.354ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-27T09:29:23.354ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-27T09:29:23.354ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-27T09:29:23.354ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-27T09:29:23.354ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-27T09:29:23.354ZINFOSledAgent (bootstore): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-27T09:29:23.354ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-27T09:29:23.354ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: d4e670d1-037a-4b75-80e2-234f2762bd9e (sled), rack_id: 8bd5c2bd-3419-4a68-ac55-258db5ea6152, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-27T09:29:23.355ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-27T09:29:23.355ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-27T09:29:23.359ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-27T09:29:23.365ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-27T09:29:23.365ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-27T09:29:23.369ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-27T09:29:23.369ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-27T09:29:23.369ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:37935
1482025-01-27T09:29:23.369ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: d4e670d1-037a-4b75-80e2-234f2762bd9e (sled), rack_id: 8bd5c2bd-3419-4a68-ac55-258db5ea6152, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-27T09:29:23.369ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-27T09:29:23.369ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-27T09:29:23.369ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-27T09:29:23.369ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-27T09:29:23.369ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-27T09:29:23.369ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-27T09:29:23.369ZINFOSledAgent (StorageManager): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-27T09:29:23.370ZINFOSledAgent (StorageManager): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-27T09:29:23.370ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-27T09:29:23.370ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-27T09:29:23.370ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-27T09:29:23.370ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-27T09:29:23.370ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-27T09:29:23.385ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-27T09:29:23.405ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-27T09:29:23.422ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-27T09:29:23.457ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
1662025-01-27T09:29:23.457ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-27T09:29:23.457ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
1682025-01-27T09:29:23.457ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-27T09:29:23.460ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 107.236325ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "425f324d-dd03-4878-90e5-2ae8ddca988c", "content-length": "124", "date": "Mon, 27 Jan 2025 09:29:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "425f324d-dd03-4878-90e5-2ae8ddca988c" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-27T09:29:23.470ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_9bf2ba33-d3cb-4144-b51f-90c70d8d5724/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-27T09:29:23.495ZINFOSledAgent: successfully created encrypted zvol: name="oxi_9bf2ba33-d3cb-4144-b51f-90c70d8d5724/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-27T09:29:23.495ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_9bf2ba33-d3cb-4144-b51f-90c70d8d5724/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-27T09:29:23.500ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
1742025-01-27T09:29:23.500ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-27T09:29:23.500ZINFOSledAgent (BackingFs): Ensuring dataset oxi_9bf2ba33-d3cb-4144-b51f-90c70d8d5724/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-27T09:29:23.568ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-27T09:29:23.569ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 111.154974ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7d204354-b424-41df-b55b-549e0b31a273", "content-length": "124", "date": "Mon, 27 Jan 2025 09:29:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7d204354-b424-41df-b55b-549e0b31a273" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-27T09:29:23.569ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-27T09:29:23.681ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-27T09:29:23.681ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 138.374124ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2f575bc5-a81c-41ef-8821-4f36c3dd1e10", "content-length": "124", "date": "Mon, 27 Jan 2025 09:29:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2f575bc5-a81c-41ef-8821-4f36c3dd1e10" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-27T09:29:23.788ZINFOSledAgent (BackingFs): Mounting oxi_9bf2ba33-d3cb-4144-b51f-90c70d8d5724/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-27T09:29:23.801ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-27T09:29:23.801ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-27T09:29:23.801ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-27T09:29:23.801ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-27T09:29:23.821ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-27T09:29:23.822ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 111.966494ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "03f129ad-7ce4-43f8-b90d-bf769c8fbc95", "content-length": "124", "date": "Mon, 27 Jan 2025 09:29:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "03f129ad-7ce4-43f8-b90d-bf769c8fbc95" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-27T09:29:23.935ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-27T09:29:23.935ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 143.056887ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8b328cd9-3132-47e0-b161-e6883cc8a748", "content-length": "124", "date": "Mon, 27 Jan 2025 09:29:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8b328cd9-3132-47e0-b161-e6883cc8a748" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-27T09:29:24.080ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-27T09:29:24.080ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 132.73359ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "df3ccba1-1ad2-4abf-9066-118cfc1adf9d", "content-length": "124", "date": "Mon, 27 Jan 2025 09:29:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "df3ccba1-1ad2-4abf-9066-118cfc1adf9d" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-27T09:29:24.214ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-27T09:29:24.214ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 372.757192ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "46f39417-5b51-4f75-9d04-71e6663ea66a", "content-length": "124", "date": "Mon, 27 Jan 2025 09:29:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "46f39417-5b51-4f75-9d04-71e6663ea66a" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-27T09:29:24.555ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
1952025-01-27T09:29:24.561ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:34990 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
1962025-01-27T09:29:24.561ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
1972025-01-27T09:29:24.561ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:34990 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = d4e670d1-037a-4b75-80e2-234f2762bd9e sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
1982025-01-27T09:29:24.562ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 339.078684ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
1992025-01-27T09:29:24.564ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2002025-01-27T09:29:24.564ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2012025-01-27T09:29:24.564ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2022025-01-27T09:29:24.564ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-27T09:29:24.588ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042025-01-27T09:29:24.904ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 438.478972ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2052025-01-27T09:29:25.344ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 830.830128ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2062025-01-27T09:29:26.177ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.582895355s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2072025-01-27T09:29:27.078ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2082025-01-27T09:29:27.078ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2092025-01-27T09:29:27.078ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2102025-01-27T09:29:27.078ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2112025-01-27T09:29:27.078ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2122025-01-27T09:29:27.078ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2132025-01-27T09:29:27.080ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2142025-01-27T09:29:27.082ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2152025-01-27T09:29:27.082ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='956859b9-fe14-4f4e-86ca-3ffacb6d4f41'/> <propval type="astring" name="rack_id" value='8bd5c2bd-3419-4a68-ac55-258db5ea6152'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feae:8d1c'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='8bd5c2bd-3419-4a68-ac55-258db5ea6152'/> <propval type="astring" name="sled_id" value='d4e670d1-037a-4b75-80e2-234f2762bd9e'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='d4e670d1-037a-4b75-80e2-234f2762bd9e'/> <propval type="astring" name="rack_uuid" value='8bd5c2bd-3419-4a68-ac55-258db5ea6152'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='d4e670d1-037a-4b75-80e2-234f2762bd9e'/> <propval type="astring" name="rack_uuid" value='8bd5c2bd-3419-4a68-ac55-258db5ea6152'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-27T09:29:27.082ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-27T09:29:27.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 32.677417ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-27T09:29:27.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 116.411248ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-27T09:29:27.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 216.734054ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-01-27T09:29:28.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 404.877275ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-27T09:29:28.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 772.620405ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-27T09:29:28.761ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.038984669s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2232025-01-27T09:29:29.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 673.127323ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-01-27T09:29:30.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.236614095s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-01-27T09:29:31.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 578.077785ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-01-27T09:29:31.801ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.413847539s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2272025-01-27T09:29:32.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.212075165s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2282025-01-27T09:29:34.142ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/d4e670d1-037a-4b75-80e2-234f2762bd9e) file = sled-agent/src/nexus.rs:527 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2292025-01-27T09:29:34.173ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302025-01-27T09:29:34.173ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2312025-01-27T09:29:34.175ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2322025-01-27T09:29:34.175ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2332025-01-27T09:29:34.175ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2342025-01-27T09:29:34.175ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-01-27T09:29:34.175ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362025-01-27T09:29:34.175ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372025-01-27T09:29:34.175ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2382025-01-27T09:29:34.175ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2392025-01-27T09:29:34.175ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:37935
2402025-01-27T09:29:34.380ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2412025-01-27T09:29:34.380ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2422025-01-27T09:29:34.386ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2432025-01-27T09:29:34.386ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2442025-01-27T09:29:34.386ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2452025-01-27T09:29:34.627ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6941409038787322019 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2462025-01-27T09:29:34.628ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9245498637835454136 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2472025-01-27T09:29:34.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58846
2482025-01-27T09:29:34.665ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2492025-01-27T09:29:34.665ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2502025-01-27T09:29:34.665ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:188
2512025-01-27T09:29:34.665ZINFOSledAgent (ServiceManager): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:188
2522025-01-27T09:29:34.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58846 req_id = 11aebb0f-f41c-434f-b2b8-a71b6bad8b4c response_code = 200 uri = /inventory
2532025-01-27T09:29:34.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56113
2542025-01-27T09:29:34.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56113 req_id = 0f17e978-ed3d-4d0e-b97d-fadcf4942ce5 response_code = 200 uri = /sled-role
2552025-01-27T09:29:34.728ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0f229405-26bd-47ce-acf9-8898431ccbf5 (physical_disk), pool_id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 35a5b742-c580-4ab6-bcd6-f6ecf8c76991 (physical_disk), pool_id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 47993138-c62c-4265-9f22-6f9bd772e858 (physical_disk), pool_id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 4e72e465-843f-4fdd-a2c2-363120a6e96c (physical_disk), pool_id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 747f9976-8a87-4171-997c-aef7ba6a0c29 (physical_disk), pool_id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 78edae5b-7144-43a2-9773-b2e0f9151be0 (physical_disk), pool_id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bea3ae1a-1fe6-48af-8c09-00ef829c5cfc (physical_disk), pool_id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c4d008cb-eded-47c8-93b6-91628c0508c1 (physical_disk), pool_id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f1467d13-77db-46d6-9c37-ce72b7c95864 (physical_disk), pool_id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2562025-01-27T09:29:34.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53798
2572025-01-27T09:29:34.728ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2582025-01-27T09:29:34.728ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0f229405-26bd-47ce-acf9-8898431ccbf5 (physical_disk), pool_id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 35a5b742-c580-4ab6-bcd6-f6ecf8c76991 (physical_disk), pool_id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 47993138-c62c-4265-9f22-6f9bd772e858 (physical_disk), pool_id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 4e72e465-843f-4fdd-a2c2-363120a6e96c (physical_disk), pool_id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 747f9976-8a87-4171-997c-aef7ba6a0c29 (physical_disk), pool_id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 78edae5b-7144-43a2-9773-b2e0f9151be0 (physical_disk), pool_id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bea3ae1a-1fe6-48af-8c09-00ef829c5cfc (physical_disk), pool_id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c4d008cb-eded-47c8-93b6-91628c0508c1 (physical_disk), pool_id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f1467d13-77db-46d6-9c37-ce72b7c95864 (physical_disk), pool_id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2592025-01-27T09:29:34.728ZINFOSledAgent (StorageManager): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602025-01-27T09:29:34.728ZINFOSledAgent (StorageManager): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2612025-01-27T09:29:34.728ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2622025-01-27T09:29:34.728ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2632025-01-27T09:29:34.728ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2642025-01-27T09:29:34.728ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2652025-01-27T09:29:34.728ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2662025-01-27T09:29:35.101ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2672025-01-27T09:29:35.103ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2682025-01-27T09:29:35.103ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool)
2692025-01-27T09:29:35.175ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d4e670d1-037a-4b75-80e2-234f2762bd9e) file = sled-agent/src/probe_manager.rs:231 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
2702025-01-27T09:29:35.205ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }
2712025-01-27T09:29:35.213ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2722025-01-27T09:29:35.213ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2732025-01-27T09:29:35.213ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2742025-01-27T09:29:35.213ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2752025-01-27T09:29:35.213ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762025-01-27T09:29:35.213ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772025-01-27T09:29:35.213ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2782025-01-27T09:29:35.248ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2792025-01-27T09:29:35.256ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/zone file = sled-storage/src/dataset.rs:302
2802025-01-27T09:29:35.392ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0 file = sled-storage/src/dataset.rs:388
2812025-01-27T09:29:35.400ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2822025-01-27T09:29:35.400ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2832025-01-27T09:29:35.400ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2842025-01-27T09:29:35.400ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2852025-01-27T09:29:35.400ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2862025-01-27T09:29:35.410ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2872025-01-27T09:29:35.410ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool)
2882025-01-27T09:29:35.503ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }
2892025-01-27T09:29:35.511ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2902025-01-27T09:29:35.511ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2912025-01-27T09:29:35.511ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2922025-01-27T09:29:35.511ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2932025-01-27T09:29:35.511ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942025-01-27T09:29:35.511ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952025-01-27T09:29:35.511ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2962025-01-27T09:29:35.547ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2972025-01-27T09:29:35.554ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1990e07a-cfb7-436f-b017-73d119d10c34/crypt/zone file = sled-storage/src/dataset.rs:302
2982025-01-27T09:29:35.691ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1990e07a-cfb7-436f-b017-73d119d10c34 file = sled-storage/src/dataset.rs:388
2992025-01-27T09:29:35.699ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3002025-01-27T09:29:35.699ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3012025-01-27T09:29:35.699ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3022025-01-27T09:29:35.699ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3032025-01-27T09:29:35.699ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3042025-01-27T09:29:35.709ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3052025-01-27T09:29:35.709ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 423760c6-8db9-4b47-b42b-49adac69df39 (zpool)
3062025-01-27T09:29:35.801ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }
3072025-01-27T09:29:35.809ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3082025-01-27T09:29:35.809ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3092025-01-27T09:29:35.809ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3102025-01-27T09:29:35.809ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3112025-01-27T09:29:35.809ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122025-01-27T09:29:35.809ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132025-01-27T09:29:35.809ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3142025-01-27T09:29:35.843ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152025-01-27T09:29:35.851ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_423760c6-8db9-4b47-b42b-49adac69df39/crypt/zone file = sled-storage/src/dataset.rs:302
3162025-01-27T09:29:35.988ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_423760c6-8db9-4b47-b42b-49adac69df39 file = sled-storage/src/dataset.rs:388
3172025-01-27T09:29:35.996ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3182025-01-27T09:29:35.996ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3192025-01-27T09:29:35.996ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3202025-01-27T09:29:35.996ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212025-01-27T09:29:35.996ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222025-01-27T09:29:36.006ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3232025-01-27T09:29:36.006ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool)
3242025-01-27T09:29:36.097ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }
3252025-01-27T09:29:36.104ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3262025-01-27T09:29:36.104ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3272025-01-27T09:29:36.104ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3282025-01-27T09:29:36.104ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3292025-01-27T09:29:36.104ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302025-01-27T09:29:36.105ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312025-01-27T09:29:36.105ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3322025-01-27T09:29:36.140ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332025-01-27T09:29:36.148ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone file = sled-storage/src/dataset.rs:302
3342025-01-27T09:29:36.177ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d4e670d1-037a-4b75-80e2-234f2762bd9e) file = sled-agent/src/probe_manager.rs:231 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
3352025-01-27T09:29:36.281ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe file = sled-storage/src/dataset.rs:388
3362025-01-27T09:29:36.289ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3372025-01-27T09:29:36.289ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3382025-01-27T09:29:36.289ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3392025-01-27T09:29:36.289ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402025-01-27T09:29:36.289ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412025-01-27T09:29:36.299ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3422025-01-27T09:29:36.299ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool)
3432025-01-27T09:29:36.395ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }
3442025-01-27T09:29:36.403ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3452025-01-27T09:29:36.403ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3462025-01-27T09:29:36.403ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3472025-01-27T09:29:36.403ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3482025-01-27T09:29:36.403ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492025-01-27T09:29:36.403ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502025-01-27T09:29:36.403ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3512025-01-27T09:29:36.439ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522025-01-27T09:29:36.447ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone file = sled-storage/src/dataset.rs:302
3532025-01-27T09:29:36.585ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_57255367-8a48-44c0-b878-15bd0dd194f1 file = sled-storage/src/dataset.rs:388
3542025-01-27T09:29:36.593ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3552025-01-27T09:29:36.593ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3562025-01-27T09:29:36.593ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3572025-01-27T09:29:36.593ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582025-01-27T09:29:36.593ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592025-01-27T09:29:36.603ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3602025-01-27T09:29:36.603ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool)
3612025-01-27T09:29:36.696ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }
3622025-01-27T09:29:36.704ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3632025-01-27T09:29:36.704ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3642025-01-27T09:29:36.704ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3652025-01-27T09:29:36.704ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3662025-01-27T09:29:36.704ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672025-01-27T09:29:36.705ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682025-01-27T09:29:36.705ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3692025-01-27T09:29:36.740ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702025-01-27T09:29:36.748ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3879af65-27ae-439f-861c-67ca34b4edf2/crypt/zone file = sled-storage/src/dataset.rs:302
3712025-01-27T09:29:36.889ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3879af65-27ae-439f-861c-67ca34b4edf2 file = sled-storage/src/dataset.rs:388
3722025-01-27T09:29:36.898ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3732025-01-27T09:29:36.898ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3742025-01-27T09:29:36.898ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3752025-01-27T09:29:36.898ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3762025-01-27T09:29:36.898ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3772025-01-27T09:29:36.907ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3782025-01-27T09:29:36.907ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool)
3792025-01-27T09:29:37.006ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }
3802025-01-27T09:29:37.014ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3812025-01-27T09:29:37.014ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3822025-01-27T09:29:37.014ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3832025-01-27T09:29:37.014ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3842025-01-27T09:29:37.014ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852025-01-27T09:29:37.015ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862025-01-27T09:29:37.015ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3872025-01-27T09:29:37.052ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882025-01-27T09:29:37.060ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/zone file = sled-storage/src/dataset.rs:302
3892025-01-27T09:29:37.179ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d4e670d1-037a-4b75-80e2-234f2762bd9e) file = sled-agent/src/probe_manager.rs:231 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
3902025-01-27T09:29:37.198ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55 file = sled-storage/src/dataset.rs:388
3912025-01-27T09:29:37.206ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922025-01-27T09:29:37.206ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932025-01-27T09:29:37.206ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942025-01-27T09:29:37.206ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952025-01-27T09:29:37.206ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962025-01-27T09:29:37.215ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3972025-01-27T09:29:37.215ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool)
3982025-01-27T09:29:37.309ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }
3992025-01-27T09:29:37.317ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4002025-01-27T09:29:37.317ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4012025-01-27T09:29:37.317ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4022025-01-27T09:29:37.317ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4032025-01-27T09:29:37.317ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042025-01-27T09:29:37.317ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052025-01-27T09:29:37.317ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4062025-01-27T09:29:37.321ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.970564105s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4072025-01-27T09:29:37.353ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4082025-01-27T09:29:37.362ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/zone file = sled-storage/src/dataset.rs:302
4092025-01-27T09:29:37.514ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a file = sled-storage/src/dataset.rs:388
4102025-01-27T09:29:37.522ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4112025-01-27T09:29:37.522ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4122025-01-27T09:29:37.522ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4132025-01-27T09:29:37.522ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4142025-01-27T09:29:37.522ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4152025-01-27T09:29:37.531ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4162025-01-27T09:29:37.531ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool)
4172025-01-27T09:29:37.628ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }
4182025-01-27T09:29:37.635ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4192025-01-27T09:29:37.635ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4202025-01-27T09:29:37.635ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4212025-01-27T09:29:37.635ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4222025-01-27T09:29:37.635ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232025-01-27T09:29:37.636ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242025-01-27T09:29:37.636ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4252025-01-27T09:29:37.674ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4262025-01-27T09:29:37.683ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone file = sled-storage/src/dataset.rs:302
4272025-01-27T09:29:37.822ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 file = sled-storage/src/dataset.rs:388
4282025-01-27T09:29:37.830ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4292025-01-27T09:29:37.830ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4302025-01-27T09:29:37.830ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-01-27T09:29:37.830ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bf2ba33-d3cb-4144-b51f-90c70d8d5724 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4322025-01-27T09:29:37.830ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4332025-01-27T09:29:37.830ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4342025-01-27T09:29:37.830ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352025-01-27T09:29:37.830ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4362025-01-27T09:29:37.830ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4372025-01-27T09:29:37.830ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4382025-01-27T09:29:37.830ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4392025-01-27T09:29:37.830ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4402025-01-27T09:29:37.831ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4412025-01-27T09:29:37.831ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4422025-01-27T09:29:37.831ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4432025-01-27T09:29:37.831ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4442025-01-27T09:29:37.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3102857 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53798 req_id = b99d94bc-3e03-40c4-af18-f8e42a498ea4 response_code = 200 uri = /omicron-physical-disks
4452025-01-27T09:29:37.862ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {01547bf9-b512-499a-86e8-6ef3705a8296 (dataset): DatasetConfig { id: 01547bf9-b512-499a-86e8-6ef3705a8296 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02ec5e92-b89c-4396-8abc-c74395513241 (dataset): DatasetConfig { id: 02ec5e92-b89c-4396-8abc-c74395513241 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 048c1060-17f6-415f-b66e-a2112c844832 (dataset): DatasetConfig { id: 048c1060-17f6-415f-b66e-a2112c844832 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05f24c40-914b-41c0-8c74-db17fa9c2c8d (dataset): DatasetConfig { id: 05f24c40-914b-41c0-8c74-db17fa9c2c8d (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06f809f4-d7b6-44da-bf8e-8a34a96a7f9a (dataset): DatasetConfig { id: 06f809f4-d7b6-44da-bf8e-8a34a96a7f9a (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0819a218-8b2e-431b-8796-f79b3a30f70a (dataset): DatasetConfig { id: 0819a218-8b2e-431b-8796-f79b3a30f70a (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c969a2f-41a0-4d19-a601-0f2a4e324973 (dataset): DatasetConfig { id: 1c969a2f-41a0-4d19-a601-0f2a4e324973 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 21c11888-4e01-40d5-9ffe-520a6633e1bb (dataset): DatasetConfig { id: 21c11888-4e01-40d5-9ffe-520a6633e1bb (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 28ae8715-c6b7-4473-8345-0b3bffb88537 (dataset): DatasetConfig { id: 28ae8715-c6b7-4473-8345-0b3bffb88537 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f9d1353-1bfb-492c-920b-2c69ec72e01c (dataset): DatasetConfig { id: 2f9d1353-1bfb-492c-920b-2c69ec72e01c (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 335ff1ee-98f7-4a16-90bd-fbf51ad4fc63 (dataset): DatasetConfig { id: 335ff1ee-98f7-4a16-90bd-fbf51ad4fc63 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33df0ee6-e58c-4c98-8765-edbf6937961f (dataset): DatasetConfig { id: 33df0ee6-e58c-4c98-8765-edbf6937961f (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3645c2ad-4bd7-44b5-aa62-223e8419049b (dataset): DatasetConfig { id: 3645c2ad-4bd7-44b5-aa62-223e8419049b (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d658f00-8667-4bc8-989a-7d49cfe1aa7b (dataset): DatasetConfig { id: 3d658f00-8667-4bc8-989a-7d49cfe1aa7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40be3fb6-f0d7-4b35-9fce-27c919c7a979 (dataset): DatasetConfig { id: 40be3fb6-f0d7-4b35-9fce-27c919c7a979 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41bb944d-6751-441f-87d6-af4385f4014d (dataset): DatasetConfig { id: 41bb944d-6751-441f-87d6-af4385f4014d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 470edc1b-d148-43ca-81e0-a82b9c96ea14 (dataset): DatasetConfig { id: 470edc1b-d148-43ca-81e0-a82b9c96ea14 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48c97327-5b8c-42c5-9b23-d880e0481e4b (dataset): DatasetConfig { id: 48c97327-5b8c-42c5-9b23-d880e0481e4b (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50b2eaac-fea2-44a0-b51f-ba296aa3fb09 (dataset): DatasetConfig { id: 50b2eaac-fea2-44a0-b51f-ba296aa3fb09 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5178b907-9334-466f-ae22-8eff86dffbbe (dataset): DatasetConfig { id: 5178b907-9334-466f-ae22-8eff86dffbbe (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5812da13-9c89-4921-a211-0bc2f9057316 (dataset): DatasetConfig { id: 5812da13-9c89-4921-a211-0bc2f9057316 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5df1dd53-fe8c-45ed-b859-d8a9e5eb14c8 (dataset): DatasetConfig { id: 5df1dd53-fe8c-45ed-b859-d8a9e5eb14c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e40e16d-59f4-443f-bb21-ea00662a86cc (dataset): DatasetConfig { id: 5e40e16d-59f4-443f-bb21-ea00662a86cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6743d09e-df7d-41a2-99c9-4a323f4354cb (dataset): DatasetConfig { id: 6743d09e-df7d-41a2-99c9-4a323f4354cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cd1be68-3d82-47db-8653-1ac9fc71f87c (dataset): DatasetConfig { id: 6cd1be68-3d82-47db-8653-1ac9fc71f87c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 715543d4-ec53-40f3-ac53-9a7f390e3deb (dataset): DatasetConfig { id: 715543d4-ec53-40f3-ac53-9a7f390e3deb (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7614f64f-d7c5-4cfc-9530-4d381d1cbcf2 (dataset): DatasetConfig { id: 7614f64f-d7c5-4cfc-9530-4d381d1cbcf2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77004e7e-4622-4784-a104-af56115acbf5 (dataset): DatasetConfig { id: 77004e7e-4622-4784-a104-af56115acbf5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77912733-cc75-4bd3-9223-f448d4196fdb (dataset): DatasetConfig { id: 77912733-cc75-4bd3-9223-f448d4196fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c134bd0-241c-4a99-bfca-85568b715aec (dataset): DatasetConfig { id: 7c134bd0-241c-4a99-bfca-85568b715aec (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f75f6e8-09e1-42e6-b267-c103435b9d6a (dataset): DatasetConfig { id: 7f75f6e8-09e1-42e6-b267-c103435b9d6a (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 80d32b2b-354f-440f-9ac5-875bb19bdad8 (dataset): DatasetConfig { id: 80d32b2b-354f-440f-9ac5-875bb19bdad8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a37632e-0c7a-4d01-8e22-dc941bb70687 (dataset): DatasetConfig { id: 8a37632e-0c7a-4d01-8e22-dc941bb70687 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e20fd9c-db52-4ac3-afcb-03dbd4e518b2 (dataset): DatasetConfig { id: 8e20fd9c-db52-4ac3-afcb-03dbd4e518b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9219c370-89fe-4e9e-ad3b-36cc1cd5cf23 (dataset): DatasetConfig { id: 9219c370-89fe-4e9e-ad3b-36cc1cd5cf23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98d9d0f7-1f22-4c5e-a167-e8786a6e9017 (dataset): DatasetConfig { id: 98d9d0f7-1f22-4c5e-a167-e8786a6e9017 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b0e4cd6-c1c2-450e-bfd4-5352ee1336b2 (dataset): DatasetConfig { id: 9b0e4cd6-c1c2-450e-bfd4-5352ee1336b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a054d66f-a6ea-413c-a275-5bb62a372614 (dataset): DatasetConfig { id: a054d66f-a6ea-413c-a275-5bb62a372614 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2eb8267-1130-4263-a066-1ed34c82a799 (dataset): DatasetConfig { id: a2eb8267-1130-4263-a066-1ed34c82a799 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3062dbd-4927-442e-9b85-9ddae5fb77cd (dataset): DatasetConfig { id: a3062dbd-4927-442e-9b85-9ddae5fb77cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab4859ae-ead2-45f3-b0e9-e89548ecbb0f (dataset): DatasetConfig { id: ab4859ae-ead2-45f3-b0e9-e89548ecbb0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2d801ec-f7e6-444c-b53b-a4e6b70ce187 (dataset): DatasetConfig { id: b2d801ec-f7e6-444c-b53b-a4e6b70ce187 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b50c4033-605a-45f7-aa3b-45ba4800ee57 (dataset): DatasetConfig { id: b50c4033-605a-45f7-aa3b-45ba4800ee57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b585803f-48b7-4c61-8f2e-1fc466462f94 (dataset): DatasetConfig { id: b585803f-48b7-4c61-8f2e-1fc466462f94 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b897c6e5-3669-4652-8b6c-676277000fb1 (dataset): DatasetConfig { id: b897c6e5-3669-4652-8b6c-676277000fb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c11b07b8-46bc-45ed-a04e-33569f4996dd (dataset): DatasetConfig { id: c11b07b8-46bc-45ed-a04e-33569f4996dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c176d76e-bed7-4c7c-9450-f1438d67387c (dataset): DatasetConfig { id: c176d76e-bed7-4c7c-9450-f1438d67387c (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c269c67a-5d26-414e-9980-611c4e3223b1 (dataset): DatasetConfig { id: c269c67a-5d26-414e-9980-611c4e3223b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cce2d91e-21c1-44d7-8594-e22ac1577307 (dataset): DatasetConfig { id: cce2d91e-21c1-44d7-8594-e22ac1577307 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cefa813c-4d41-4469-8d77-c9975fd88f0d (dataset): DatasetConfig { id: cefa813c-4d41-4469-8d77-c9975fd88f0d (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cf38e54f-956c-4890-b47b-eafc420a34d6 (dataset): DatasetConfig { id: cf38e54f-956c-4890-b47b-eafc420a34d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d554eff1-f5be-4304-a24e-c4a6464a7b9e (dataset): DatasetConfig { id: d554eff1-f5be-4304-a24e-c4a6464a7b9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d595549c-99af-4b7d-9ba7-a2333655c8e4 (dataset): DatasetConfig { id: d595549c-99af-4b7d-9ba7-a2333655c8e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7f85e9f-9b01-4115-b9d7-01a08c8b8061 (dataset): DatasetConfig { id: d7f85e9f-9b01-4115-b9d7-01a08c8b8061 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9d09ca8-36d3-49f4-ba12-0a56b230f2cc (dataset): DatasetConfig { id: d9d09ca8-36d3-49f4-ba12-0a56b230f2cc (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db38a341-e3d3-4236-a5da-d836eef8c767 (dataset): DatasetConfig { id: db38a341-e3d3-4236-a5da-d836eef8c767 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbfb8473-04c6-44d2-a60c-9eb8f07205e7 (dataset): DatasetConfig { id: dbfb8473-04c6-44d2-a60c-9eb8f07205e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dcb353a4-4235-4bbd-b1c2-5bcea45a98d2 (dataset): DatasetConfig { id: dcb353a4-4235-4bbd-b1c2-5bcea45a98d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de89fe3f-43fc-4ac2-9dfc-1cd487924f02 (dataset): DatasetConfig { id: de89fe3f-43fc-4ac2-9dfc-1cd487924f02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3a18f85-d7e1-437f-8d9e-dfa477715721 (dataset): DatasetConfig { id: e3a18f85-d7e1-437f-8d9e-dfa477715721 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e7779fe1-d5c3-4543-8843-6f83fbf70a97 (dataset): DatasetConfig { id: e7779fe1-d5c3-4543-8843-6f83fbf70a97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb5d6158-14cd-44fe-99a6-08adb7d69ee2 (dataset): DatasetConfig { id: eb5d6158-14cd-44fe-99a6-08adb7d69ee2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f46f96b6-55c2-4bc5-aa7e-96c40984bc04 (dataset): DatasetConfig { id: f46f96b6-55c2-4bc5-aa7e-96c40984bc04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8e23c37-ad31-48a5-9558-cb4eaca17884 (dataset): DatasetConfig { id: f8e23c37-ad31-48a5-9558-cb4eaca17884 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f93e6506-eb12-45f1-bddc-b6192c12151c (dataset): DatasetConfig { id: f93e6506-eb12-45f1-bddc-b6192c12151c (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb84254d-4971-4b5f-b740-116c1e12466a (dataset): DatasetConfig { id: fb84254d-4971-4b5f-b740-116c1e12466a (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4462025-01-27T09:29:37.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37009
4472025-01-27T09:29:37.863ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4482025-01-27T09:29:37.863ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {01547bf9-b512-499a-86e8-6ef3705a8296 (dataset): DatasetConfig { id: 01547bf9-b512-499a-86e8-6ef3705a8296 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02ec5e92-b89c-4396-8abc-c74395513241 (dataset): DatasetConfig { id: 02ec5e92-b89c-4396-8abc-c74395513241 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 048c1060-17f6-415f-b66e-a2112c844832 (dataset): DatasetConfig { id: 048c1060-17f6-415f-b66e-a2112c844832 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05f24c40-914b-41c0-8c74-db17fa9c2c8d (dataset): DatasetConfig { id: 05f24c40-914b-41c0-8c74-db17fa9c2c8d (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06f809f4-d7b6-44da-bf8e-8a34a96a7f9a (dataset): DatasetConfig { id: 06f809f4-d7b6-44da-bf8e-8a34a96a7f9a (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0819a218-8b2e-431b-8796-f79b3a30f70a (dataset): DatasetConfig { id: 0819a218-8b2e-431b-8796-f79b3a30f70a (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c969a2f-41a0-4d19-a601-0f2a4e324973 (dataset): DatasetConfig { id: 1c969a2f-41a0-4d19-a601-0f2a4e324973 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 21c11888-4e01-40d5-9ffe-520a6633e1bb (dataset): DatasetConfig { id: 21c11888-4e01-40d5-9ffe-520a6633e1bb (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 28ae8715-c6b7-4473-8345-0b3bffb88537 (dataset): DatasetConfig { id: 28ae8715-c6b7-4473-8345-0b3bffb88537 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f9d1353-1bfb-492c-920b-2c69ec72e01c (dataset): DatasetConfig { id: 2f9d1353-1bfb-492c-920b-2c69ec72e01c (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 335ff1ee-98f7-4a16-90bd-fbf51ad4fc63 (dataset): DatasetConfig { id: 335ff1ee-98f7-4a16-90bd-fbf51ad4fc63 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33df0ee6-e58c-4c98-8765-edbf6937961f (dataset): DatasetConfig { id: 33df0ee6-e58c-4c98-8765-edbf6937961f (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3645c2ad-4bd7-44b5-aa62-223e8419049b (dataset): DatasetConfig { id: 3645c2ad-4bd7-44b5-aa62-223e8419049b (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d658f00-8667-4bc8-989a-7d49cfe1aa7b (dataset): DatasetConfig { id: 3d658f00-8667-4bc8-989a-7d49cfe1aa7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40be3fb6-f0d7-4b35-9fce-27c919c7a979 (dataset): DatasetConfig { id: 40be3fb6-f0d7-4b35-9fce-27c919c7a979 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41bb944d-6751-441f-87d6-af4385f4014d (dataset): DatasetConfig { id: 41bb944d-6751-441f-87d6-af4385f4014d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 470edc1b-d148-43ca-81e0-a82b9c96ea14 (dataset): DatasetConfig { id: 470edc1b-d148-43ca-81e0-a82b9c96ea14 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48c97327-5b8c-42c5-9b23-d880e0481e4b (dataset): DatasetConfig { id: 48c97327-5b8c-42c5-9b23-d880e0481e4b (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50b2eaac-fea2-44a0-b51f-ba296aa3fb09 (dataset): DatasetConfig { id: 50b2eaac-fea2-44a0-b51f-ba296aa3fb09 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5178b907-9334-466f-ae22-8eff86dffbbe (dataset): DatasetConfig { id: 5178b907-9334-466f-ae22-8eff86dffbbe (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5812da13-9c89-4921-a211-0bc2f9057316 (dataset): DatasetConfig { id: 5812da13-9c89-4921-a211-0bc2f9057316 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5df1dd53-fe8c-45ed-b859-d8a9e5eb14c8 (dataset): DatasetConfig { id: 5df1dd53-fe8c-45ed-b859-d8a9e5eb14c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e40e16d-59f4-443f-bb21-ea00662a86cc (dataset): DatasetConfig { id: 5e40e16d-59f4-443f-bb21-ea00662a86cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6743d09e-df7d-41a2-99c9-4a323f4354cb (dataset): DatasetConfig { id: 6743d09e-df7d-41a2-99c9-4a323f4354cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cd1be68-3d82-47db-8653-1ac9fc71f87c (dataset): DatasetConfig { id: 6cd1be68-3d82-47db-8653-1ac9fc71f87c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 715543d4-ec53-40f3-ac53-9a7f390e3deb (dataset): DatasetConfig { id: 715543d4-ec53-40f3-ac53-9a7f390e3deb (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7614f64f-d7c5-4cfc-9530-4d381d1cbcf2 (dataset): DatasetConfig { id: 7614f64f-d7c5-4cfc-9530-4d381d1cbcf2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77004e7e-4622-4784-a104-af56115acbf5 (dataset): DatasetConfig { id: 77004e7e-4622-4784-a104-af56115acbf5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77912733-cc75-4bd3-9223-f448d4196fdb (dataset): DatasetConfig { id: 77912733-cc75-4bd3-9223-f448d4196fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c134bd0-241c-4a99-bfca-85568b715aec (dataset): DatasetConfig { id: 7c134bd0-241c-4a99-bfca-85568b715aec (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f75f6e8-09e1-42e6-b267-c103435b9d6a (dataset): DatasetConfig { id: 7f75f6e8-09e1-42e6-b267-c103435b9d6a (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 80d32b2b-354f-440f-9ac5-875bb19bdad8 (dataset): DatasetConfig { id: 80d32b2b-354f-440f-9ac5-875bb19bdad8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a37632e-0c7a-4d01-8e22-dc941bb70687 (dataset): DatasetConfig { id: 8a37632e-0c7a-4d01-8e22-dc941bb70687 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e20fd9c-db52-4ac3-afcb-03dbd4e518b2 (dataset): DatasetConfig { id: 8e20fd9c-db52-4ac3-afcb-03dbd4e518b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9219c370-89fe-4e9e-ad3b-36cc1cd5cf23 (dataset): DatasetConfig { id: 9219c370-89fe-4e9e-ad3b-36cc1cd5cf23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98d9d0f7-1f22-4c5e-a167-e8786a6e9017 (dataset): DatasetConfig { id: 98d9d0f7-1f22-4c5e-a167-e8786a6e9017 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b0e4cd6-c1c2-450e-bfd4-5352ee1336b2 (dataset): DatasetConfig { id: 9b0e4cd6-c1c2-450e-bfd4-5352ee1336b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a054d66f-a6ea-413c-a275-5bb62a372614 (dataset): DatasetConfig { id: a054d66f-a6ea-413c-a275-5bb62a372614 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2eb8267-1130-4263-a066-1ed34c82a799 (dataset): DatasetConfig { id: a2eb8267-1130-4263-a066-1ed34c82a799 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3062dbd-4927-442e-9b85-9ddae5fb77cd (dataset): DatasetConfig { id: a3062dbd-4927-442e-9b85-9ddae5fb77cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab4859ae-ead2-45f3-b0e9-e89548ecbb0f (dataset): DatasetConfig { id: ab4859ae-ead2-45f3-b0e9-e89548ecbb0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2d801ec-f7e6-444c-b53b-a4e6b70ce187 (dataset): DatasetConfig { id: b2d801ec-f7e6-444c-b53b-a4e6b70ce187 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b50c4033-605a-45f7-aa3b-45ba4800ee57 (dataset): DatasetConfig { id: b50c4033-605a-45f7-aa3b-45ba4800ee57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b585803f-48b7-4c61-8f2e-1fc466462f94 (dataset): DatasetConfig { id: b585803f-48b7-4c61-8f2e-1fc466462f94 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b897c6e5-3669-4652-8b6c-676277000fb1 (dataset): DatasetConfig { id: b897c6e5-3669-4652-8b6c-676277000fb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c11b07b8-46bc-45ed-a04e-33569f4996dd (dataset): DatasetConfig { id: c11b07b8-46bc-45ed-a04e-33569f4996dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c176d76e-bed7-4c7c-9450-f1438d67387c (dataset): DatasetConfig { id: c176d76e-bed7-4c7c-9450-f1438d67387c (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c269c67a-5d26-414e-9980-611c4e3223b1 (dataset): DatasetConfig { id: c269c67a-5d26-414e-9980-611c4e3223b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cce2d91e-21c1-44d7-8594-e22ac1577307 (dataset): DatasetConfig { id: cce2d91e-21c1-44d7-8594-e22ac1577307 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cefa813c-4d41-4469-8d77-c9975fd88f0d (dataset): DatasetConfig { id: cefa813c-4d41-4469-8d77-c9975fd88f0d (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cf38e54f-956c-4890-b47b-eafc420a34d6 (dataset): DatasetConfig { id: cf38e54f-956c-4890-b47b-eafc420a34d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d554eff1-f5be-4304-a24e-c4a6464a7b9e (dataset): DatasetConfig { id: d554eff1-f5be-4304-a24e-c4a6464a7b9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d595549c-99af-4b7d-9ba7-a2333655c8e4 (dataset): DatasetConfig { id: d595549c-99af-4b7d-9ba7-a2333655c8e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7f85e9f-9b01-4115-b9d7-01a08c8b8061 (dataset): DatasetConfig { id: d7f85e9f-9b01-4115-b9d7-01a08c8b8061 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9d09ca8-36d3-49f4-ba12-0a56b230f2cc (dataset): DatasetConfig { id: d9d09ca8-36d3-49f4-ba12-0a56b230f2cc (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db38a341-e3d3-4236-a5da-d836eef8c767 (dataset): DatasetConfig { id: db38a341-e3d3-4236-a5da-d836eef8c767 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbfb8473-04c6-44d2-a60c-9eb8f07205e7 (dataset): DatasetConfig { id: dbfb8473-04c6-44d2-a60c-9eb8f07205e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dcb353a4-4235-4bbd-b1c2-5bcea45a98d2 (dataset): DatasetConfig { id: dcb353a4-4235-4bbd-b1c2-5bcea45a98d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de89fe3f-43fc-4ac2-9dfc-1cd487924f02 (dataset): DatasetConfig { id: de89fe3f-43fc-4ac2-9dfc-1cd487924f02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3a18f85-d7e1-437f-8d9e-dfa477715721 (dataset): DatasetConfig { id: e3a18f85-d7e1-437f-8d9e-dfa477715721 (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e7779fe1-d5c3-4543-8843-6f83fbf70a97 (dataset): DatasetConfig { id: e7779fe1-d5c3-4543-8843-6f83fbf70a97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb5d6158-14cd-44fe-99a6-08adb7d69ee2 (dataset): DatasetConfig { id: eb5d6158-14cd-44fe-99a6-08adb7d69ee2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f46f96b6-55c2-4bc5-aa7e-96c40984bc04 (dataset): DatasetConfig { id: f46f96b6-55c2-4bc5-aa7e-96c40984bc04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8e23c37-ad31-48a5-9558-cb4eaca17884 (dataset): DatasetConfig { id: f8e23c37-ad31-48a5-9558-cb4eaca17884 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f93e6506-eb12-45f1-bddc-b6192c12151c (dataset): DatasetConfig { id: f93e6506-eb12-45f1-bddc-b6192c12151c (dataset), name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb84254d-4971-4b5f-b740-116c1e12466a (dataset): DatasetConfig { id: fb84254d-4971-4b5f-b740-116c1e12466a (dataset), name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4492025-01-27T09:29:37.863ZINFOSledAgent (StorageManager): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4502025-01-27T09:29:37.863ZINFOSledAgent (StorageManager): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512025-01-27T09:29:37.863ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4522025-01-27T09:29:37.878ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532025-01-27T09:29:37.878ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542025-01-27T09:29:37.878ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_423760c6-8db9-4b47-b42b-49adac69df39/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4552025-01-27T09:29:37.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-01-27T09:29:37.926ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4572025-01-27T09:29:37.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone" } file = sled-storage/src/manager.rs:1431
4582025-01-27T09:29:37.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-01-27T09:29:37.955ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602025-01-27T09:29:37.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97" } file = sled-storage/src/manager.rs:1431
4612025-01-27T09:29:38.016ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-27T09:29:38.016ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-01-27T09:29:38.016ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4642025-01-27T09:29:38.067ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-01-27T09:29:38.067ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-01-27T09:29:38.067ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1990e07a-cfb7-436f-b017-73d119d10c34/crypt/zone/oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb"), full_name: "oxp_1990e07a-cfb7-436f-b017-73d119d10c34/crypt/zone/oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb" } file = sled-storage/src/manager.rs:1431
4672025-01-27T09:29:38.125ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-27T09:29:38.125ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-01-27T09:29:38.125ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone/oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone/oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f" } file = sled-storage/src/manager.rs:1431
4702025-01-27T09:29:38.182ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d4e670d1-037a-4b75-80e2-234f2762bd9e) file = sled-agent/src/probe_manager.rs:231 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
4712025-01-27T09:29:38.184ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722025-01-27T09:29:38.184ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4732025-01-27T09:29:38.184ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/debug"), full_name: "oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/debug" } file = sled-storage/src/manager.rs:1431
4742025-01-27T09:29:38.214ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752025-01-27T09:29:38.214ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762025-01-27T09:29:38.214ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crucible" } file = sled-storage/src/manager.rs:1431
4772025-01-27T09:29:38.260ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782025-01-27T09:29:38.260ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4792025-01-27T09:29:38.260ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/423760c6-8db9-4b47-b42b-49adac69df39/crypt/zone"), full_name: "oxp_423760c6-8db9-4b47-b42b-49adac69df39/crypt/zone" } file = sled-storage/src/manager.rs:1431
4802025-01-27T09:29:38.289ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812025-01-27T09:29:38.289ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822025-01-27T09:29:38.289ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crucible" } file = sled-storage/src/manager.rs:1431
4832025-01-27T09:29:38.336ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842025-01-27T09:29:38.336ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852025-01-27T09:29:38.336ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/423760c6-8db9-4b47-b42b-49adac69df39/crypt/zone/oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), full_name: "oxp_423760c6-8db9-4b47-b42b-49adac69df39/crypt/zone/oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180" } file = sled-storage/src/manager.rs:1431
4862025-01-27T09:29:38.396ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872025-01-27T09:29:38.396ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4882025-01-27T09:29:38.396ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4892025-01-27T09:29:38.444ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902025-01-27T09:29:38.444ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912025-01-27T09:29:38.444ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/423760c6-8db9-4b47-b42b-49adac69df39/crypt/zone/oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344"), full_name: "oxp_423760c6-8db9-4b47-b42b-49adac69df39/crypt/zone/oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344" } file = sled-storage/src/manager.rs:1431
4922025-01-27T09:29:38.502ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-01-27T09:29:38.502ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942025-01-27T09:29:38.502ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone/oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21"), full_name: "oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone/oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21" } file = sled-storage/src/manager.rs:1431
4952025-01-27T09:29:38.561ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-01-27T09:29:38.561ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972025-01-27T09:29:38.561ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1990e07a-cfb7-436f-b017-73d119d10c34/crucible" } file = sled-storage/src/manager.rs:1431
4982025-01-27T09:29:38.611ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-01-27T09:29:38.611ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002025-01-27T09:29:38.611ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crucible" } file = sled-storage/src/manager.rs:1431
5012025-01-27T09:29:38.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-01-27T09:29:38.658ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-01-27T09:29:38.658ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone/oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone/oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d" } file = sled-storage/src/manager.rs:1431
5042025-01-27T09:29:38.716ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-01-27T09:29:38.716ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062025-01-27T09:29:38.716ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f" } file = sled-storage/src/manager.rs:1431
5072025-01-27T09:29:38.775ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-01-27T09:29:38.775ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092025-01-27T09:29:38.775ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/zone/oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df"), full_name: "oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/zone/oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df" } file = sled-storage/src/manager.rs:1431
5102025-01-27T09:29:38.833ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-01-27T09:29:38.833ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122025-01-27T09:29:38.833ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone/oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6"), full_name: "oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone/oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6" } file = sled-storage/src/manager.rs:1431
5132025-01-27T09:29:38.894ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-01-27T09:29:38.894ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152025-01-27T09:29:38.894ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3879af65-27ae-439f-861c-67ca34b4edf2/crypt/zone/oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e"), full_name: "oxp_3879af65-27ae-439f-861c-67ca34b4edf2/crypt/zone/oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e" } file = sled-storage/src/manager.rs:1431
5162025-01-27T09:29:38.951ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-01-27T09:29:38.952ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5182025-01-27T09:29:38.952ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crucible" } file = sled-storage/src/manager.rs:1431
5192025-01-27T09:29:38.998ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-01-27T09:29:38.998ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5212025-01-27T09:29:38.998ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/423760c6-8db9-4b47-b42b-49adac69df39/crypt/debug"), full_name: "oxp_423760c6-8db9-4b47-b42b-49adac69df39/crypt/debug" } file = sled-storage/src/manager.rs:1431
5222025-01-27T09:29:39.029ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-27T09:29:39.030ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-01-27T09:29:39.030ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone/oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2"), full_name: "oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone/oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2" } file = sled-storage/src/manager.rs:1431
5252025-01-27T09:29:39.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-01-27T09:29:39.090ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5272025-01-27T09:29:39.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/debug"), full_name: "oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/debug" } file = sled-storage/src/manager.rs:1431
5282025-01-27T09:29:39.118ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-01-27T09:29:39.118ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302025-01-27T09:29:39.118ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae" } file = sled-storage/src/manager.rs:1431
5312025-01-27T09:29:39.173ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-01-27T09:29:39.173ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332025-01-27T09:29:39.173ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1990e07a-cfb7-436f-b017-73d119d10c34/crypt/zone/oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629"), full_name: "oxp_1990e07a-cfb7-436f-b017-73d119d10c34/crypt/zone/oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629" } file = sled-storage/src/manager.rs:1431
5342025-01-27T09:29:39.184ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d4e670d1-037a-4b75-80e2-234f2762bd9e) file = sled-agent/src/probe_manager.rs:231 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
5352025-01-27T09:29:39.235ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-01-27T09:29:39.235ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5372025-01-27T09:29:39.235ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/zone"), full_name: "oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/zone" } file = sled-storage/src/manager.rs:1431
5382025-01-27T09:29:39.264ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-01-27T09:29:39.264ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402025-01-27T09:29:39.264ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/zone/oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa"), full_name: "oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/zone/oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa" } file = sled-storage/src/manager.rs:1431
5412025-01-27T09:29:39.321ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422025-01-27T09:29:39.321ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432025-01-27T09:29:39.321ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3879af65-27ae-439f-861c-67ca34b4edf2/crypt/zone/oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8"), full_name: "oxp_3879af65-27ae-439f-861c-67ca34b4edf2/crypt/zone/oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8" } file = sled-storage/src/manager.rs:1431
5442025-01-27T09:29:39.379ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-01-27T09:29:39.379ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5462025-01-27T09:29:39.379ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/debug"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/debug" } file = sled-storage/src/manager.rs:1431
5472025-01-27T09:29:39.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-01-27T09:29:39.409ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5492025-01-27T09:29:39.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone" } file = sled-storage/src/manager.rs:1431
5502025-01-27T09:29:39.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-01-27T09:29:39.438ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522025-01-27T09:29:39.438ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3" } file = sled-storage/src/manager.rs:1431
5532025-01-27T09:29:39.495ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-27T09:29:39.495ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552025-01-27T09:29:39.495ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_423760c6-8db9-4b47-b42b-49adac69df39/crucible" } file = sled-storage/src/manager.rs:1431
5562025-01-27T09:29:39.543ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-27T09:29:39.543ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5582025-01-27T09:29:39.543ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone"), full_name: "oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone" } file = sled-storage/src/manager.rs:1431
5592025-01-27T09:29:39.573ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-01-27T09:29:39.573ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5612025-01-27T09:29:39.573ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/zone/oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e"), full_name: "oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/zone/oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e" } file = sled-storage/src/manager.rs:1431
5622025-01-27T09:29:39.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-01-27T09:29:39.631ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5642025-01-27T09:29:39.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3879af65-27ae-439f-861c-67ca34b4edf2/crypt/debug"), full_name: "oxp_3879af65-27ae-439f-861c-67ca34b4edf2/crypt/debug" } file = sled-storage/src/manager.rs:1431
5652025-01-27T09:29:39.660ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-01-27T09:29:39.660ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5672025-01-27T09:29:39.660ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5682025-01-27T09:29:39.710ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-01-27T09:29:39.710ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-01-27T09:29:39.710ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3879af65-27ae-439f-861c-67ca34b4edf2/crucible" } file = sled-storage/src/manager.rs:1431
5712025-01-27T09:29:39.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-01-27T09:29:39.757ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5732025-01-27T09:29:39.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1990e07a-cfb7-436f-b017-73d119d10c34/crypt/debug"), full_name: "oxp_1990e07a-cfb7-436f-b017-73d119d10c34/crypt/debug" } file = sled-storage/src/manager.rs:1431
5742025-01-27T09:29:39.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-01-27T09:29:39.784ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5762025-01-27T09:29:39.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1990e07a-cfb7-436f-b017-73d119d10c34/crypt/zone"), full_name: "oxp_1990e07a-cfb7-436f-b017-73d119d10c34/crypt/zone" } file = sled-storage/src/manager.rs:1431
5772025-01-27T09:29:39.813ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782025-01-27T09:29:39.813ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5792025-01-27T09:29:39.813ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/zone"), full_name: "oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5802025-01-27T09:29:39.842ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812025-01-27T09:29:39.842ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5822025-01-27T09:29:39.842ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3879af65-27ae-439f-861c-67ca34b4edf2/crypt/zone"), full_name: "oxp_3879af65-27ae-439f-861c-67ca34b4edf2/crypt/zone" } file = sled-storage/src/manager.rs:1431
5832025-01-27T09:29:39.872ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-01-27T09:29:39.872ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5852025-01-27T09:29:39.872ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55/crucible" } file = sled-storage/src/manager.rs:1431
5862025-01-27T09:29:39.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-01-27T09:29:39.919ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5882025-01-27T09:29:39.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5892025-01-27T09:29:39.967ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-01-27T09:29:39.967ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912025-01-27T09:29:39.967ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone/oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone/oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832" } file = sled-storage/src/manager.rs:1431
5922025-01-27T09:29:40.025ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-01-27T09:29:40.025ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942025-01-27T09:29:40.025ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/zone/oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377"), full_name: "oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/zone/oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377" } file = sled-storage/src/manager.rs:1431
5952025-01-27T09:29:40.085ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-01-27T09:29:40.085ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-01-27T09:29:40.085ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crucible" } file = sled-storage/src/manager.rs:1431
5982025-01-27T09:29:40.132ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-01-27T09:29:40.132ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002025-01-27T09:29:40.132ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6012025-01-27T09:29:40.180ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-27T09:29:40.180ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6032025-01-27T09:29:40.180ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/debug"), full_name: "oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/debug" } file = sled-storage/src/manager.rs:1431
6042025-01-27T09:29:40.186ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d4e670d1-037a-4b75-80e2-234f2762bd9e) file = sled-agent/src/probe_manager.rs:231 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
6052025-01-27T09:29:40.210ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062025-01-27T09:29:40.210ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6072025-01-27T09:29:40.210ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/zone/oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86" } file = sled-storage/src/manager.rs:1431
6082025-01-27T09:29:40.269ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092025-01-27T09:29:40.269ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102025-01-27T09:29:40.269ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone/oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/zone/oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f" } file = sled-storage/src/manager.rs:1431
6112025-01-27T09:29:40.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122025-01-27T09:29:40.328ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6132025-01-27T09:29:40.328ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6142025-01-27T09:29:40.375ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6152025-01-27T09:29:40.375ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6162025-01-27T09:29:40.375ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/zone/oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41"), full_name: "oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/zone/oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41" } file = sled-storage/src/manager.rs:1431
6172025-01-27T09:29:40.433ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6182025-01-27T09:29:40.433ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6192025-01-27T09:29:40.433ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6202025-01-27T09:29:40.483ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212025-01-27T09:29:40.483ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222025-01-27T09:29:40.483ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/zone/oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4"), full_name: "oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/zone/oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4" } file = sled-storage/src/manager.rs:1431
6232025-01-27T09:29:40.543ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242025-01-27T09:29:40.543ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6252025-01-27T09:29:40.543ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/zone/oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c"), full_name: "oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/zone/oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c" } file = sled-storage/src/manager.rs:1431
6262025-01-27T09:29:40.602ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272025-01-27T09:29:40.602ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6282025-01-27T09:29:40.602ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/423760c6-8db9-4b47-b42b-49adac69df39/crypt/zone/oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938"), full_name: "oxp_423760c6-8db9-4b47-b42b-49adac69df39/crypt/zone/oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938" } file = sled-storage/src/manager.rs:1431
6292025-01-27T09:29:40.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302025-01-27T09:29:40.658ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6312025-01-27T09:29:40.658ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3879af65-27ae-439f-861c-67ca34b4edf2/crypt/zone/oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b"), full_name: "oxp_3879af65-27ae-439f-861c-67ca34b4edf2/crypt/zone/oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b" } file = sled-storage/src/manager.rs:1431
6322025-01-27T09:29:40.716ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332025-01-27T09:29:40.716ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6342025-01-27T09:29:40.716ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/debug"), full_name: "oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/debug" } file = sled-storage/src/manager.rs:1431
6352025-01-27T09:29:40.746ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362025-01-27T09:29:40.746ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6372025-01-27T09:29:40.746ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone/oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447"), full_name: "oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/zone/oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447" } file = sled-storage/src/manager.rs:1431
6382025-01-27T09:29:40.803ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392025-01-27T09:29:40.803ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6402025-01-27T09:29:40.803ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6412025-01-27T09:29:40.853ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422025-01-27T09:29:40.853ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6432025-01-27T09:29:40.853ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3879af65-27ae-439f-861c-67ca34b4edf2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6442025-01-27T09:29:40.905ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452025-01-27T09:29:40.905ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6462025-01-27T09:29:40.905ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57255367-8a48-44c0-b878-15bd0dd194f1/crypt/debug"), full_name: "oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crypt/debug" } file = sled-storage/src/manager.rs:1431
6472025-01-27T09:29:40.933ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-01-27T09:29:40.933ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6492025-01-27T09:29:40.933ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/zone"), full_name: "oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/zone" } file = sled-storage/src/manager.rs:1431
6502025-01-27T09:29:40.963ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6512025-01-27T09:29:40.963ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6522025-01-27T09:29:40.963ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6532025-01-27T09:29:41.012ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542025-01-27T09:29:41.013ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6552025-01-27T09:29:41.013ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
6562025-01-27T09:29:41.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3150460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37009 req_id = ff25e667-3442-4387-a760-f4a5ed4323c5 response_code = 200 uri = /datasets
6572025-01-27T09:29:41.045ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 83d21f18-7616-467b-8557-bd40504cedae (service), filesystem_pool: Some(ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ff934b86-3f32-4308-a2d5-95837789171f (service), filesystem_pool: Some(ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 43964eda-85cf-48be-b25b-2fa4583ed2a2 (service), filesystem_pool: Some(ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6582025-01-27T09:29:41.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60398
6592025-01-27T09:29:41.045ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-01-27T09:29:41.045ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-01-27T09:29:41.054ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-01-27T09:29:41.054ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-01-27T09:29:41.063ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642025-01-27T09:29:41.063ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652025-01-27T09:29:41.072ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-27T09:29:41.072ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:188
6672025-01-27T09:29:41.072ZINFOSledAgent (ServiceManager): No ledger in /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:188
6682025-01-27T09:29:41.072ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-01-27T09:29:41.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-01-27T09:29:41.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-01-27T09:29:41.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-01-27T09:29:41.167ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f file = illumos-utils/src/zone.rs:325
6732025-01-27T09:29:41.171ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae file = illumos-utils/src/zone.rs:325
6742025-01-27T09:29:41.174ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2 file = illumos-utils/src/zone.rs:325
6752025-01-27T09:29:41.186ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f file = illumos-utils/src/zone.rs:363
6762025-01-27T09:29:41.191ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae file = illumos-utils/src/zone.rs:363
6772025-01-27T09:29:41.195ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2 file = illumos-utils/src/zone.rs:363
6782025-01-27T09:29:41.195ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d4e670d1-037a-4b75-80e2-234f2762bd9e) file = sled-agent/src/probe_manager.rs:231 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
6792025-01-27T09:29:42.197ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d4e670d1-037a-4b75-80e2-234f2762bd9e) file = sled-agent/src/probe_manager.rs:231 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
6802025-01-27T09:29:42.783ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812025-01-27T09:29:42.783ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6822025-01-27T09:29:42.783ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
6832025-01-27T09:29:43.268ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842025-01-27T09:29:43.393ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6852025-01-27T09:29:43.393ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6862025-01-27T09:29:43.399ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6872025-01-27T09:29:43.399ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6882025-01-27T09:29:43.552ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
6892025-01-27T09:29:43.552ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
6902025-01-27T09:29:43.593ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
6912025-01-27T09:29:43.593ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
6922025-01-27T09:29:43.644ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
6932025-01-27T09:29:43.644ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
6942025-01-27T09:29:43.664ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
6952025-01-27T09:29:43.664ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
6962025-01-27T09:29:43.733ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
6972025-01-27T09:29:43.733ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
6982025-01-27T09:29:43.750ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6992025-01-27T09:29:43.750ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7002025-01-27T09:29:43.750ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
7012025-01-27T09:29:43.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f") failed: Property not found. retry in 53.402049ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7022025-01-27T09:29:43.760ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7032025-01-27T09:29:43.764ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7042025-01-27T09:29:43.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f") failed: Property not found. retry in 110.400125ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7052025-01-27T09:29:43.832ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7062025-01-27T09:29:43.832ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7072025-01-27T09:29:43.865ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7082025-01-27T09:29:43.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae") failed: Property not found. retry in 56.961667ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7092025-01-27T09:29:43.904ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7102025-01-27T09:29:43.904ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7112025-01-27T09:29:43.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 53.514576ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7122025-01-27T09:29:43.905ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 0
7132025-01-27T09:29:43.905ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7142025-01-27T09:29:43.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f") failed: Property not found. retry in 195.052874ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7152025-01-27T09:29:43.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7162025-01-27T09:29:43.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae") failed: Property not found. retry in 53.699071ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7172025-01-27T09:29:44.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 56.052692ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7182025-01-27T09:29:44.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae") failed: Property not found. retry in 222.746082ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7192025-01-27T09:29:44.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 111.454075ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7202025-01-27T09:29:44.268ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16084343581909740695 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
7212025-01-27T09:29:44.269ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3247995778793208263 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
7222025-01-27T09:29:44.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f") failed: Property not found. retry in 269.353331ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7232025-01-27T09:29:44.296ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7242025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7252025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7262025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7272025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7282025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7292025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7302025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7312025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7322025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7332025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7342025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7352025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7362025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7372025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7382025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7392025-01-27T09:29:44.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7402025-01-27T09:29:44.297ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7412025-01-27T09:29:44.297ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7422025-01-27T09:29:44.300ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7432025-01-27T09:29:44.300ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7442025-01-27T09:29:44.300ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7452025-01-27T09:29:44.300ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7462025-01-27T09:29:44.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae") failed: Property not found. retry in 304.531237ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7472025-01-27T09:29:44.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 345.972668ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7482025-01-27T09:29:44.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f") failed: Property not found. retry in 765.493556ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7492025-01-27T09:29:44.630ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6941409038787322019 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
7502025-01-27T09:29:44.630ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9245498637835454136 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
7512025-01-27T09:29:44.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae") failed: Property not found. retry in 886.33086ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7522025-01-27T09:29:44.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 926.120423ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7532025-01-27T09:29:45.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f") failed: Property not found. retry in 973.985376ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7542025-01-27T09:29:45.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae") failed: Property not found. retry in 1.223966801s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7552025-01-27T09:29:45.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 577.751353ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7562025-01-27T09:29:46.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 1.044321938s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7572025-01-27T09:29:46.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f") failed: Property not found. retry in 1.369594391s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7582025-01-27T09:29:46.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae") failed: Property not found. retry in 1.077539229s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7592025-01-27T09:29:47.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 890.434157ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7602025-01-27T09:29:47.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f") failed: Property not found. retry in 1.429388304s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7612025-01-27T09:29:47.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae") failed: Property not found. retry in 957.403909ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7622025-01-27T09:29:48.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 523.256369ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7632025-01-27T09:29:48.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 964.462294ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7642025-01-27T09:29:48.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae") failed: Property not found. retry in 1.0492057s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7652025-01-27T09:29:49.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f") failed: Property not found. retry in 1.109406537s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7662025-01-27T09:29:49.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2") failed: Property not found. retry in 1.28727652s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7672025-01-27T09:29:51.029ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_ff934b86-3f32-4308-a2d5-95837789171f
7682025-01-27T09:29:51.029ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_83d21f18-7616-467b-8557-bd40504cedae
7692025-01-27T09:29:51.029ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_43964eda-85cf-48be-b25b-2fa4583ed2a2
7702025-01-27T09:29:51.029ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7712025-01-27T09:29:51.029ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722025-01-27T09:29:51.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9984594 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60398 req_id = b6a1fe88-12a1-4022-b77b-5d5a7eb1a4a9 response_code = 204 uri = /omicron-zones
7732025-01-27T09:29:51.032ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742025-01-27T09:29:52.535ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 82.915359ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7752025-01-27T09:29:52.619ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 142.342105ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7762025-01-27T09:29:52.817ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7772025-01-27T09:29:52.924ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7782025-01-27T09:29:53.010ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7792025-01-27T09:29:53.010ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7802025-01-27T09:29:53.042ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7812025-01-27T09:29:53.043ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7822025-01-27T09:29:53.043ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7832025-01-27T09:29:53.073ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 83d21f18-7616-467b-8557-bd40504cedae (service), filesystem_pool: Some(ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ff934b86-3f32-4308-a2d5-95837789171f (service), filesystem_pool: Some(ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 43964eda-85cf-48be-b25b-2fa4583ed2a2 (service), filesystem_pool: Some(ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8faf7e87-dab3-4143-8907-0a4b168199a4 (service), filesystem_pool: Some(ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1ca70d96-6a67-4c1b-87f3-fc3e5d3dd197, kind: Service { id: 8faf7e87-dab3-4143-8907-0a4b168199a4 }, name: Name("ntp-8faf7e87-dab3-4143-8907-0a4b168199a4"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 136])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7842025-01-27T09:29:53.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52619
7852025-01-27T09:29:53.073ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7862025-01-27T09:29:53.073ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, responder: ... }
7872025-01-27T09:29:53.084ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7882025-01-27T09:29:53.084ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7892025-01-27T09:29:53.095ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7902025-01-27T09:29:53.095ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7912025-01-27T09:29:53.105ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7922025-01-27T09:29:53.105ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:177
7932025-01-27T09:29:53.105ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:177
7942025-01-27T09:29:53.106ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7952025-01-27T09:29:53.117ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7962025-01-27T09:29:53.149ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7972025-01-27T09:29:53.149ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7982025-01-27T09:29:53.149ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7992025-01-27T09:29:53.179ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 173, 136]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
8002025-01-27T09:29:53.179ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
8012025-01-27T09:29:53.180ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
8022025-01-27T09:29:53.180ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
8032025-01-27T09:29:53.180ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
8042025-01-27T09:29:53.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8052025-01-27T09:29:53.205ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4 file = illumos-utils/src/zone.rs:325
8062025-01-27T09:29:53.224ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4 file = illumos-utils/src/zone.rs:363
8072025-01-27T09:29:53.845ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8082025-01-27T09:29:53.846ZINFOSledAgent (ServiceManager): Booting oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8092025-01-27T09:29:53.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 37.732861ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8102025-01-27T09:29:54.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 131.677253ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8112025-01-27T09:29:54.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 166.659955ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8122025-01-27T09:29:54.270ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16084343581909740695 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8132025-01-27T09:29:54.270ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3247995778793208263 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8142025-01-27T09:29:54.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 370.986296ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8152025-01-27T09:29:54.632ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6941409038787322019 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8162025-01-27T09:29:54.632ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9245498637835454136 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8172025-01-27T09:29:54.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 930.933976ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8182025-01-27T09:29:55.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 568.110057ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8192025-01-27T09:29:56.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 630.660066ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8202025-01-27T09:29:56.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 1.413904639s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8212025-01-27T09:29:58.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 1.440340312s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8222025-01-27T09:29:59.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4") failed: Property not found. retry in 1.448945704s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8232025-01-27T09:29:59.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15637819910980139178 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8242025-01-27T09:30:00.264ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7024191058415878028 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8252025-01-27T09:30:01.032ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4871652575390023502 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8262025-01-27T09:30:01.237ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4
8272025-01-27T09:30:01.237ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8282025-01-27T09:30:01.237ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8292025-01-27T09:30:01.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8164790 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52619 req_id = 2db2ddf6-2b7c-4ba4-85d8-d42246ff97b5 response_code = 204 uri = /omicron-zones
8302025-01-27T09:30:01.239ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8312025-01-27T09:30:01.269ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322025-01-27T09:30:01.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41947
8332025-01-27T09:30:01.279ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8342025-01-27T09:30:01.279ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9879 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41947 req_id = fb2de237-8107-403a-997b-4d4e042fb6a1 response_code = 500 uri = /timesync
8352025-01-27T09:30:01.282ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362025-01-27T09:30:01.455ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8372025-01-27T09:30:01.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38888
8382025-01-27T09:30:04.272ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16084343581909740695 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8392025-01-27T09:30:04.272ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3247995778793208263 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8402025-01-27T09:30:04.633ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6941409038787322019 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8412025-01-27T09:30:04.634ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9245498637835454136 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8422025-01-27T09:30:05.464ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8432025-01-27T09:30:05.464ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38888 req_id = 8fdc1f91-8081-457b-ada2-50da7c17ffcc response_code = 500 uri = /timesync
8442025-01-27T09:30:05.467ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8452025-01-27T09:30:05.653ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8462025-01-27T09:30:05.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64710
8472025-01-27T09:30:05.662ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8482025-01-27T09:30:05.662ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8968 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64710 req_id = 02aa69a5-756b-4a65-8df4-1819363807aa response_code = 500 uri = /timesync
8492025-01-27T09:30:05.664ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8502025-01-27T09:30:05.885ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8512025-01-27T09:30:05.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32851
8522025-01-27T09:30:05.895ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8faf7e87-dab3-4143-8907-0a4b168199a4': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8532025-01-27T09:30:05.895ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32851 req_id = cd11fff2-b766-4156-8ea3-8392e55b7c07 response_code = 500 uri = /timesync
8542025-01-27T09:30:05.897ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8552025-01-27T09:30:06.022ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8562025-01-27T09:30:06.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43005
8572025-01-27T09:30:07.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2008795 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43005 req_id = 5358975a-1275-4e39-bd60-bce86e827184 response_code = 200 uri = /timesync
8582025-01-27T09:30:07.068ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8592025-01-27T09:30:07.068ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8602025-01-27T09:30:07.328ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612025-01-27T09:30:07.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34241
8622025-01-27T09:30:07.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8409 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34241 req_id = 7e2dc7da-365c-4c89-8870-388fe9a551f0 response_code = 200 uri = /timesync
8632025-01-27T09:30:07.339ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8642025-01-27T09:30:07.339ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8652025-01-27T09:30:07.728ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8662025-01-27T09:30:07.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57028
8672025-01-27T09:30:07.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57028 req_id = fa9f3a37-6352-4125-91a7-4840e60b815c response_code = 200 uri = /timesync
8682025-01-27T09:30:07.740ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8692025-01-27T09:30:07.740ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8702025-01-27T09:30:08.016ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8712025-01-27T09:30:08.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34173
8722025-01-27T09:30:08.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9397 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34173 req_id = b471c492-cdd6-4f37-9a7f-1aa36a8c6950 response_code = 200 uri = /timesync
8732025-01-27T09:30:08.027ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737970206.2901945, correction: 0.064893648 } file = sled-agent/src/rack_setup/service.rs:743
8742025-01-27T09:30:08.027ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8752025-01-27T09:30:08.367ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 248.072704ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8762025-01-27T09:30:08.428ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8772025-01-27T09:30:08.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40916
8782025-01-27T09:30:08.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8869 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40916 req_id = 63fb9ca0-bbd2-4db6-962f-9feac09a4ae0 response_code = 200 uri = /timesync
8792025-01-27T09:30:08.438ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737970206.2901945, correction: 0.063782826 } file = sled-agent/src/rack_setup/service.rs:743
8802025-01-27T09:30:08.438ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8812025-01-27T09:30:08.729ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8822025-01-27T09:30:08.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43506
8832025-01-27T09:30:08.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43506 req_id = 73b0d9ae-fee8-4955-9de1-9e01105412e0 response_code = 200 uri = /timesync
8842025-01-27T09:30:08.742ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737970206.2901945, correction: 0.062970087 } file = sled-agent/src/rack_setup/service.rs:743
8852025-01-27T09:30:08.742ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8862025-01-27T09:30:08.943ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15637819910980139178 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8872025-01-27T09:30:09.279ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8882025-01-27T09:30:09.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55108
8892025-01-27T09:30:09.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55108 req_id = 6b1224b9-4155-471d-929f-3bb5199ef383 response_code = 200 uri = /timesync
8902025-01-27T09:30:09.289ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737970206.2901945, correction: 0.062066678 } file = sled-agent/src/rack_setup/service.rs:743
8912025-01-27T09:30:09.289ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922025-01-27T09:30:09.303ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7024191058415878028 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8932025-01-27T09:30:10.023ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8942025-01-27T09:30:10.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47963
8952025-01-27T09:30:10.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47963 req_id = 329e90db-7545-407c-aaaf-88f2865b3a30 response_code = 200 uri = /timesync
8962025-01-27T09:30:10.034ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737970206.2901945, correction: 0.06057984 } file = sled-agent/src/rack_setup/service.rs:743
8972025-01-27T09:30:10.034ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8982025-01-27T09:30:10.075ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4871652575390023502 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
8992025-01-27T09:30:10.279ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10747307528965480936 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
9002025-01-27T09:30:10.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2048039231123111594 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
9012025-01-27T09:30:11.061ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9022025-01-27T09:30:11.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59210
9032025-01-27T09:30:11.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9778 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59210 req_id = e86e136a-1930-4c10-9219-0939b5cac0c5 response_code = 200 uri = /timesync
9042025-01-27T09:30:11.074ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737970206.2901945, correction: 0.057867613 } file = sled-agent/src/rack_setup/service.rs:743
9052025-01-27T09:30:11.074ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9062025-01-27T09:30:12.386ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9072025-01-27T09:30:12.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53946
9082025-01-27T09:30:12.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53946 req_id = 8e7dfde9-d34e-4458-9fb5-abe471bd34d8 response_code = 200 uri = /timesync
9092025-01-27T09:30:12.396ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1737970211.3890994, correction: 0.053606585 } file = sled-agent/src/rack_setup/service.rs:743
9102025-01-27T09:30:12.396ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9112025-01-27T09:30:12.656ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55900
9122025-01-27T09:30:12.656ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55900 req_id = e491a448-d571-4477-8d2d-581952ec449b response_code = 200 uri = /baseboard
9132025-01-27T09:30:13.323ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16084343581909740695 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
9142025-01-27T09:30:13.323ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3247995778793208263 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
9152025-01-27T09:30:13.683ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6941409038787322019 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
9162025-01-27T09:30:13.684ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9245498637835454136 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
9172025-01-27T09:30:14.003ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9182025-01-27T09:30:14.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50854
9192025-01-27T09:30:14.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 21179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50854 req_id = 65cfa497-5065-4049-ab02-d58f6ff063b8 response_code = 200 uri = /timesync
9202025-01-27T09:30:14.029ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 214638438, ip_addr: 12.203.31.102, stratum: 3, ref_time: 1737970212.780417, correction: 0.049112242 } file = sled-agent/src/rack_setup/service.rs:743
9212025-01-27T09:30:14.029ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9222025-01-27T09:30:14.058ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 83d21f18-7616-467b-8557-bd40504cedae (service), filesystem_pool: Some(ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ff934b86-3f32-4308-a2d5-95837789171f (service), filesystem_pool: Some(ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 43964eda-85cf-48be-b25b-2fa4583ed2a2 (service), filesystem_pool: Some(ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8faf7e87-dab3-4143-8907-0a4b168199a4 (service), filesystem_pool: Some(ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1ca70d96-6a67-4c1b-87f3-fc3e5d3dd197, kind: Service { id: 8faf7e87-dab3-4143-8907-0a4b168199a4 }, name: Name("ntp-8faf7e87-dab3-4143-8907-0a4b168199a4"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 136])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: ee2dc329-92b9-4f40-a80c-92c765165f9f (service), filesystem_pool: Some(ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } } } }, OmicronZoneConfig { id: 19d0f09e-c591-4801-9308-30379e5e678d (service), filesystem_pool: Some(ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 897eae46-52af-4211-91e3-396e4ca93ab6 (service), filesystem_pool: Some(ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1b06b5ba-576f-41e4-8ddf-d2fb9a156344 (service), filesystem_pool: Some(ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External } } } }, OmicronZoneConfig { id: 60e8ea08-80b9-4374-8716-45c9045af1c8 (service), filesystem_pool: Some(ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9232025-01-27T09:30:14.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50131
9242025-01-27T09:30:14.059ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9252025-01-27T09:30:14.059ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, responder: ... }
9262025-01-27T09:30:14.068ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9272025-01-27T09:30:14.068ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9282025-01-27T09:30:14.078ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9292025-01-27T09:30:14.078ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9302025-01-27T09:30:14.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9312025-01-27T09:30:14.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Cockroach }, responder: ... }
9322025-01-27T09:30:14.096ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9332025-01-27T09:30:14.096ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9342025-01-27T09:30:14.105ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9352025-01-27T09:30:14.105ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9362025-01-27T09:30:14.114ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9372025-01-27T09:30:14.114ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9382025-01-27T09:30:14.123ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9392025-01-27T09:30:14.123ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9402025-01-27T09:30:14.132ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9412025-01-27T09:30:14.132ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:177
9422025-01-27T09:30:14.133ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:177
9432025-01-27T09:30:14.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9442025-01-27T09:30:14.211ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9452025-01-27T09:30:14.211ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9462025-01-27T09:30:14.211ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9472025-01-27T09:30:14.211ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9482025-01-27T09:30:14.211ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9492025-01-27T09:30:14.305ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344 file = illumos-utils/src/zone.rs:325
9502025-01-27T09:30:14.309ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6 file = illumos-utils/src/zone.rs:325
9512025-01-27T09:30:14.313ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8 file = illumos-utils/src/zone.rs:325
9522025-01-27T09:30:14.318ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d file = illumos-utils/src/zone.rs:325
9532025-01-27T09:30:14.323ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f file = illumos-utils/src/zone.rs:325
9542025-01-27T09:30:14.328ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344 file = illumos-utils/src/zone.rs:363
9552025-01-27T09:30:14.332ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6 file = illumos-utils/src/zone.rs:363
9562025-01-27T09:30:14.337ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8 file = illumos-utils/src/zone.rs:363
9572025-01-27T09:30:14.342ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d file = illumos-utils/src/zone.rs:363
9582025-01-27T09:30:14.346ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f file = illumos-utils/src/zone.rs:363
9592025-01-27T09:30:18.089ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1b06b5ba-576f-41e4-8ddf-d2fb9a156344'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9602025-01-27T09:30:18.089ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
9612025-01-27T09:30:18.113ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='60e8ea08-80b9-4374-8716-45c9045af1c8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9622025-01-27T09:30:18.113ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
9632025-01-27T09:30:18.257ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='897eae46-52af-4211-91e3-396e4ca93ab6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9642025-01-27T09:30:18.257ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
9652025-01-27T09:30:18.264ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ee2dc329-92b9-4f40-a80c-92c765165f9f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9662025-01-27T09:30:18.264ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
9672025-01-27T09:30:18.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 65.815859ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
9682025-01-27T09:30:18.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 51.939418ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
9692025-01-27T09:30:18.316ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='19d0f09e-c591-4801-9308-30379e5e678d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9702025-01-27T09:30:18.316ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
9712025-01-27T09:30:18.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 106.529707ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
9722025-01-27T09:30:18.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 147.202997ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
9732025-01-27T09:30:18.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 269.139057ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
9742025-01-27T09:30:18.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 43.247308ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
9752025-01-27T09:30:18.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 57.120607ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
9762025-01-27T09:30:18.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 33.880377ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
9772025-01-27T09:30:18.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 81.010848ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
9782025-01-27T09:30:18.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 52.864451ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
9792025-01-27T09:30:18.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 77.982317ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
9802025-01-27T09:30:18.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 185.127665ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
9812025-01-27T09:30:18.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 272.369978ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
9822025-01-27T09:30:18.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 140.811711ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
9832025-01-27T09:30:18.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 199.341129ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
9842025-01-27T09:30:19.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 509.297994ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
9852025-01-27T09:30:19.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 388.597817ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
9862025-01-27T09:30:19.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 506.169291ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
9872025-01-27T09:30:19.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 554.74239ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
9882025-01-27T09:30:19.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 386.39171ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
9892025-01-27T09:30:19.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 602.918201ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
9902025-01-27T09:30:19.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 488.835414ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
9912025-01-27T09:30:19.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 1.034064943s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
9922025-01-27T09:30:19.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 1.190329426s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
9932025-01-27T09:30:19.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 589.740014ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
9942025-01-27T09:30:20.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 1.252022279s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
9952025-01-27T09:30:20.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 1.489538032s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
9962025-01-27T09:30:20.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 1.132909971s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
9972025-01-27T09:30:20.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 833.563859ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
9982025-01-27T09:30:20.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 951.869273ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
9992025-01-27T09:30:21.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 1.444643776s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10002025-01-27T09:30:21.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 1.411113463s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10012025-01-27T09:30:21.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 1.162919984s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10022025-01-27T09:30:21.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 994.21531ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10032025-01-27T09:30:21.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 531.862095ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10042025-01-27T09:30:22.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 749.979106ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10052025-01-27T09:30:22.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 798.111724ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10062025-01-27T09:30:22.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 867.35315ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10072025-01-27T09:30:22.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 936.838006ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10082025-01-27T09:30:22.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 1.428846032s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10092025-01-27T09:30:23.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 796.495808ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10102025-01-27T09:30:23.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 996.081417ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10112025-01-27T09:30:23.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 933.83301ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10122025-01-27T09:30:23.695ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 721.892287ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
10132025-01-27T09:30:23.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 943.143466ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10142025-01-27T09:30:23.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 1.363620514s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10152025-01-27T09:30:24.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 1.39201804s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10162025-01-27T09:30:24.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 712.779232ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10172025-01-27T09:30:24.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 965.487617ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10182025-01-27T09:30:24.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 852.797056ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10192025-01-27T09:30:25.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 1.252061761s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10202025-01-27T09:30:25.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 696.168653ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10212025-01-27T09:30:25.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 615.159718ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10222025-01-27T09:30:25.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 845.48744ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10232025-01-27T09:30:25.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 721.432833ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10242025-01-27T09:30:25.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 1.050413919s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10252025-01-27T09:30:26.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 1.277149294s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10262025-01-27T09:30:26.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 1.209100554s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10272025-01-27T09:30:26.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 1.241040412s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10282025-01-27T09:30:26.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 1.239218894s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10292025-01-27T09:30:27.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 623.632386ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10302025-01-27T09:30:27.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 714.412885ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10312025-01-27T09:30:27.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 1.118497453s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10322025-01-27T09:30:27.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 1.432627266s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10332025-01-27T09:30:27.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 1.481383792s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10342025-01-27T09:30:27.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 1.379760571s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10352025-01-27T09:30:28.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 1.083106136s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10362025-01-27T09:30:28.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 1.430532806s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10372025-01-27T09:30:29.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 1.015830831s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10382025-01-27T09:30:29.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 925.207856ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10392025-01-27T09:30:29.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 669.702616ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10402025-01-27T09:30:29.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 722.496473ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10412025-01-27T09:30:29.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 1.094532615s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10422025-01-27T09:30:29.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 672.869595ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10432025-01-27T09:30:30.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 606.279142ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10442025-01-27T09:30:30.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 1.057303951s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10452025-01-27T09:30:30.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 592.225444ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10462025-01-27T09:30:30.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 1.206671073s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10472025-01-27T09:30:30.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 1.487272338s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10482025-01-27T09:30:30.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 632.638861ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10492025-01-27T09:30:30.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 893.929752ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10502025-01-27T09:30:31.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 1.044678509s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10512025-01-27T09:30:31.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 1.032546114s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10522025-01-27T09:30:31.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 588.905845ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10532025-01-27T09:30:31.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 1.397852417s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10542025-01-27T09:30:32.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 1.284045781s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10552025-01-27T09:30:32.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 974.840483ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10562025-01-27T09:30:32.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 931.246956ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10572025-01-27T09:30:32.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 550.956278ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10582025-01-27T09:30:33.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344") failed: Property not found. retry in 760.612407ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10592025-01-27T09:30:33.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f") failed: Property not found. retry in 1.013772475s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10602025-01-27T09:30:33.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6") failed: Property not found. retry in 1.167553659s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10612025-01-27T09:30:33.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8") failed: Property not found. retry in 982.965773ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10622025-01-27T09:30:33.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d") failed: Property not found. retry in 822.094189ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10632025-01-27T09:30:34.488ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_1b06b5ba-576f-41e4-8ddf-d2fb9a156344
10642025-01-27T09:30:34.489ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_897eae46-52af-4211-91e3-396e4ca93ab6
10652025-01-27T09:30:34.489ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_60e8ea08-80b9-4374-8716-45c9045af1c8
10662025-01-27T09:30:34.489ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d
10672025-01-27T09:30:34.489ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_ee2dc329-92b9-4f40-a80c-92c765165f9f
10682025-01-27T09:30:34.489ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10692025-01-27T09:30:34.489ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10702025-01-27T09:30:34.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 20382392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50131 req_id = 816b095e-6b52-4280-acd5-1f635cb401fc response_code = 204 uri = /omicron-zones
10712025-01-27T09:30:34.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64117
10722025-01-27T09:30:34.563ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 34355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64117 req_id = c5a5309d-1daa-43a1-b850-a34819c3b06a response_code = 500 uri = /cockroachdb
10732025-01-27T09:30:34.563ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c5a5309d-1daa-43a1-b850-a34819c3b06a", "content-length": "124", "date": "Mon, 27 Jan 2025 09:30:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c5a5309d-1daa-43a1-b850-a34819c3b06a" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 91.099709ms
10742025-01-27T09:30:34.689ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 33549 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64117 req_id = d8e07f9c-8cf2-48d9-96df-5796bf8e0a39 response_code = 500 uri = /cockroachdb
10752025-01-27T09:30:34.689ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d8e07f9c-8cf2-48d9-96df-5796bf8e0a39", "content-length": "124", "date": "Mon, 27 Jan 2025 09:30:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d8e07f9c-8cf2-48d9-96df-5796bf8e0a39" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 153.381736ms
10762025-01-27T09:30:34.871ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27530 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64117 req_id = b9cc788f-1c83-4724-9b39-5af1e8f6f4f3 response_code = 500 uri = /cockroachdb
10772025-01-27T09:30:34.872ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b9cc788f-1c83-4724-9b39-5af1e8f6f4f3", "content-length": "124", "date": "Mon, 27 Jan 2025 09:30:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b9cc788f-1c83-4724-9b39-5af1e8f6f4f3" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 163.497513ms
10782025-01-27T09:30:35.061ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_19d0f09e-c591-4801-9308-30379e5e678d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25546 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64117 req_id = 37c17e14-ad86-43ef-aade-2cb20fc71119 response_code = 500 uri = /cockroachdb
10792025-01-27T09:30:35.062ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "37c17e14-ad86-43ef-aade-2cb20fc71119", "content-length": "124", "date": "Mon, 27 Jan 2025 09:30:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "37c17e14-ad86-43ef-aade-2cb20fc71119" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 227.602342ms
10802025-01-27T09:30:35.319ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3752
10812025-01-27T09:30:49.570ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10822025-01-27T09:30:55.701ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10832025-01-27T09:30:55.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 20413748 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:64117 req_id = 9f061c24-581c-4518-93a8-d12bf7caa58e response_code = 204 uri = /cockroachdb
10842025-01-27T09:30:55.723ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.021874721s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
10852025-01-27T09:30:55.758ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 83d21f18-7616-467b-8557-bd40504cedae (service), filesystem_pool: Some(ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ff934b86-3f32-4308-a2d5-95837789171f (service), filesystem_pool: Some(ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 43964eda-85cf-48be-b25b-2fa4583ed2a2 (service), filesystem_pool: Some(ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8faf7e87-dab3-4143-8907-0a4b168199a4 (service), filesystem_pool: Some(ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1ca70d96-6a67-4c1b-87f3-fc3e5d3dd197, kind: Service { id: 8faf7e87-dab3-4143-8907-0a4b168199a4 }, name: Name("ntp-8faf7e87-dab3-4143-8907-0a4b168199a4"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 136])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: ee2dc329-92b9-4f40-a80c-92c765165f9f (service), filesystem_pool: Some(ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } } } }, OmicronZoneConfig { id: 19d0f09e-c591-4801-9308-30379e5e678d (service), filesystem_pool: Some(ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 897eae46-52af-4211-91e3-396e4ca93ab6 (service), filesystem_pool: Some(ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1b06b5ba-576f-41e4-8ddf-d2fb9a156344 (service), filesystem_pool: Some(ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External } } } }, OmicronZoneConfig { id: 60e8ea08-80b9-4374-8716-45c9045af1c8 (service), filesystem_pool: Some(ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External } } } }, OmicronZoneConfig { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 (service), filesystem_pool: Some(ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 973be945-abc3-45ec-9b5d-b6b0e143999f (service), filesystem_pool: Some(ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 31e6d238-77dc-443c-83f4-2b834aaac06c (service), filesystem_pool: Some(ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e (service), filesystem_pool: Some(ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 (service), filesystem_pool: Some(ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 68bb99eb-b4ab-4082-991e-b4bbc97b38df (service), filesystem_pool: Some(ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 10f866cd-9998-4a8e-b593-06f125e33b86 (service), filesystem_pool: Some(ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } } } }, OmicronZoneConfig { id: cb84c3cf-3cf9-44e2-9979-05dfad6e4629 (service), filesystem_pool: Some(ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 471072d1-1074-4ce4-8624-5eb1eb666447 (service), filesystem_pool: Some(ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: ca2b963a-a4d3-4a39-ae4d-ae7b078b215e (service), filesystem_pool: Some(ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 4e71d602-200b-41e9-aad4-e3ede9f1e1e3 (service), filesystem_pool: Some(ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External } } } }, OmicronZoneConfig { id: 8cef54b0-4bf2-424c-b374-5b9e9f682832 (service), filesystem_pool: Some(ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53993421-f481-40aa-a8d8-e0726be87c21 (service), filesystem_pool: Some(ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 172bb22d-a56f-4207-a308-9a2e907f4938 (service), filesystem_pool: Some(ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External } } } }, OmicronZoneConfig { id: a85ef0f0-1ab9-4261-827f-33c1bd759c5b (service), filesystem_pool: Some(ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5e4034d0-68b1-4e4d-8344-e580c4275afa (service), filesystem_pool: Some(ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External } } } }, OmicronZoneConfig { id: 1a51ed25-62e8-4e11-8d4e-27a2a38a2e41 (service), filesystem_pool: Some(ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7812e930-d4de-4299-b2fd-679d77249377 (service), filesystem_pool: Some(ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2e459145-50ff-4cfb-99c9-4cf21ad624bb (service), filesystem_pool: Some(ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10862025-01-27T09:30:55.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49998
10872025-01-27T09:30:55.764ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10882025-01-27T09:30:55.764ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: InternalDns }, responder: ... }
10892025-01-27T09:30:55.782ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10902025-01-27T09:30:55.782ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10912025-01-27T09:30:55.794ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10922025-01-27T09:30:55.794ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10932025-01-27T09:30:55.804ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10942025-01-27T09:30:55.804ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Cockroach }, responder: ... }
10952025-01-27T09:30:55.814ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10962025-01-27T09:30:55.814ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10972025-01-27T09:30:55.824ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10982025-01-27T09:30:55.824ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10992025-01-27T09:30:55.834ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11002025-01-27T09:30:55.834ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11012025-01-27T09:30:55.845ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11022025-01-27T09:30:55.845ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11032025-01-27T09:30:55.855ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11042025-01-27T09:30:55.855ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11052025-01-27T09:30:55.868ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11062025-01-27T09:30:55.868ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11072025-01-27T09:30:55.879ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11082025-01-27T09:30:55.880ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11092025-01-27T09:30:55.892ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11102025-01-27T09:30:55.892ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, kind: Crucible }, responder: ... }
11112025-01-27T09:30:55.905ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11122025-01-27T09:30:55.905ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, kind: Crucible }, responder: ... }
11132025-01-27T09:30:55.916ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11142025-01-27T09:30:55.916ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, kind: Crucible }, responder: ... }
11152025-01-27T09:30:55.927ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11162025-01-27T09:30:55.927ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, kind: Crucible }, responder: ... }
11172025-01-27T09:30:55.938ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11182025-01-27T09:30:55.938ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, kind: Crucible }, responder: ... }
11192025-01-27T09:30:55.949ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11202025-01-27T09:30:55.949ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, kind: Crucible }, responder: ... }
11212025-01-27T09:30:55.961ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11222025-01-27T09:30:55.961ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, kind: Crucible }, responder: ... }
11232025-01-27T09:30:55.975ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11242025-01-27T09:30:55.975ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, kind: Crucible }, responder: ... }
11252025-01-27T09:30:55.988ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11262025-01-27T09:30:55.988ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, kind: Crucible }, responder: ... }
11272025-01-27T09:30:56.003ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282025-01-27T09:30:56.003ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:177
11292025-01-27T09:30:56.004ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:177
11302025-01-27T09:30:56.004ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11312025-01-27T09:30:56.129ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11322025-01-27T09:30:56.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11332025-01-27T09:30:56.171ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11342025-01-27T09:30:56.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11352025-01-27T09:30:56.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11362025-01-27T09:30:56.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11372025-01-27T09:30:56.198ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11382025-01-27T09:30:56.198ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11392025-01-27T09:30:56.198ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11402025-01-27T09:30:56.199ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11412025-01-27T09:30:56.323ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11422025-01-27T09:30:56.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11432025-01-27T09:30:56.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11442025-01-27T09:30:56.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11452025-01-27T09:30:56.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11462025-01-27T09:30:56.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11472025-01-27T09:30:56.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11482025-01-27T09:30:56.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11492025-01-27T09:30:56.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11502025-01-27T09:30:56.400ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832 file = illumos-utils/src/zone.rs:325
11512025-01-27T09:30:56.406ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df file = illumos-utils/src/zone.rs:325
11522025-01-27T09:30:56.411ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86 file = illumos-utils/src/zone.rs:325
11532025-01-27T09:30:56.417ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb file = illumos-utils/src/zone.rs:325
11542025-01-27T09:30:56.422ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629 file = illumos-utils/src/zone.rs:325
11552025-01-27T09:30:56.427ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41 file = illumos-utils/src/zone.rs:325
11562025-01-27T09:30:56.585ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832 file = illumos-utils/src/zone.rs:363
11572025-01-27T09:30:56.591ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df file = illumos-utils/src/zone.rs:363
11582025-01-27T09:30:56.595ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86 file = illumos-utils/src/zone.rs:363
11592025-01-27T09:30:56.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb file = illumos-utils/src/zone.rs:363
11602025-01-27T09:30:56.605ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629 file = illumos-utils/src/zone.rs:363
11612025-01-27T09:30:56.610ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41 file = illumos-utils/src/zone.rs:363
11622025-01-27T09:30:56.616ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938 file = illumos-utils/src/zone.rs:325
11632025-01-27T09:30:56.621ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa file = illumos-utils/src/zone.rs:325
11642025-01-27T09:30:56.626ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b file = illumos-utils/src/zone.rs:325
11652025-01-27T09:30:56.632ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447 file = illumos-utils/src/zone.rs:325
11662025-01-27T09:30:56.636ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377 file = illumos-utils/src/zone.rs:325
11672025-01-27T09:30:56.641ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3 file = illumos-utils/src/zone.rs:325
11682025-01-27T09:30:56.647ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21 file = illumos-utils/src/zone.rs:325
11692025-01-27T09:30:56.653ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e file = illumos-utils/src/zone.rs:325
11702025-01-27T09:30:56.715ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11712025-01-27T09:30:56.716ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938 file = illumos-utils/src/zone.rs:363
11722025-01-27T09:30:56.725ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa file = illumos-utils/src/zone.rs:363
11732025-01-27T09:30:56.732ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b file = illumos-utils/src/zone.rs:363
11742025-01-27T09:30:56.739ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447 file = illumos-utils/src/zone.rs:363
11752025-01-27T09:30:56.746ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377 file = illumos-utils/src/zone.rs:363
11762025-01-27T09:30:56.753ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3 file = illumos-utils/src/zone.rs:363
11772025-01-27T09:30:56.761ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21 file = illumos-utils/src/zone.rs:363
11782025-01-27T09:30:56.769ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e file = illumos-utils/src/zone.rs:363
11792025-01-27T09:30:56.866ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11802025-01-27T09:30:56.922ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11812025-01-27T09:30:56.979ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11822025-01-27T09:30:57.041ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11832025-01-27T09:30:57.043ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11842025-01-27T09:30:57.043ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11852025-01-27T09:30:57.128ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 129, 91]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11862025-01-27T09:30:57.128ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11872025-01-27T09:30:57.132ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11882025-01-27T09:30:57.132ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11892025-01-27T09:30:57.199ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 247, 178]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11902025-01-27T09:30:57.199ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11912025-01-27T09:30:57.201ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11922025-01-27T09:30:57.201ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11932025-01-27T09:30:57.264ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 197, 220]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11942025-01-27T09:30:57.264ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11952025-01-27T09:30:57.266ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11962025-01-27T09:30:57.266ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11972025-01-27T09:30:57.332ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 193, 255]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11982025-01-27T09:30:57.333ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11992025-01-27T09:30:57.334ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12002025-01-27T09:30:57.334ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12012025-01-27T09:30:57.407ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 220, 155]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12022025-01-27T09:30:57.407ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12032025-01-27T09:30:57.408ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12042025-01-27T09:30:57.408ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12052025-01-27T09:30:57.409ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12062025-01-27T09:30:57.409ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12072025-01-27T09:30:57.410ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12082025-01-27T09:30:57.410ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12092025-01-27T09:30:57.410ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12102025-01-27T09:30:57.410ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12112025-01-27T09:30:57.410ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12122025-01-27T09:30:57.410ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12132025-01-27T09:30:57.419ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12142025-01-27T09:30:57.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12152025-01-27T09:30:57.470ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12162025-01-27T09:30:57.474ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12172025-01-27T09:30:57.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12182025-01-27T09:30:57.477ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12192025-01-27T09:30:57.480ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12202025-01-27T09:30:57.481ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212025-01-27T09:30:57.481ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12222025-01-27T09:30:57.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12232025-01-27T09:30:57.776ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97 file = illumos-utils/src/zone.rs:325
12242025-01-27T09:30:57.791ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f file = illumos-utils/src/zone.rs:325
12252025-01-27T09:30:57.805ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180 file = illumos-utils/src/zone.rs:325
12262025-01-27T09:30:57.816ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c file = illumos-utils/src/zone.rs:325
12272025-01-27T09:30:57.830ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e file = illumos-utils/src/zone.rs:325
12282025-01-27T09:30:57.844ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97 file = illumos-utils/src/zone.rs:363
12292025-01-27T09:30:57.857ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f file = illumos-utils/src/zone.rs:363
12302025-01-27T09:30:57.867ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180 file = illumos-utils/src/zone.rs:363
12312025-01-27T09:30:57.879ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c file = illumos-utils/src/zone.rs:363
12322025-01-27T09:30:57.891ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e file = illumos-utils/src/zone.rs:363
12332025-01-27T09:30:59.958ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342025-01-27T09:30:59.958ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352025-01-27T09:30:59.959ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
12362025-01-27T09:30:59.975ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
12372025-01-27T09:31:00.231ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='926d6e70-894b-4515-bfe0-85657a29b193'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12382025-01-27T09:31:00.301ZINFOSledAgent (ServiceManager): Booting oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
12392025-01-27T09:31:00.305ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1990e07a-cfb7-436f-b017-73d119d10c34/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='82371938-e2be-483c-ad60-5dbb263b9904'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12402025-01-27T09:31:00.306ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_423760c6-8db9-4b47-b42b-49adac69df39/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c0ccbe2b-85f0-4e3e-b0a7-ac5bf54b7064'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12412025-01-27T09:31:00.306ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6395c924-dc0a-494e-a839-d2e146ec9f25'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12422025-01-27T09:31:00.306ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3879af65-27ae-439f-861c-67ca34b4edf2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cae33618-93ee-4221-a671-0203f123ce37'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12432025-01-27T09:31:00.306ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
12442025-01-27T09:31:00.347ZINFOSledAgent (ServiceManager): Booting oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
12452025-01-27T09:31:00.408ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
12462025-01-27T09:31:00.428ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
12472025-01-27T09:31:00.449ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c84dd39c-48bd-485c-a454-3b45b98846a6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12482025-01-27T09:31:00.449ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_57255367-8a48-44c0-b878-15bd0dd194f1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cbd03b02-890d-4b52-8a4d-1232492df02e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12492025-01-27T09:31:00.450ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
12502025-01-27T09:31:00.473ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
12512025-01-27T09:31:00.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 49.962297ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
12522025-01-27T09:31:00.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 30.690781ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
12532025-01-27T09:31:00.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 82.626623ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
12542025-01-27T09:31:00.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 127.106679ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
12552025-01-27T09:31:00.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 67.183714ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
12562025-01-27T09:31:00.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 70.415291ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
12572025-01-27T09:31:00.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 29.190784ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
12582025-01-27T09:31:00.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 226.275043ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
12592025-01-27T09:31:00.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 111.540333ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
12602025-01-27T09:31:00.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 35.892324ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
12612025-01-27T09:31:00.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 56.432981ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
12622025-01-27T09:31:01.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 140.659261ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
12632025-01-27T09:31:01.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 64.975037ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
12642025-01-27T09:31:01.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 60.822452ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
12652025-01-27T09:31:01.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 48.004687ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
12662025-01-27T09:31:01.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 119.375153ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
12672025-01-27T09:31:01.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 86.007499ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
12682025-01-27T09:31:01.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 61.57187ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
12692025-01-27T09:31:01.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 95.172231ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
12702025-01-27T09:31:01.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 285.392472ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
12712025-01-27T09:31:01.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 54.905612ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
12722025-01-27T09:31:01.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 270.043081ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
12732025-01-27T09:31:01.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 422.920016ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
12742025-01-27T09:31:01.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 239.404863ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
12752025-01-27T09:31:01.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 223.298343ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
12762025-01-27T09:31:01.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 221.587065ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
12772025-01-27T09:31:01.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 220.916015ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
12782025-01-27T09:31:01.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 213.741004ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
12792025-01-27T09:31:01.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 191.262504ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
12802025-01-27T09:31:01.365ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12812025-01-27T09:31:01.365ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
12822025-01-27T09:31:01.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 410.202062ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
12832025-01-27T09:31:01.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 684.288232ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
12842025-01-27T09:31:01.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 450.909948ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
12852025-01-27T09:31:01.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 295.698442ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
12862025-01-27T09:31:01.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 546.644916ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
12872025-01-27T09:31:01.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 417.701372ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
12882025-01-27T09:31:01.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 407.699301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
12892025-01-27T09:31:01.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 484.843409ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
12902025-01-27T09:31:01.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.117766956s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
12912025-01-27T09:31:01.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 68.50755ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
12922025-01-27T09:31:01.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 109.755666ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
12932025-01-27T09:31:01.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 934.305478ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
12942025-01-27T09:31:01.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 228.213146ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
12952025-01-27T09:31:01.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 442.836059ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
12962025-01-27T09:31:01.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 893.395133ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
12972025-01-27T09:31:01.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 852.875504ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
12982025-01-27T09:31:01.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 543.418211ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
12992025-01-27T09:31:02.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 740.764805ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
13002025-01-27T09:31:02.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 712.734371ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
13012025-01-27T09:31:02.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 494.37469ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
13022025-01-27T09:31:02.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 713.66826ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
13032025-01-27T09:31:02.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.168972683s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
13042025-01-27T09:31:02.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 602.652784ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
13052025-01-27T09:31:02.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 816.04216ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
13062025-01-27T09:31:02.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.42232267s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
13072025-01-27T09:31:02.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.128857457s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
13082025-01-27T09:31:02.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.350056906s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
13092025-01-27T09:31:02.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.174937479s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
13102025-01-27T09:31:02.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.347900835s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
13112025-01-27T09:31:02.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.338039495s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
13122025-01-27T09:31:02.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.047243419s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
13132025-01-27T09:31:03.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.435700392s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
13142025-01-27T09:31:03.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 515.389099ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
13152025-01-27T09:31:03.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.371580085s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
13162025-01-27T09:31:03.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 848.156987ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
13172025-01-27T09:31:03.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.215498939s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
13182025-01-27T09:31:03.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.426476591s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
13192025-01-27T09:31:04.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.101460903s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
13202025-01-27T09:31:04.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 615.043521ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
13212025-01-27T09:31:04.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 514.248792ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
13222025-01-27T09:31:04.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.123918111s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
13232025-01-27T09:31:04.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.446449811s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
13242025-01-27T09:31:04.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 801.697664ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
13252025-01-27T09:31:04.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 601.300306ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
13262025-01-27T09:31:04.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.372821816s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
13272025-01-27T09:31:04.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 670.400826ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
13282025-01-27T09:31:04.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.442140233s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
13292025-01-27T09:31:05.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 663.929072ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
13302025-01-27T09:31:05.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.416400529s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
13312025-01-27T09:31:05.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.483875704s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
13322025-01-27T09:31:05.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.061824491s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
13332025-01-27T09:31:05.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.473946166s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
13342025-01-27T09:31:05.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 826.785494ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
13352025-01-27T09:31:05.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 617.634689ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
13362025-01-27T09:31:05.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.238400893s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
13372025-01-27T09:31:05.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.287172782s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
13382025-01-27T09:31:06.061ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13392025-01-27T09:31:06.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.308572463s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
13402025-01-27T09:31:06.106ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
13412025-01-27T09:31:06.117ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422025-01-27T09:31:06.139ZINFOSledAgent (ServiceManager): Booting oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
13432025-01-27T09:31:06.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.136732958s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
13442025-01-27T09:31:06.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.336149722s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
13452025-01-27T09:31:06.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 49.643742ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
13462025-01-27T09:31:06.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 585.125506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
13472025-01-27T09:31:06.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 145.03298ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
13482025-01-27T09:31:06.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 52.108554ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
13492025-01-27T09:31:06.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.190375757s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
13502025-01-27T09:31:06.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 102.973489ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
13512025-01-27T09:31:06.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 119.899215ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
13522025-01-27T09:31:06.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 283.00301ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
13532025-01-27T09:31:06.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.069925139s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
13542025-01-27T09:31:06.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 245.894394ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
13552025-01-27T09:31:06.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.021731137s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
13562025-01-27T09:31:06.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 207.120555ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
13572025-01-27T09:31:06.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 528.824214ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
13582025-01-27T09:31:06.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 777.706546ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
13592025-01-27T09:31:06.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 573.798377ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
13602025-01-27T09:31:06.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 524.446446ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
13612025-01-27T09:31:07.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.013240142s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
13622025-01-27T09:31:07.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 643.498496ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
13632025-01-27T09:31:07.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 673.538835ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
13642025-01-27T09:31:07.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 983.758223ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
13652025-01-27T09:31:07.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 519.582281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
13662025-01-27T09:31:07.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 647.389381ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
13672025-01-27T09:31:07.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.220304397s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
13682025-01-27T09:31:07.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.152138948s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
13692025-01-27T09:31:07.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.087738595s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
13702025-01-27T09:31:07.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.484469575s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
13712025-01-27T09:31:07.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.419238643s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
13722025-01-27T09:31:07.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.288570467s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
13732025-01-27T09:31:07.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 701.421934ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
13742025-01-27T09:31:08.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.05133538s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
13752025-01-27T09:31:08.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 796.326589ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
13762025-01-27T09:31:08.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.271536494s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
13772025-01-27T09:31:08.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.38606341s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
13782025-01-27T09:31:08.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.372737781s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
13792025-01-27T09:31:08.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 510.619517ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
13802025-01-27T09:31:08.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.311963951s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
13812025-01-27T09:31:08.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.061470699s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
13822025-01-27T09:31:08.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 509.868821ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
13832025-01-27T09:31:08.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 918.183963ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
13842025-01-27T09:31:08.830ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13852025-01-27T09:31:08.830ZINFOSledAgent (ServiceManager): Booting oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
13862025-01-27T09:31:09.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 51.295205ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
13872025-01-27T09:31:09.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 829.937629ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
13882025-01-27T09:31:09.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 899.523657ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
13892025-01-27T09:31:09.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 759.700583ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
13902025-01-27T09:31:09.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 93.741958ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
13912025-01-27T09:31:09.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 934.850554ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
13922025-01-27T09:31:09.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 815.330732ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
13932025-01-27T09:31:09.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 103.764456ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
13942025-01-27T09:31:09.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 977.535909ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
13952025-01-27T09:31:09.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 441.400072ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
13962025-01-27T09:31:09.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 560.769986ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
13972025-01-27T09:31:09.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.478846515s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
13982025-01-27T09:31:09.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.158372587s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
13992025-01-27T09:31:09.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 494.785545ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
14002025-01-27T09:31:09.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 715.944658ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
14012025-01-27T09:31:09.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 599.445714ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
14022025-01-27T09:31:09.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 889.917564ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
14032025-01-27T09:31:09.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.057574808s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
14042025-01-27T09:31:09.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 583.513128ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
14052025-01-27T09:31:09.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 959.40281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
14062025-01-27T09:31:10.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 760.191085ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
14072025-01-27T09:31:10.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 737.487147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
14082025-01-27T09:31:10.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.146660838s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
14092025-01-27T09:31:10.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 732.901381ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
14102025-01-27T09:31:10.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.436155011s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
14112025-01-27T09:31:10.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 779.35682ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
14122025-01-27T09:31:10.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.407861232s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
14132025-01-27T09:31:10.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 562.58995ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
14142025-01-27T09:31:10.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.060594478s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
14152025-01-27T09:31:10.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 579.659199ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
14162025-01-27T09:31:10.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 657.828497ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
14172025-01-27T09:31:10.830ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='216f1c06-c6fe-48e2-812c-522c4d5eb20a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14182025-01-27T09:31:10.859ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
14192025-01-27T09:31:10.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 578.926644ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
14202025-01-27T09:31:10.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 981.247881ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
14212025-01-27T09:31:10.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.240643576s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
14222025-01-27T09:31:10.965ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14232025-01-27T09:31:10.965ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
14242025-01-27T09:31:11.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 768.971662ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
14252025-01-27T09:31:11.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 530.963159ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
14262025-01-27T09:31:11.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 944.431725ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
14272025-01-27T09:31:11.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 60.468447ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
14282025-01-27T09:31:11.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 63.114909ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
14292025-01-27T09:31:11.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 112.433272ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
14302025-01-27T09:31:11.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 100.210942ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
14312025-01-27T09:31:11.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 777.319855ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
14322025-01-27T09:31:11.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 731.583111ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
14332025-01-27T09:31:11.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 136.273997ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
14342025-01-27T09:31:11.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 255.019971ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
14352025-01-27T09:31:11.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 760.139954ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
14362025-01-27T09:31:11.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.169450676s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
14372025-01-27T09:31:11.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 358.90815ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
14382025-01-27T09:31:11.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 679.569813ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
14392025-01-27T09:31:11.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 763.365731ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
14402025-01-27T09:31:11.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 399.071621ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
14412025-01-27T09:31:11.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 784.328887ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
14422025-01-27T09:31:11.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 946.547849ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
14432025-01-27T09:31:11.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 666.303807ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
14442025-01-27T09:31:11.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 539.601498ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
14452025-01-27T09:31:11.941ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.095781663s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
14462025-01-27T09:31:11.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 719.82787ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
14472025-01-27T09:31:11.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 667.360539ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
14482025-01-27T09:31:11.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.467248919s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
14492025-01-27T09:31:12.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 543.696475ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
14502025-01-27T09:31:12.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.098082471s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
14512025-01-27T09:31:12.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 634.081962ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
14522025-01-27T09:31:12.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 872.862839ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
14532025-01-27T09:31:12.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.467457203s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
14542025-01-27T09:31:12.206ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='68bb99eb-b4ab-4082-991e-b4bbc97b38df'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14552025-01-27T09:31:12.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.092654992s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
14562025-01-27T09:31:12.216ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
14572025-01-27T09:31:12.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 658.204705ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
14582025-01-27T09:31:12.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 56.013615ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
14592025-01-27T09:31:12.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.397415745s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
14602025-01-27T09:31:12.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 124.493554ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
14612025-01-27T09:31:12.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.428652371s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
14622025-01-27T09:31:12.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.458107248s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
14632025-01-27T09:31:12.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.168756928s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
14642025-01-27T09:31:12.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 137.625884ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
14652025-01-27T09:31:12.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.18011973s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
14662025-01-27T09:31:12.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 635.417877ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
14672025-01-27T09:31:12.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.205729995s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
14682025-01-27T09:31:12.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 269.969448ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
14692025-01-27T09:31:12.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.373619234s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
14702025-01-27T09:31:12.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 979.174518ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
14712025-01-27T09:31:12.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 454.972784ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
14722025-01-27T09:31:13.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 811.496774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
14732025-01-27T09:31:13.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.046738973s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
14742025-01-27T09:31:13.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.082868365s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
14752025-01-27T09:31:13.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 509.765893ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
14762025-01-27T09:31:13.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 549.172216ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
14772025-01-27T09:31:13.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.28640102s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
14782025-01-27T09:31:13.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 955.852865ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
14792025-01-27T09:31:13.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.34819584s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
14802025-01-27T09:31:13.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.10062854s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
14812025-01-27T09:31:13.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.077651412s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
14822025-01-27T09:31:13.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 613.344233ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
14832025-01-27T09:31:13.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 655.052655ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
14842025-01-27T09:31:13.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 948.643933ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
14852025-01-27T09:31:13.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.122130546s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
14862025-01-27T09:31:13.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 598.443464ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
14872025-01-27T09:31:13.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.472065996s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
14882025-01-27T09:31:13.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.085805149s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
14892025-01-27T09:31:13.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.106322252s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
14902025-01-27T09:31:14.029ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='eec82dbc-18ba-4cd8-8aab-5cbbe8859f04'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14912025-01-27T09:31:14.029ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
14922025-01-27T09:31:14.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.072343702s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
14932025-01-27T09:31:14.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.269486253s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
14942025-01-27T09:31:14.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.216024725s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
14952025-01-27T09:31:14.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 31.996329ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
14962025-01-27T09:31:14.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 77.343143ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
14972025-01-27T09:31:14.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.454442152s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
14982025-01-27T09:31:14.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 297.509494ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
14992025-01-27T09:31:14.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.235588043s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
15002025-01-27T09:31:14.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 858.907854ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
15012025-01-27T09:31:14.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.089787366s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
15022025-01-27T09:31:14.709ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15032025-01-27T09:31:14.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 525.51799ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
15042025-01-27T09:31:14.745ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15052025-01-27T09:31:14.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.342575731s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
15062025-01-27T09:31:14.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 678.411984ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
15072025-01-27T09:31:14.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.197413078s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
15082025-01-27T09:31:14.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.133648171s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
15092025-01-27T09:31:14.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 33.657586ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15102025-01-27T09:31:14.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.301970422s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
15112025-01-27T09:31:14.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 57.349673ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15122025-01-27T09:31:15.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 919.177977ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
15132025-01-27T09:31:15.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 233.977189ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15142025-01-27T09:31:15.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.060869566s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
15152025-01-27T09:31:15.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.024402829s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
15162025-01-27T09:31:15.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 950.171243ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
15172025-01-27T09:31:15.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.026049731s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
15182025-01-27T09:31:15.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 409.832867ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15192025-01-27T09:31:15.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 706.328692ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
15202025-01-27T09:31:15.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.321870699s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
15212025-01-27T09:31:15.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.027273321s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
15222025-01-27T09:31:15.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.129038177s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
15232025-01-27T09:31:15.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 576.404264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
15242025-01-27T09:31:15.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 681.223931ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
15252025-01-27T09:31:15.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 516.943786ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
15262025-01-27T09:31:15.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 963.318202ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15272025-01-27T09:31:15.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.201796077s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
15282025-01-27T09:31:15.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.338740004s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
15292025-01-27T09:31:15.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 988.460458ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
15302025-01-27T09:31:16.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 899.285698ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
15312025-01-27T09:31:16.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.177390554s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
15322025-01-27T09:31:16.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.01929521s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
15332025-01-27T09:31:16.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.348802638s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
15342025-01-27T09:31:16.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.046302311s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
15352025-01-27T09:31:16.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 883.751258ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
15362025-01-27T09:31:16.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 996.417571ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
15372025-01-27T09:31:16.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.437505422s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
15382025-01-27T09:31:16.226ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36369
15392025-01-27T09:31:16.287ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 13494 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36369 req_id = ae77624e-7945-4e3f-ad6e-1c9b3612fc85 response_code = 200 uri = /baseboard
15402025-01-27T09:31:16.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 683.985304ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
15412025-01-27T09:31:16.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 524.46093ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
15422025-01-27T09:31:16.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 831.404289ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
15432025-01-27T09:31:16.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.327980979s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
15442025-01-27T09:31:16.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 975.350815ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
15452025-01-27T09:31:16.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 569.424922ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15462025-01-27T09:31:16.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 837.195576ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
15472025-01-27T09:31:16.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.032383006s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
15482025-01-27T09:31:16.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.290753174s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
15492025-01-27T09:31:16.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 594.956802ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
15502025-01-27T09:31:16.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.299104585s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
15512025-01-27T09:31:17.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 600.574591ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
15522025-01-27T09:31:17.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.047692171s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
15532025-01-27T09:31:17.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 598.729813ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
15542025-01-27T09:31:17.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.461149693s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
15552025-01-27T09:31:17.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 595.815083ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
15562025-01-27T09:31:17.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 964.302881ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
15572025-01-27T09:31:17.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.065335257s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
15582025-01-27T09:31:17.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 597.881442ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15592025-01-27T09:31:17.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 843.392925ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
15602025-01-27T09:31:17.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 851.748719ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
15612025-01-27T09:31:17.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 897.513164ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
15622025-01-27T09:31:17.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 525.692072ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
15632025-01-27T09:31:17.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.099658955s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
15642025-01-27T09:31:17.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 504.065663ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
15652025-01-27T09:31:17.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.061916762s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
15662025-01-27T09:31:17.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.0440745s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
15672025-01-27T09:31:17.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.014484514s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
15682025-01-27T09:31:17.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 775.523981ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
15692025-01-27T09:31:17.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 524.251102ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
15702025-01-27T09:31:17.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 980.468274ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15712025-01-27T09:31:18.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 636.266982ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
15722025-01-27T09:31:18.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 912.882682ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
15732025-01-27T09:31:18.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.072746659s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
15742025-01-27T09:31:18.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.404664208s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
15752025-01-27T09:31:18.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.420306476s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
15762025-01-27T09:31:18.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 755.132379ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
15772025-01-27T09:31:18.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.231225931s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
15782025-01-27T09:31:18.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.378992439s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
15792025-01-27T09:31:18.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.333768078s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
15802025-01-27T09:31:18.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.387611004s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
15812025-01-27T09:31:18.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 755.587345ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
15822025-01-27T09:31:18.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 573.789925ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
15832025-01-27T09:31:18.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 833.269612ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
15842025-01-27T09:31:18.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 766.576449ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
15852025-01-27T09:31:18.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 876.052262ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
15862025-01-27T09:31:18.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.170371173s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
15872025-01-27T09:31:18.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 998.722737ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
15882025-01-27T09:31:18.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 672.814716ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
15892025-01-27T09:31:18.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 1.296452149s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
15902025-01-27T09:31:19.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 926.00443ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
15912025-01-27T09:31:19.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 533.068413ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
15922025-01-27T09:31:19.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.396425026s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
15932025-01-27T09:31:19.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.470516574s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
15942025-01-27T09:31:19.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 832.738911ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
15952025-01-27T09:31:19.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 906.726013ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
15962025-01-27T09:31:19.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 711.174219ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
15972025-01-27T09:31:19.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 875.417305ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
15982025-01-27T09:31:19.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.454408377s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
15992025-01-27T09:31:19.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.040048445s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
16002025-01-27T09:31:19.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.336470807s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
16012025-01-27T09:31:19.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 582.147815ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
16022025-01-27T09:31:19.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.315785788s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
16032025-01-27T09:31:19.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.078673646s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
16042025-01-27T09:31:19.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.277953598s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
16052025-01-27T09:31:19.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 982.586152ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
16062025-01-27T09:31:19.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 751.620248ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
16072025-01-27T09:31:19.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 854.556319ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
16082025-01-27T09:31:19.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 937.589154ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
16092025-01-27T09:31:20.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 763.66927ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
16102025-01-27T09:31:20.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 1.292912819s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
16112025-01-27T09:31:20.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 740.158794ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
16122025-01-27T09:31:20.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 818.175228ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
16132025-01-27T09:31:20.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.053724584s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
16142025-01-27T09:31:20.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 815.871975ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
16152025-01-27T09:31:20.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.364038302s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
16162025-01-27T09:31:20.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.208742379s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
16172025-01-27T09:31:20.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.242014644s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
16182025-01-27T09:31:20.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 803.915111ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
16192025-01-27T09:31:20.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 711.155082ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
16202025-01-27T09:31:20.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 568.786529ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
16212025-01-27T09:31:20.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.362308445s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
16222025-01-27T09:31:20.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.459332682s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
16232025-01-27T09:31:20.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 744.173295ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
16242025-01-27T09:31:20.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.203614836s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
16252025-01-27T09:31:20.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 763.445653ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
16262025-01-27T09:31:20.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 835.867054ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
16272025-01-27T09:31:21.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.119692408s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
16282025-01-27T09:31:21.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 920.924903ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
16292025-01-27T09:31:21.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 956.514495ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
16302025-01-27T09:31:21.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 766.656028ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
16312025-01-27T09:31:21.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.02412323s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
16322025-01-27T09:31:21.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 812.644474ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
16332025-01-27T09:31:21.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 710.611086ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
16342025-01-27T09:31:21.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 644.147564ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
16352025-01-27T09:31:21.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.013222113s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
16362025-01-27T09:31:21.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.256739451s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
16372025-01-27T09:31:21.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 822.77313ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
16382025-01-27T09:31:21.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 652.223883ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
16392025-01-27T09:31:21.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.050487651s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
16402025-01-27T09:31:21.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.024930259s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
16412025-01-27T09:31:21.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.056915632s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
16422025-01-27T09:31:21.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 936.856579ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
16432025-01-27T09:31:21.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.231465271s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
16442025-01-27T09:31:22.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 864.061519ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
16452025-01-27T09:31:22.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 558.388615ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
16462025-01-27T09:31:22.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.101154103s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
16472025-01-27T09:31:22.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.47007693s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
16482025-01-27T09:31:22.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 661.954188ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
16492025-01-27T09:31:22.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 1.110906642s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
16502025-01-27T09:31:22.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 983.897617ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
16512025-01-27T09:31:22.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 506.201492ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
16522025-01-27T09:31:22.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.298875s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
16532025-01-27T09:31:22.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.030897883s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
16542025-01-27T09:31:22.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 864.452041ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
16552025-01-27T09:31:22.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 915.729985ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
16562025-01-27T09:31:22.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 691.43165ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
16572025-01-27T09:31:22.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 867.646492ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
16582025-01-27T09:31:22.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 751.645866ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
16592025-01-27T09:31:22.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 978.263793ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
16602025-01-27T09:31:22.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 520.809204ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
16612025-01-27T09:31:22.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.060342781s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
16622025-01-27T09:31:22.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.215713241s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
16632025-01-27T09:31:22.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 613.133248ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
16642025-01-27T09:31:22.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.265175641s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
16652025-01-27T09:31:23.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.186364719s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
16662025-01-27T09:31:23.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 506.899147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
16672025-01-27T09:31:23.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 753.475483ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
16682025-01-27T09:31:23.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 898.341405ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
16692025-01-27T09:31:23.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.10079402s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
16702025-01-27T09:31:23.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 541.127686ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
16712025-01-27T09:31:23.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.220851869s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
16722025-01-27T09:31:23.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 949.245986ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
16732025-01-27T09:31:23.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 740.748839ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
16742025-01-27T09:31:23.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 652.414163ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
16752025-01-27T09:31:23.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.398432274s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
16762025-01-27T09:31:23.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.007328592s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
16772025-01-27T09:31:23.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.499746752s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
16782025-01-27T09:31:23.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.303111736s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
16792025-01-27T09:31:23.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.09812597s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
16802025-01-27T09:31:23.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.073684935s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
16812025-01-27T09:31:23.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 810.193873ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
16822025-01-27T09:31:23.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.394284052s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
16832025-01-27T09:31:24.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 576.065485ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
16842025-01-27T09:31:24.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.080707704s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
16852025-01-27T09:31:24.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.329102118s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
16862025-01-27T09:31:24.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 649.108668ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
16872025-01-27T09:31:24.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 967.891686ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
16882025-01-27T09:31:24.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 552.795587ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
16892025-01-27T09:31:24.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 645.370643ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
16902025-01-27T09:31:24.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.21092031s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
16912025-01-27T09:31:24.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 534.644647ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
16922025-01-27T09:31:24.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 758.002987ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
16932025-01-27T09:31:24.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.117229759s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
16942025-01-27T09:31:24.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 632.025662ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
16952025-01-27T09:31:24.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.107781043s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
16962025-01-27T09:31:24.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.308029628s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
16972025-01-27T09:31:24.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.19204259s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
16982025-01-27T09:31:24.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 577.684456ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
16992025-01-27T09:31:24.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.359120705s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
17002025-01-27T09:31:25.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 687.833357ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
17012025-01-27T09:31:25.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 886.362579ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
17022025-01-27T09:31:25.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 815.699139ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
17032025-01-27T09:31:25.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.286682875s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
17042025-01-27T09:31:25.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 891.434909ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
17052025-01-27T09:31:25.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.478954349s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
17062025-01-27T09:31:25.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 576.986374ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
17072025-01-27T09:31:25.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 713.748788ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
17082025-01-27T09:31:25.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.094687693s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
17092025-01-27T09:31:25.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.400321389s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
17102025-01-27T09:31:25.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 643.220956ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
17112025-01-27T09:31:25.485ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
17122025-01-27T09:31:25.505ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
17132025-01-27T09:31:25.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 883.606397ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
17142025-01-27T09:31:25.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 627.754602ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
17152025-01-27T09:31:25.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 904.539861ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
17162025-01-27T09:31:25.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 72.194181ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
17172025-01-27T09:31:25.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.325780712s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
17182025-01-27T09:31:25.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 102.428185ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
17192025-01-27T09:31:25.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 657.062079ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
17202025-01-27T09:31:25.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 907.909367ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
17212025-01-27T09:31:25.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.36651686s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
17222025-01-27T09:31:25.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 238.864712ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
17232025-01-27T09:31:26.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.222069841s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
17242025-01-27T09:31:26.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.074285359s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
17252025-01-27T09:31:26.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 777.81562ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
17262025-01-27T09:31:26.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.143132429s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
17272025-01-27T09:31:26.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 891.624883ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
17282025-01-27T09:31:26.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.09912449s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
17292025-01-27T09:31:26.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 330.693338ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
17302025-01-27T09:31:26.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.159533109s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
17312025-01-27T09:31:26.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.086084033s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
17322025-01-27T09:31:26.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.400461105s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
17332025-01-27T09:31:26.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 662.746996ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
17342025-01-27T09:31:26.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 567.116496ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
17352025-01-27T09:31:26.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 610.688431ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
17362025-01-27T09:31:26.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 422.947456ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
17372025-01-27T09:31:26.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.336998319s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
17382025-01-27T09:31:26.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 646.520094ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
17392025-01-27T09:31:26.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 557.318557ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
17402025-01-27T09:31:26.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.390261035s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
17412025-01-27T09:31:26.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 780.186458ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
17422025-01-27T09:31:27.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 830.491498ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
17432025-01-27T09:31:27.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 831.087484ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
17442025-01-27T09:31:27.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 850.915455ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
17452025-01-27T09:31:27.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.30509676s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
17462025-01-27T09:31:27.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.244067633s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
17472025-01-27T09:31:27.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 861.585545ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
17482025-01-27T09:31:27.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 525.793272ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
17492025-01-27T09:31:27.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.104109844s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
17502025-01-27T09:31:27.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 710.147751ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
17512025-01-27T09:31:27.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 962.078242ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
17522025-01-27T09:31:27.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 580.948195ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
17532025-01-27T09:31:27.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.413581984s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
17542025-01-27T09:31:27.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 879.58272ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
17552025-01-27T09:31:27.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 826.631739ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
17562025-01-27T09:31:27.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 699.874033ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
17572025-01-27T09:31:27.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 773.359969ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
17582025-01-27T09:31:27.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.128491384s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
17592025-01-27T09:31:27.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.427456029s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
17602025-01-27T09:31:27.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 883.036939ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
17612025-01-27T09:31:27.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 704.575556ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
17622025-01-27T09:31:27.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 1.392636689s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
17632025-01-27T09:31:27.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.33923307s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
17642025-01-27T09:31:27.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.452284567s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
17652025-01-27T09:31:28.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.469978038s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
17662025-01-27T09:31:28.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 913.173751ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
17672025-01-27T09:31:28.075ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.587459754s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
17682025-01-27T09:31:28.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.22470641s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
17692025-01-27T09:31:28.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 859.495551ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
17702025-01-27T09:31:28.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 607.54408ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
17712025-01-27T09:31:28.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 526.11134ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
17722025-01-27T09:31:28.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 958.496795ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
17732025-01-27T09:31:28.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.366935011s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
17742025-01-27T09:31:28.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.487980332s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
17752025-01-27T09:31:28.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.43183083s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
17762025-01-27T09:31:28.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.169845348s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
17772025-01-27T09:31:28.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 754.650298ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
17782025-01-27T09:31:28.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 1.292108395s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
17792025-01-27T09:31:28.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.249012988s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
17802025-01-27T09:31:28.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 613.033245ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
17812025-01-27T09:31:28.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 853.1804ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
17822025-01-27T09:31:28.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 839.330343ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
17832025-01-27T09:31:28.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.201975356s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
17842025-01-27T09:31:29.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 672.616329ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
17852025-01-27T09:31:29.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.140763205s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
17862025-01-27T09:31:29.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 514.385862ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
17872025-01-27T09:31:29.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 990.69842ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
17882025-01-27T09:31:29.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 1.385185972s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
17892025-01-27T09:31:29.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.017083677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
17902025-01-27T09:31:29.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 857.39645ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
17912025-01-27T09:31:29.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 548.016152ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
17922025-01-27T09:31:29.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 974.913197ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
17932025-01-27T09:31:29.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 990.847409ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
17942025-01-27T09:31:29.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 1.105228635s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
17952025-01-27T09:31:29.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.486831074s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
17962025-01-27T09:31:29.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.025155172s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
17972025-01-27T09:31:29.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 629.460082ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
17982025-01-27T09:31:29.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.091497099s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
17992025-01-27T09:31:29.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.16662439s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
18002025-01-27T09:31:29.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.011414916s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
18012025-01-27T09:31:29.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 661.681555ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
18022025-01-27T09:31:30.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 806.730885ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
18032025-01-27T09:31:30.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 1.441096901s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
18042025-01-27T09:31:30.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 618.121703ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
18052025-01-27T09:31:30.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 924.585504ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
18062025-01-27T09:31:30.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 893.529554ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
18072025-01-27T09:31:30.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 556.332292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
18082025-01-27T09:31:30.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.114857727s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
18092025-01-27T09:31:30.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 862.070945ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
18102025-01-27T09:31:30.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 1.227772193s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
18112025-01-27T09:31:30.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21") failed: Property not found. retry in 1.402871639s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
18122025-01-27T09:31:30.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.437257338s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
18132025-01-27T09:31:30.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 950.957601ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
18142025-01-27T09:31:30.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.129511184s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
18152025-01-27T09:31:30.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 650.856225ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
18162025-01-27T09:31:30.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 994.759536ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
18172025-01-27T09:31:30.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 661.204192ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
18182025-01-27T09:31:30.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.117088751s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
18192025-01-27T09:31:30.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.08905147s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
18202025-01-27T09:31:30.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.226671199s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
18212025-01-27T09:31:30.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 516.68242ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
18222025-01-27T09:31:31.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447") failed: Property not found. retry in 1.070469424s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
18232025-01-27T09:31:31.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 1.493484572s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
18242025-01-27T09:31:31.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.234260513s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
18252025-01-27T09:31:31.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 815.790696ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
18262025-01-27T09:31:31.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.477729125s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
18272025-01-27T09:31:31.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 676.561225ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
18282025-01-27T09:31:31.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.084241477s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
18292025-01-27T09:31:31.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 828.840798ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
18302025-01-27T09:31:31.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 1.305360613s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
18312025-01-27T09:31:31.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 956.441592ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
18322025-01-27T09:31:31.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 578.698244ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
18332025-01-27T09:31:31.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 526.316449ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
18342025-01-27T09:31:31.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 718.766155ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
18352025-01-27T09:31:31.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df") failed: Property not found. retry in 1.486963061s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
18362025-01-27T09:31:31.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.239558974s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
18372025-01-27T09:31:32.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.248073391s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
18382025-01-27T09:31:32.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832") failed: Property not found. retry in 1.366622942s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
18392025-01-27T09:31:32.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e") failed: Property not found. retry in 1.291270649s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
18402025-01-27T09:31:32.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 1.070217466s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
18412025-01-27T09:31:32.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 1.040278416s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
18422025-01-27T09:31:32.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629") failed: Property not found. retry in 1.008766023s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
18432025-01-27T09:31:32.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e") failed: Property not found. retry in 779.959035ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
18442025-01-27T09:31:32.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938") failed: Property not found. retry in 1.179977362s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
18452025-01-27T09:31:32.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa") failed: Property not found. retry in 1.298858051s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
18462025-01-27T09:31:32.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377") failed: Property not found. retry in 768.306191ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
18472025-01-27T09:31:32.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3") failed: Property not found. retry in 1.257489563s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
18482025-01-27T09:31:32.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c") failed: Property not found. retry in 1.142358936s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
18492025-01-27T09:31:32.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f") failed: Property not found. retry in 928.421328ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
18502025-01-27T09:31:32.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180") failed: Property not found. retry in 1.354219268s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
18512025-01-27T09:31:32.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 1.424042759s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
18522025-01-27T09:31:33.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97") failed: Property not found. retry in 1.075181485s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
18532025-01-27T09:31:33.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b") failed: Property not found. retry in 611.718619ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
18542025-01-27T09:31:33.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb") failed: Property not found. retry in 1.005769805s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
18552025-01-27T09:31:33.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41") failed: Property not found. retry in 1.303532306s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
18562025-01-27T09:31:34.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 1.010130702s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
18572025-01-27T09:31:35.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 620.921839ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
18582025-01-27T09:31:35.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86") failed: Property not found. retry in 1.184108146s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
18592025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_8cef54b0-4bf2-424c-b374-5b9e9f682832
18602025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_1283cfe5-16ee-4e4b-b00b-94393a95c90e
18612025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_68bb99eb-b4ab-4082-991e-b4bbc97b38df
18622025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_10f866cd-9998-4a8e-b593-06f125e33b86
18632025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_2e459145-50ff-4cfb-99c9-4cf21ad624bb
18642025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_a15e36e8-b39a-414b-9d9d-d9079f61ed97
18652025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_cb84c3cf-3cf9-44e2-9979-05dfad6e4629
18662025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_1a51ed25-62e8-4e11-8d4e-27a2a38a2e41
18672025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_973be945-abc3-45ec-9b5d-b6b0e143999f
18682025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_38339a12-b1a8-49b8-a1a9-3eea1fc5d180
18692025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_31e6d238-77dc-443c-83f4-2b834aaac06c
18702025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_172bb22d-a56f-4207-a308-9a2e907f4938
18712025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_5e4034d0-68b1-4e4d-8344-e580c4275afa
18722025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_a85ef0f0-1ab9-4261-827f-33c1bd759c5b
18732025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_471072d1-1074-4ce4-8624-5eb1eb666447
18742025-01-27T09:31:37.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_7812e930-d4de-4299-b2fd-679d77249377
18752025-01-27T09:31:37.190ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_4e71d602-200b-41e9-aad4-e3ede9f1e1e3
18762025-01-27T09:31:37.190ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_53993421-f481-40aa-a8d8-e0726be87c21
18772025-01-27T09:31:37.190ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_ca2b963a-a4d3-4a39-ae4d-ae7b078b215e
18782025-01-27T09:31:37.192ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18792025-01-27T09:31:37.194ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18802025-01-27T09:31:37.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41435458 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49998 req_id = 3091bebe-e4d6-4299-b077-27b3ee4ce21a response_code = 204 uri = /omicron-zones
18812025-01-27T09:31:37.201ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
18822025-01-27T09:31:37.205ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18832025-01-27T09:31:37.210ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:803
18842025-01-27T09:31:37.243ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
18852025-01-27T09:31:37.250ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18862025-01-27T09:31:37.385ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18872025-01-27T09:31:37.488ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18882025-01-27T09:31:37.588ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18892025-01-27T09:31:37.685ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18902025-01-27T09:31:37.923ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18912025-01-27T09:31:38.237ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18922025-01-27T09:31:38.406ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18932025-01-27T09:31:38.615ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.495324074s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
18942025-01-27T09:31:38.700ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18952025-01-27T09:31:38.997ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8bd5c2bd-3419-4a68-ac55-258db5ea6152/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18962025-01-27T09:31:40.533ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "bdb20e7f-dac6-449f-926f-2370f61c1c14", "content-length": "113", "date": "Mon, 27 Jan 2025 09:31:40 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "bdb20e7f-dac6-449f-926f-2370f61c1c14" } file = sled-agent/src/rack_setup/service.rs:1079
18972025-01-27T09:31:41.969ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "533bdd6d-a259-41e0-8498-e3ceb5d7dec2", "content-length": "173", "date": "Mon, 27 Jan 2025 09:31:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8bd5c2bd-3419-4a68-ac55-258db5ea6152\"", request_id: "533bdd6d-a259-41e0-8498-e3ceb5d7dec2" } file = sled-agent/src/rack_setup/service.rs:1079
18982025-01-27T09:31:42.996ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d4aa67f8-550b-4a5d-bd23-10052d9ad9cc", "content-length": "173", "date": "Mon, 27 Jan 2025 09:31:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8bd5c2bd-3419-4a68-ac55-258db5ea6152\"", request_id: "d4aa67f8-550b-4a5d-bd23-10052d9ad9cc" } file = sled-agent/src/rack_setup/service.rs:1079
18992025-01-27T09:31:44.844ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f90d78c7-40fb-49d3-b85b-59dbbf2d97e1", "content-length": "173", "date": "Mon, 27 Jan 2025 09:31:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d4e670d1-037a-4b75-80e2-234f2762bd9e\"", request_id: "f90d78c7-40fb-49d3-b85b-59dbbf2d97e1" } file = sled-agent/src/rack_setup/service.rs:1079
19002025-01-27T09:31:45.776ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c1748704-5251-4369-b9cf-e7cf9b78e261", "content-length": "173", "date": "Mon, 27 Jan 2025 09:31:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d4e670d1-037a-4b75-80e2-234f2762bd9e\"", request_id: "c1748704-5251-4369-b9cf-e7cf9b78e261" } file = sled-agent/src/rack_setup/service.rs:1079
19012025-01-27T09:31:46.320ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59399
19022025-01-27T09:31:46.320ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59399 req_id = afbf3ef7-c7ae-4a19-a65f-764f74ff28d3 response_code = 200 uri = /baseboard
19032025-01-27T09:31:47.818ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "941bca66-6d83-4bbf-88ed-259bb39305e5", "content-length": "173", "date": "Mon, 27 Jan 2025 09:31:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d4e670d1-037a-4b75-80e2-234f2762bd9e\"", request_id: "941bca66-6d83-4bbf-88ed-259bb39305e5" } file = sled-agent/src/rack_setup/service.rs:1079
19042025-01-27T09:31:49.272ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9997cbbf-845b-443b-91e7-85df86445b0d", "content-length": "173", "date": "Mon, 27 Jan 2025 09:31:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d4e670d1-037a-4b75-80e2-234f2762bd9e\"", request_id: "9997cbbf-845b-443b-91e7-85df86445b0d" } file = sled-agent/src/rack_setup/service.rs:1079
19052025-01-27T09:31:50.986ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2c740531-3ddd-45d1-8da4-2e9ae2bbecb8", "content-length": "173", "date": "Mon, 27 Jan 2025 09:31:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d4e670d1-037a-4b75-80e2-234f2762bd9e\"", request_id: "2c740531-3ddd-45d1-8da4-2e9ae2bbecb8" } file = sled-agent/src/rack_setup/service.rs:1079
19062025-01-27T09:31:53.284ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "15c0a5e8-962b-4c1f-a40f-c10b4cf8c1c7", "content-length": "173", "date": "Mon, 27 Jan 2025 09:31:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d4e670d1-037a-4b75-80e2-234f2762bd9e\"", request_id: "15c0a5e8-962b-4c1f-a40f-c10b4cf8c1c7" } file = sled-agent/src/rack_setup/service.rs:1079
19072025-01-27T09:31:57.588ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c79d0e01-51df-4213-8c15-95b116ef8e91", "content-length": "173", "date": "Mon, 27 Jan 2025 09:31:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d4e670d1-037a-4b75-80e2-234f2762bd9e\"", request_id: "c79d0e01-51df-4213-8c15-95b116ef8e91" } file = sled-agent/src/rack_setup/service.rs:1079
19082025-01-27T09:32:02.537ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "047c95d8-4b74-4a1c-ad81-522b795fffdc", "content-length": "173", "date": "Mon, 27 Jan 2025 09:32:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d4e670d1-037a-4b75-80e2-234f2762bd9e\"", request_id: "047c95d8-4b74-4a1c-ad81-522b795fffdc" } file = sled-agent/src/rack_setup/service.rs:1079
19092025-01-27T09:32:05.648ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "33c245cc-ec59-4aa2-87c2-4f902918f608", "content-length": "173", "date": "Mon, 27 Jan 2025 09:32:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d4e670d1-037a-4b75-80e2-234f2762bd9e\"", request_id: "33c245cc-ec59-4aa2-87c2-4f902918f608" } file = sled-agent/src/rack_setup/service.rs:1079
19102025-01-27T09:32:07.874ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
19112025-01-27T09:32:08.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44252
19122025-01-27T09:32:08.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19132025-01-27T09:32:08.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19142025-01-27T09:32:08.194ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:177
19152025-01-27T09:32:08.196ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:177
19162025-01-27T09:32:08.207ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19172025-01-27T09:32:08.207ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0
19182025-01-27T09:32:08.228ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19192025-01-27T09:32:08.229ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1990e07a-cfb7-436f-b017-73d119d10c34
19202025-01-27T09:32:08.250ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19212025-01-27T09:32:08.250ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_423760c6-8db9-4b47-b42b-49adac69df39
19222025-01-27T09:32:08.271ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19232025-01-27T09:32:08.271ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe
19242025-01-27T09:32:08.294ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19252025-01-27T09:32:08.294ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57255367-8a48-44c0-b878-15bd0dd194f1
19262025-01-27T09:32:08.316ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19272025-01-27T09:32:08.316ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3879af65-27ae-439f-861c-67ca34b4edf2
19282025-01-27T09:32:08.339ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19292025-01-27T09:32:08.339ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55
19302025-01-27T09:32:08.360ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19312025-01-27T09:32:08.360ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a
19322025-01-27T09:32:08.381ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19332025-01-27T09:32:08.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9
19342025-01-27T09:32:08.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201666 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44252 req_id = 20f47899-0e1b-401b-817a-ffa902050e5e response_code = 200 uri = /inventory
19352025-01-27T09:32:12.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62508
19362025-01-27T09:32:12.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62508 req_id = 06656814-e133-4457-ae0b-565b8b4b4cef response_code = 200 uri = /vpc-routes
19372025-01-27T09:32:12.405ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
19382025-01-27T09:32:12.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62508 req_id = eff73e43-6870-489a-9c22-ad2334ed7891 response_code = 204 uri = /eip-gateways
19392025-01-27T09:32:12.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65005
19402025-01-27T09:32:12.471ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19412025-01-27T09:32:12.471ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19422025-01-27T09:32:12.471ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19432025-01-27T09:32:12.472ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19442025-01-27T09:32:12.472ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19452025-01-27T09:32:12.472ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19462025-01-27T09:32:12.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19472025-01-27T09:32:12.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65005 req_id = ed1122a3-16bb-4054-b691-dc46c945315a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19482025-01-27T09:32:12.474ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
19492025-01-27T09:32:12.479ZINFOSledAgent (RSS): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19502025-01-27T09:32:12.479ZINFOSledAgent (RSS): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19512025-01-27T09:32:12.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45587
19522025-01-27T09:32:12.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 807 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45587 req_id = 671e7f0f-45c7-4d03-9286-7329ed83a5cf response_code = 200 uri = /v2p
19532025-01-27T09:32:12.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47384
19542025-01-27T09:32:12.651ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19552025-01-27T09:32:12.776ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19562025-01-27T09:32:12.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221075 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47384 req_id = 534022a9-8f2a-4523-9d60-e1aa0e200e17 response_code = 204 uri = /switch-ports
19572025-01-27T09:32:12.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47384 req_id = 7d4879f8-14d3-47a3-82e5-c50dca2f294a response_code = 200 uri = /network-bootstore-config
19582025-01-27T09:32:12.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56198
19592025-01-27T09:32:12.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56198 req_id = a75bbbe7-03c5-43ec-883f-e020b5b2c465 response_code = 200 uri = /vpc-routes
19602025-01-27T09:32:12.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1696 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62508 req_id = 5deb8c04-5822-44a2-9174-8fe93be656f0 response_code = 204 uri = /vpc-routes
19612025-01-27T09:32:13.022ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
19622025-01-27T09:32:13.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56198 req_id = 0ef45df2-0613-4c5b-b36b-8173a414e604 response_code = 204 uri = /eip-gateways
19632025-01-27T09:32:13.078ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
19642025-01-27T09:32:13.078ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19652025-01-27T09:32:13.083ZINFOSledAgent (bootstore): Writing ledger to /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19662025-01-27T09:32:13.091ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
19672025-01-27T09:32:13.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 23390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47384 req_id = fb8e55c5-610b-4863-a1ba-069875828107 response_code = 204 uri = /network-bootstore-config
19682025-01-27T09:32:13.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58836
19692025-01-27T09:32:13.212ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19702025-01-27T09:32:13.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19712025-01-27T09:32:13.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19722025-01-27T09:32:13.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19732025-01-27T09:32:13.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19742025-01-27T09:32:13.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19752025-01-27T09:32:13.212ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19762025-01-27T09:32:13.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58836 req_id = ae460314-98b3-41e6-8a1b-8271cf3b9418 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19772025-01-27T09:32:13.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64706
19782025-01-27T09:32:13.213ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19792025-01-27T09:32:13.264ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19802025-01-27T09:32:13.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64706 req_id = b4fd9b7f-b7bf-4f39-a057-bf77ae836f41 response_code = 204 uri = /switch-ports
19812025-01-27T09:32:13.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54658
19822025-01-27T09:32:13.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64706 req_id = a36e97bb-db9c-4454-bf46-ff0a54e60241 response_code = 200 uri = /network-bootstore-config
19832025-01-27T09:32:13.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54658 req_id = e7130075-1c5a-4009-ab7b-da364bce6587 response_code = 200 uri = /v2p
19842025-01-27T09:32:13.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34207
19852025-01-27T09:32:13.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19862025-01-27T09:32:13.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19872025-01-27T09:32:13.368ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:177
19882025-01-27T09:32:13.368ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:177
19892025-01-27T09:32:13.382ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19902025-01-27T09:32:13.382ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0
19912025-01-27T09:32:13.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19922025-01-27T09:32:13.412ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1990e07a-cfb7-436f-b017-73d119d10c34
19932025-01-27T09:32:13.437ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19942025-01-27T09:32:13.437ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_423760c6-8db9-4b47-b42b-49adac69df39
19952025-01-27T09:32:13.466ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19962025-01-27T09:32:13.466ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe
19972025-01-27T09:32:13.476ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19982025-01-27T09:32:13.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 504 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56198 req_id = eb204905-b916-4ef4-8e49-0d5ed0d6c779 response_code = 204 uri = /vpc-routes
19992025-01-27T09:32:13.495ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20002025-01-27T09:32:13.495ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57255367-8a48-44c0-b878-15bd0dd194f1
20012025-01-27T09:32:13.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43494
20022025-01-27T09:32:13.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43494 req_id = 34576813-da92-4c92-b11e-ccbed9d7e73b response_code = 200 uri = /vpc-routes
20032025-01-27T09:32:13.519ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20042025-01-27T09:32:13.519ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3879af65-27ae-439f-861c-67ca34b4edf2
20052025-01-27T09:32:13.543ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20062025-01-27T09:32:13.543ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55
20072025-01-27T09:32:13.561ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
20082025-01-27T09:32:13.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43494 req_id = 8e932277-2edd-433d-8340-5dd7e8385169 response_code = 204 uri = /eip-gateways
20092025-01-27T09:32:13.565ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20102025-01-27T09:32:13.565ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a
20112025-01-27T09:32:13.588ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20122025-01-27T09:32:13.588ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9
20132025-01-27T09:32:13.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 234329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34207 req_id = d372be1d-3202-448b-b9c0-ab4800651628 response_code = 200 uri = /inventory
20142025-01-27T09:32:13.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47937
20152025-01-27T09:32:13.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47937 req_id = 4f662392-62c9-402b-8a3c-2eff2f14ba08 response_code = 200 uri = /v2p
20162025-01-27T09:32:13.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43494 req_id = 46814c2a-400f-49b9-8d63-00e16f4fe29c response_code = 204 uri = /vpc-routes
20172025-01-27T09:32:13.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41510
20182025-01-27T09:32:13.884ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20192025-01-27T09:32:13.928ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20202025-01-27T09:32:13.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107026 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41510 req_id = cdc73fba-0ce6-4c58-ac48-47c92e4fdff7 response_code = 204 uri = /switch-ports
20212025-01-27T09:32:13.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41510 req_id = b1d73912-1756-4eb0-a27d-0c621d868d58 response_code = 200 uri = /network-bootstore-config
20222025-01-27T09:32:14.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51052
20232025-01-27T09:32:14.119ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20242025-01-27T09:32:14.119ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20252025-01-27T09:32:14.119ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20262025-01-27T09:32:14.119ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20272025-01-27T09:32:14.119ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20282025-01-27T09:32:14.119ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20292025-01-27T09:32:14.119ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20302025-01-27T09:32:14.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51052 req_id = d275398e-8f36-4a18-ae2e-a92ab4c78eee response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20312025-01-27T09:32:14.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51586
20322025-01-27T09:32:14.123ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20332025-01-27T09:32:14.123ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20342025-01-27T09:32:14.123ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20352025-01-27T09:32:14.123ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20362025-01-27T09:32:14.123ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20372025-01-27T09:32:14.123ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20382025-01-27T09:32:14.123ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20392025-01-27T09:32:14.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51586 req_id = 4bbc133b-1a02-4b8a-a575-4cf8edbe0d84 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20402025-01-27T09:32:16.354ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42248
20412025-01-27T09:32:16.355ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42248 req_id = f41580d9-f01a-4a8e-8b3a-0b0f6d073a32 response_code = 200 uri = /baseboard
20422025-01-27T09:32:20.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43958
20432025-01-27T09:32:20.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43958 req_id = 13bef226-a8ff-4b22-8a58-a3f3c0ed6be9 response_code = 200 uri = /vpc-routes
20442025-01-27T09:32:20.307ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
20452025-01-27T09:32:20.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43958 req_id = 64cd1d2d-2447-40a9-845d-1a3e650c6058 response_code = 204 uri = /eip-gateways
20462025-01-27T09:32:20.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43958 req_id = b1d94ed1-917e-49bb-b1b5-1681a0dd0a69 response_code = 204 uri = /vpc-routes
20472025-01-27T09:32:25.900ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:34990 remote_addr = [fd00:1122:3344:101::d]:58433 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
20482025-01-27T09:32:25.929ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27489 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 5c03b782-2d65-4ad3-9e6f-bacaf4ddba81 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
20492025-01-27T09:32:42.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62822
20502025-01-27T09:32:42.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62822 req_id = dcb38ebf-9639-4b4e-8f35-bab61153e247 response_code = 200 uri = /vpc-routes
20512025-01-27T09:32:42.515ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
20522025-01-27T09:32:42.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62822 req_id = 8ca62aa4-68bc-437a-8bad-d875631eca62 response_code = 204 uri = /eip-gateways
20532025-01-27T09:32:42.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62822 req_id = 4dacae72-90ed-4eb0-b6f3-4adb04f93de2 response_code = 204 uri = /vpc-routes
20542025-01-27T09:32:42.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41020
20552025-01-27T09:32:42.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41020 req_id = 0b7df095-4495-4411-b079-99e4d2e3f68a response_code = 200 uri = /v2p
20562025-01-27T09:32:42.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51720
20572025-01-27T09:32:42.742ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20582025-01-27T09:32:42.778ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20592025-01-27T09:32:42.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51720 req_id = 83dbce15-b72e-462c-9fed-8ed6a734b215 response_code = 204 uri = /switch-ports
20602025-01-27T09:32:42.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51720 req_id = 4ae953bf-71c7-4a17-b3f9-7680a2abacb5 response_code = 200 uri = /network-bootstore-config
20612025-01-27T09:32:43.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54029
20622025-01-27T09:32:43.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54029 req_id = c614bf63-328f-471f-87f2-da7b424ce442 response_code = 200 uri = /vpc-routes
20632025-01-27T09:32:43.170ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
20642025-01-27T09:32:43.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54029 req_id = d445cc67-7150-4e96-9cd5-f42b0d15620e response_code = 204 uri = /eip-gateways
20652025-01-27T09:32:43.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54029 req_id = 770e9b20-bb05-4819-b3f3-4ed44b9bd2f3 response_code = 204 uri = /vpc-routes
20662025-01-27T09:32:43.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46279
20672025-01-27T09:32:43.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46279 req_id = 4f57e637-69b7-4f43-95b3-29d8f1c1e7af response_code = 200 uri = /v2p
20682025-01-27T09:32:43.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61186
20692025-01-27T09:32:43.498ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20702025-01-27T09:32:43.532ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20712025-01-27T09:32:43.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84329 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61186 req_id = 8bbbc896-c636-49c4-8e65-156c6465ea02 response_code = 204 uri = /switch-ports
20722025-01-27T09:32:43.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61186 req_id = cf108af3-0cbf-48b7-bffd-4fe53cf2abf7 response_code = 200 uri = /network-bootstore-config
20732025-01-27T09:32:43.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43860
20742025-01-27T09:32:43.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43860 req_id = 2148af3e-af6b-4d32-9c7d-7d2f3cf752ee response_code = 200 uri = /vpc-routes
20752025-01-27T09:32:43.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
20762025-01-27T09:32:43.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43860 req_id = 6e91b6bf-b470-4553-9da6-656746538873 response_code = 204 uri = /eip-gateways
20772025-01-27T09:32:43.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35215
20782025-01-27T09:32:43.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35215 req_id = 6fe6d431-e828-4b28-b518-c56407c32645 response_code = 200 uri = /v2p
20792025-01-27T09:32:43.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43860 req_id = aba40e52-5bf0-4579-82aa-8f3656d21aa3 response_code = 204 uri = /vpc-routes
20802025-01-27T09:32:43.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36956
20812025-01-27T09:32:43.974ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20822025-01-27T09:32:44.011ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20832025-01-27T09:32:44.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91960 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36956 req_id = 37b95c75-f944-42b0-9f5a-814f3dba85bd response_code = 204 uri = /switch-ports
20842025-01-27T09:32:44.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36956 req_id = 1c276e02-3caa-4603-afaf-a64d07b08e31 response_code = 200 uri = /network-bootstore-config
20852025-01-27T09:32:46.388ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50110
20862025-01-27T09:32:46.388ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50110 req_id = 95251b85-fd6e-4f81-ac23-3b32d5330e00 response_code = 200 uri = /baseboard
20872025-01-27T09:32:55.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6394 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = b6c28cc7-9250-487b-9b2d-454b77bceb72 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
20882025-01-27T09:33:12.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48844
20892025-01-27T09:33:12.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48844 req_id = fd9ee97d-e697-43d2-85d9-575b02c1f718 response_code = 200 uri = /vpc-routes
20902025-01-27T09:33:12.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51979
20912025-01-27T09:33:12.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51979 req_id = 1732c6d4-05ad-44a6-a968-d2d2c8dcbedf response_code = 200 uri = /v2p
20922025-01-27T09:33:12.464ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
20932025-01-27T09:33:12.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48844 req_id = c996823e-f4a4-4d1d-9c5d-4162bf22cdbe response_code = 204 uri = /eip-gateways
20942025-01-27T09:33:12.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44124
20952025-01-27T09:33:12.467ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20962025-01-27T09:33:12.505ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20972025-01-27T09:33:12.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95097 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44124 req_id = 78d010dc-b506-4fa8-ad9c-6f89913af308 response_code = 204 uri = /switch-ports
20982025-01-27T09:33:12.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48844 req_id = a1941d2b-dd9e-4137-8dfb-f8e45a160074 response_code = 204 uri = /vpc-routes
20992025-01-27T09:33:12.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44124 req_id = d4d40c34-2288-46a6-9c2d-55b337a9fa87 response_code = 200 uri = /network-bootstore-config
21002025-01-27T09:33:13.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37789
21012025-01-27T09:33:13.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37789 req_id = df49cb27-98b9-495d-bfda-225e816cf17b response_code = 200 uri = /vpc-routes
21022025-01-27T09:33:13.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53592
21032025-01-27T09:33:13.114ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21042025-01-27T09:33:13.152ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21052025-01-27T09:33:13.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53592 req_id = 2a798251-0115-4e17-8374-cf795222f14a response_code = 204 uri = /switch-ports
21062025-01-27T09:33:13.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
21072025-01-27T09:33:13.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37789 req_id = 0762067e-1836-479b-b32e-44f600501537 response_code = 204 uri = /eip-gateways
21082025-01-27T09:33:13.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53592 req_id = f0740c48-1b41-4163-84d4-aa1185060761 response_code = 200 uri = /network-bootstore-config
21092025-01-27T09:33:13.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49273
21102025-01-27T09:33:13.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49273 req_id = 206adc76-3398-4463-bcd0-26151b0c6ce3 response_code = 200 uri = /v2p
21112025-01-27T09:33:13.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 429 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37789 req_id = 9473f84e-4b91-4dc7-b8c3-9c11aac2ffff response_code = 204 uri = /vpc-routes
21122025-01-27T09:33:13.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39659
21132025-01-27T09:33:13.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39659 req_id = 5607f288-8489-4df7-9ab7-e0aa2ca8ef73 response_code = 200 uri = /vpc-routes
21142025-01-27T09:33:13.519ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
21152025-01-27T09:33:13.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39659 req_id = a45e86eb-7a92-4f40-a449-0a66d1534075 response_code = 204 uri = /eip-gateways
21162025-01-27T09:33:13.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39659 req_id = 8bf2d967-dad7-45c8-adb6-aa0d0ba5b174 response_code = 204 uri = /vpc-routes
21172025-01-27T09:33:13.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38561
21182025-01-27T09:33:13.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38561 req_id = 15e61b4c-d5a9-4e72-8414-31d31d04454a response_code = 200 uri = /v2p
21192025-01-27T09:33:13.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60185
21202025-01-27T09:33:13.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21212025-01-27T09:33:13.662ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21222025-01-27T09:33:13.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60185 req_id = 650485eb-ea2d-4fe4-b67b-17e84203fef9 response_code = 204 uri = /switch-ports
21232025-01-27T09:33:13.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60185 req_id = 766b4f52-f9a2-4849-b85c-c9256333a4b4 response_code = 200 uri = /network-bootstore-config
21242025-01-27T09:33:16.420ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39844
21252025-01-27T09:33:16.421ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39844 req_id = 7b9fa3ae-31cc-4051-84cf-970d15deea9a response_code = 200 uri = /baseboard
21262025-01-27T09:33:25.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6678 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = c00a8cc9-3e11-4a80-89fb-ade7aeb64108 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
21272025-01-27T09:33:42.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36127
21282025-01-27T09:33:42.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36127 req_id = 88d11d4d-6776-4a04-b6e9-3b3e880d29e8 response_code = 200 uri = /vpc-routes
21292025-01-27T09:33:42.566ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
21302025-01-27T09:33:42.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36127 req_id = 1fe82616-14bf-4b82-a196-965af9911874 response_code = 204 uri = /eip-gateways
21312025-01-27T09:33:42.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36127 req_id = 38ea7542-4e6d-4c0f-a930-1ab56a96fb12 response_code = 204 uri = /vpc-routes
21322025-01-27T09:33:42.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51520
21332025-01-27T09:33:42.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51520 req_id = b4886cbc-216a-465d-a01e-e6136f9a5256 response_code = 200 uri = /v2p
21342025-01-27T09:33:42.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37959
21352025-01-27T09:33:42.724ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21362025-01-27T09:33:42.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21372025-01-27T09:33:42.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37959 req_id = cf237474-0038-4f68-bdbb-da012df6cd8b response_code = 204 uri = /switch-ports
21382025-01-27T09:33:42.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37959 req_id = 42bef7fa-acb9-4288-8194-18abbc8933a4 response_code = 200 uri = /network-bootstore-config
21392025-01-27T09:33:43.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50609
21402025-01-27T09:33:43.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50609 req_id = d6e8e199-1885-48c6-8678-6db68744a240 response_code = 200 uri = /vpc-routes
21412025-01-27T09:33:43.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
21422025-01-27T09:33:43.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50609 req_id = 9879da78-fa67-49b4-aa17-1186861925b6 response_code = 204 uri = /eip-gateways
21432025-01-27T09:33:43.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50609 req_id = 118dcd46-94fa-4398-8089-c485e90d6b62 response_code = 204 uri = /vpc-routes
21442025-01-27T09:33:43.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42053
21452025-01-27T09:33:43.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42053 req_id = 9332eb88-8b05-4462-852f-d7c2aac21b2f response_code = 200 uri = /v2p
21462025-01-27T09:33:43.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62306
21472025-01-27T09:33:43.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21482025-01-27T09:33:43.414ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21492025-01-27T09:33:43.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93244 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62306 req_id = 730db187-330e-45e5-a01e-46ee081ac8f8 response_code = 204 uri = /switch-ports
21502025-01-27T09:33:43.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62306 req_id = 4f7db9b0-ba47-4f52-8a56-2aa33bdfb4d8 response_code = 200 uri = /network-bootstore-config
21512025-01-27T09:33:43.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49168
21522025-01-27T09:33:43.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49168 req_id = 3ac2abcd-9754-42e0-b6ef-be65481f03de response_code = 200 uri = /vpc-routes
21532025-01-27T09:33:43.767ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
21542025-01-27T09:33:43.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49168 req_id = dfc754c2-c108-4c3b-a18e-34beb1cbdd0c response_code = 204 uri = /eip-gateways
21552025-01-27T09:33:43.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49168 req_id = 6ad33c89-9560-4465-9d27-d9d7de11631a response_code = 204 uri = /vpc-routes
21562025-01-27T09:33:43.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34848
21572025-01-27T09:33:43.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34848 req_id = 4886027f-aa40-4ba4-adfc-ca3ee50eb1d1 response_code = 200 uri = /v2p
21582025-01-27T09:33:43.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62600
21592025-01-27T09:33:43.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21602025-01-27T09:33:43.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21612025-01-27T09:33:43.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97170 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62600 req_id = 11717655-d9b6-478f-8a18-f11a6f42ad44 response_code = 204 uri = /switch-ports
21622025-01-27T09:33:43.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62600 req_id = fcc80290-2af6-4f0a-89ec-dea270275227 response_code = 200 uri = /network-bootstore-config
21632025-01-27T09:33:46.452ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56875
21642025-01-27T09:33:46.452ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56875 req_id = 21e5f23f-8be6-412a-ac87-1e838bbf62bd response_code = 200 uri = /baseboard
21652025-01-27T09:33:55.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6905 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = ef16f414-3f26-4145-9b1c-c7554bdc314a response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
21662025-01-27T09:34:12.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60636
21672025-01-27T09:34:12.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60636 req_id = b588a189-edc9-4de3-8e50-7c1b552b9027 response_code = 200 uri = /v2p
21682025-01-27T09:34:12.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62438
21692025-01-27T09:34:12.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62438 req_id = da5bfad0-4511-4b17-a4f5-63c313344e54 response_code = 200 uri = /vpc-routes
21702025-01-27T09:34:12.470ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
21712025-01-27T09:34:12.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62438 req_id = 5b06b64f-b215-418e-b654-86d16ed5a806 response_code = 204 uri = /eip-gateways
21722025-01-27T09:34:12.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56266
21732025-01-27T09:34:12.476ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21742025-01-27T09:34:12.512ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21752025-01-27T09:34:12.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56266 req_id = 35bc9b42-f9b8-45ed-b0d1-9c91bc1c65b9 response_code = 204 uri = /switch-ports
21762025-01-27T09:34:12.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62438 req_id = 2a6477f3-cb61-4aaf-b6a9-0e19bbe3064f response_code = 204 uri = /vpc-routes
21772025-01-27T09:34:12.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56266 req_id = 62114d3b-0b3a-4586-9761-0ea8462e7d7b response_code = 200 uri = /network-bootstore-config
21782025-01-27T09:34:12.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53742
21792025-01-27T09:34:12.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53742 req_id = 0e391b7c-6528-44d2-8f10-4eaa0fff9521 response_code = 200 uri = /vpc-routes
21802025-01-27T09:34:13.032ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
21812025-01-27T09:34:13.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53742 req_id = f0de62af-6a3b-439c-88ee-fdeef3560518 response_code = 204 uri = /eip-gateways
21822025-01-27T09:34:13.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53742 req_id = feb3506f-9845-4623-8f59-1192ffeb025a response_code = 204 uri = /vpc-routes
21832025-01-27T09:34:13.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46964
21842025-01-27T09:34:13.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46964 req_id = 591d1ba8-59b3-4395-8679-08990b3389c9 response_code = 200 uri = /v2p
21852025-01-27T09:34:13.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62588
21862025-01-27T09:34:13.097ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21872025-01-27T09:34:13.134ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21882025-01-27T09:34:13.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62588 req_id = 431a7edb-657a-45d0-ab77-364a0d9addda response_code = 204 uri = /switch-ports
21892025-01-27T09:34:13.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62588 req_id = 44004a26-1908-4bf0-b878-580d7cc06f5d response_code = 200 uri = /network-bootstore-config
21902025-01-27T09:34:13.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48355
21912025-01-27T09:34:13.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48355 req_id = 10209ffb-b0b2-4ea0-b8ea-ea9825391a1a response_code = 200 uri = /vpc-routes
21922025-01-27T09:34:13.465ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
21932025-01-27T09:34:13.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48355 req_id = 124db520-965c-4059-b936-2eb179435b3f response_code = 204 uri = /eip-gateways
21942025-01-27T09:34:13.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48355 req_id = 8df309bb-6c2e-46b8-bc41-c2b6c473f210 response_code = 204 uri = /vpc-routes
21952025-01-27T09:34:13.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48626
21962025-01-27T09:34:13.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48626 req_id = df560c82-71b8-446a-96ff-562f13266822 response_code = 200 uri = /v2p
21972025-01-27T09:34:13.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38501
21982025-01-27T09:34:13.623ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21992025-01-27T09:34:13.660ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22002025-01-27T09:34:13.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87908 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38501 req_id = 42c6864f-b836-4cf4-a870-e73fe157a91d response_code = 204 uri = /switch-ports
22012025-01-27T09:34:13.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38501 req_id = d0ff362c-a61f-4b87-87a2-c28481c045eb response_code = 200 uri = /network-bootstore-config
22022025-01-27T09:34:16.501ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51560
22032025-01-27T09:34:16.501ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51560 req_id = a2023036-2047-451f-95b7-e3e1458a33e5 response_code = 200 uri = /baseboard
22042025-01-27T09:34:25.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6715 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 6b67cd30-68c3-484e-8b1e-f82ffcc3ff94 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
22052025-01-27T09:34:36.929ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22062025-01-27T09:34:42.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51995
22072025-01-27T09:34:42.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51995 req_id = 79d85f92-9af4-4251-8d5b-92d066411697 response_code = 200 uri = /v2p
22082025-01-27T09:34:42.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65439
22092025-01-27T09:34:42.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65439 req_id = 1c03a492-703e-45f7-9e04-3688dcdb9de1 response_code = 200 uri = /vpc-routes
22102025-01-27T09:34:42.584ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
22112025-01-27T09:34:42.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65439 req_id = 03657e46-ad26-4c38-8a03-ae2d92666bfb response_code = 204 uri = /eip-gateways
22122025-01-27T09:34:42.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65439 req_id = 5500da94-942d-424c-8d50-0ae75e1033c6 response_code = 204 uri = /vpc-routes
22132025-01-27T09:34:42.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55998
22142025-01-27T09:34:42.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22152025-01-27T09:34:42.760ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22162025-01-27T09:34:42.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119722 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55998 req_id = 8a42f07b-a06a-41d5-8aac-e6cda8f3b040 response_code = 204 uri = /switch-ports
22172025-01-27T09:34:42.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55998 req_id = d3bf7214-5c52-497d-9e31-93b2463e52a9 response_code = 200 uri = /network-bootstore-config
22182025-01-27T09:34:43.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54579
22192025-01-27T09:34:43.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54579 req_id = 23759f9d-33c3-4eaf-b04f-996ef5c98378 response_code = 200 uri = /vpc-routes
22202025-01-27T09:34:43.107ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
22212025-01-27T09:34:43.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54579 req_id = 7945a9cc-3720-4648-b334-fe5db51f2b02 response_code = 204 uri = /eip-gateways
22222025-01-27T09:34:43.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35677
22232025-01-27T09:34:43.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35677 req_id = ad52c6aa-64b6-4786-9d2c-3647bfe758a8 response_code = 200 uri = /v2p
22242025-01-27T09:34:43.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54579 req_id = 6945b660-9436-4159-b4d9-e601b0a9e19d response_code = 204 uri = /vpc-routes
22252025-01-27T09:34:43.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53908
22262025-01-27T09:34:43.376ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22272025-01-27T09:34:43.415ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22282025-01-27T09:34:43.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98757 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53908 req_id = 0e043479-060d-406c-b47b-96b9791cc39c response_code = 204 uri = /switch-ports
22292025-01-27T09:34:43.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53908 req_id = ec43ed5d-f802-4ea5-9a27-14f0a4fb9353 response_code = 200 uri = /network-bootstore-config
22302025-01-27T09:34:43.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56913
22312025-01-27T09:34:43.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56913 req_id = ca5dbf09-58b8-4344-9e0f-0e42f7a9ac0b response_code = 200 uri = /vpc-routes
22322025-01-27T09:34:43.651ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
22332025-01-27T09:34:43.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56913 req_id = fb0c9115-21f9-4787-aa05-075611ec62c9 response_code = 204 uri = /eip-gateways
22342025-01-27T09:34:43.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40286
22352025-01-27T09:34:43.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40286 req_id = 1da6d517-8e21-4e12-b94e-ac114316ce27 response_code = 200 uri = /v2p
22362025-01-27T09:34:43.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56913 req_id = 7de510b3-a4fe-41dc-9ece-a5167453fabd response_code = 204 uri = /vpc-routes
22372025-01-27T09:34:43.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59807
22382025-01-27T09:34:43.853ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22392025-01-27T09:34:43.890ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22402025-01-27T09:34:43.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92525 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59807 req_id = fea1145f-7a48-45b9-81a9-5a5d1cf739f9 response_code = 204 uri = /switch-ports
22412025-01-27T09:34:43.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59807 req_id = 3e8f58bb-d1ff-48c0-b76f-404311156223 response_code = 200 uri = /network-bootstore-config
22422025-01-27T09:34:46.534ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50937
22432025-01-27T09:34:46.534ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50937 req_id = a62a8952-5b5f-4879-8407-3279eada6dc9 response_code = 200 uri = /baseboard
22442025-01-27T09:34:55.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6588 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = e2c47296-c9ad-4b65-a581-a029f5c74a12 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
22452025-01-27T09:35:12.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43873
22462025-01-27T09:35:12.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43873 req_id = 9ed26097-0424-4060-97ec-1ff9535429d0 response_code = 200 uri = /vpc-routes
22472025-01-27T09:35:12.377ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
22482025-01-27T09:35:12.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43873 req_id = b083aa0b-0675-4031-87d4-ba3bd330ac11 response_code = 204 uri = /eip-gateways
22492025-01-27T09:35:12.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43873 req_id = 0d9b8846-0650-4786-a610-c45b084619ff response_code = 204 uri = /vpc-routes
22502025-01-27T09:35:12.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50564
22512025-01-27T09:35:12.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50564 req_id = f29360bc-1e40-493a-8b51-ca0b48a7c437 response_code = 200 uri = /v2p
22522025-01-27T09:35:12.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45660
22532025-01-27T09:35:12.418ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22542025-01-27T09:35:12.455ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22552025-01-27T09:35:12.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87464 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45660 req_id = 2b74ad43-341f-4c6e-9def-f456976c8ad2 response_code = 204 uri = /switch-ports
22562025-01-27T09:35:12.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45660 req_id = 585b17f7-9491-4722-9f40-9d6e52ad036a response_code = 200 uri = /network-bootstore-config
22572025-01-27T09:35:12.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34199
22582025-01-27T09:35:12.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34199 req_id = 57ea5f24-593f-4572-9b39-203243be12d3 response_code = 200 uri = /v2p
22592025-01-27T09:35:13.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50211
22602025-01-27T09:35:13.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50211 req_id = e2226531-ae79-4f2b-b609-15fd3134dca8 response_code = 200 uri = /vpc-routes
22612025-01-27T09:35:13.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48622
22622025-01-27T09:35:13.094ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22632025-01-27T09:35:13.131ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22642025-01-27T09:35:13.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89146 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48622 req_id = 0c6e949c-58e5-4d02-820d-b3be9ead58d9 response_code = 204 uri = /switch-ports
22652025-01-27T09:35:13.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48622 req_id = 883961e3-3e4a-456e-9e6a-9b5e01b25322 response_code = 200 uri = /network-bootstore-config
22662025-01-27T09:35:13.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
22672025-01-27T09:35:13.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50211 req_id = 4c309c15-63b8-4369-be46-d96d9282547c response_code = 204 uri = /eip-gateways
22682025-01-27T09:35:13.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50211 req_id = 4bef9a3a-a204-4207-bbd8-5ffab31dd16b response_code = 204 uri = /vpc-routes
22692025-01-27T09:35:13.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61056
22702025-01-27T09:35:13.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61056 req_id = f5c6ad66-743a-4072-94a1-5ffb89a735e1 response_code = 200 uri = /vpc-routes
22712025-01-27T09:35:13.420ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
22722025-01-27T09:35:13.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61056 req_id = e0b5f4f0-a27b-417f-b753-555f50f911c3 response_code = 204 uri = /eip-gateways
22732025-01-27T09:35:13.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61056 req_id = 45a19d4b-22a1-411e-a5ea-2295f27561b5 response_code = 204 uri = /vpc-routes
22742025-01-27T09:35:13.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61309
22752025-01-27T09:35:13.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61309 req_id = eeac994d-ada4-44a5-aeef-9d28bf628824 response_code = 200 uri = /v2p
22762025-01-27T09:35:13.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59055
22772025-01-27T09:35:13.609ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22782025-01-27T09:35:13.644ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22792025-01-27T09:35:13.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91458 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59055 req_id = 0ad5f4d4-3c0e-4cbb-8250-f34333eacb13 response_code = 204 uri = /switch-ports
22802025-01-27T09:35:13.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59055 req_id = 6bbbd137-286f-427d-ae79-21c2ac5cc5f8 response_code = 200 uri = /network-bootstore-config
22812025-01-27T09:35:16.569ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37937
22822025-01-27T09:35:16.569ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37937 req_id = 30b3d829-851a-4c3f-8aba-b38c57a106b2 response_code = 200 uri = /baseboard
22832025-01-27T09:35:25.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6784 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = e590373e-50cd-4639-b991-cd85fc9ac9f7 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
22842025-01-27T09:35:42.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64972
22852025-01-27T09:35:42.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64972 req_id = 989a193f-cfb2-4633-9776-af049103dabf response_code = 200 uri = /vpc-routes
22862025-01-27T09:35:42.547ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
22872025-01-27T09:35:42.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64972 req_id = fb0f344b-d334-4bbd-8379-c525d1eb02dc response_code = 204 uri = /eip-gateways
22882025-01-27T09:35:42.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64972 req_id = 9cc20299-ce7c-4878-82eb-4f9d39e88a94 response_code = 204 uri = /vpc-routes
22892025-01-27T09:35:42.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37045
22902025-01-27T09:35:42.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22912025-01-27T09:35:42.664ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22922025-01-27T09:35:42.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85746 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37045 req_id = 529ed17d-f9fd-46d3-8de7-e1c0a4cabaac response_code = 204 uri = /switch-ports
22932025-01-27T09:35:42.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61204
22942025-01-27T09:35:42.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61204 req_id = 88cd7ab1-fdff-4dba-9592-4e1ca0cf80da response_code = 200 uri = /v2p
22952025-01-27T09:35:42.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37045 req_id = 1e676f67-3a27-4649-a40c-cde9a6243b56 response_code = 200 uri = /network-bootstore-config
22962025-01-27T09:35:43.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55369
22972025-01-27T09:35:43.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55369 req_id = 32fdb81e-ff91-48ba-99c8-487653a18a23 response_code = 200 uri = /vpc-routes
22982025-01-27T09:35:43.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
22992025-01-27T09:35:43.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55369 req_id = 909d15bf-ec60-47f0-8ad3-2982ebd6efe1 response_code = 204 uri = /eip-gateways
23002025-01-27T09:35:43.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55369 req_id = 196d04c1-ef36-4e5e-9bb4-9acb23afb442 response_code = 204 uri = /vpc-routes
23012025-01-27T09:35:43.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36381
23022025-01-27T09:35:43.285ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23032025-01-27T09:35:43.327ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23042025-01-27T09:35:43.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102277 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36381 req_id = 533e31f6-c61b-4419-b97a-0096baf01688 response_code = 204 uri = /switch-ports
23052025-01-27T09:35:43.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33848
23062025-01-27T09:35:43.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33848 req_id = 20055e32-4bbb-4a9e-9cde-63f616a92a42 response_code = 200 uri = /v2p
23072025-01-27T09:35:43.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36381 req_id = 2af4af5c-0620-4185-8538-1abc968d26cc response_code = 200 uri = /network-bootstore-config
23082025-01-27T09:35:43.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56163
23092025-01-27T09:35:43.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56163 req_id = 559ee25c-421d-4c21-9157-7ca319b76d65 response_code = 200 uri = /vpc-routes
23102025-01-27T09:35:43.742ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
23112025-01-27T09:35:43.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56163 req_id = 6bf89023-79d3-4b0d-934c-7ff46bd09695 response_code = 204 uri = /eip-gateways
23122025-01-27T09:35:43.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56163 req_id = d80accdd-9c34-4925-a409-6025894502e1 response_code = 204 uri = /vpc-routes
23132025-01-27T09:35:43.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56965
23142025-01-27T09:35:43.878ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23152025-01-27T09:35:43.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23162025-01-27T09:35:43.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56965 req_id = 55b6d766-98ee-4b43-a30d-f9e8dac3711d response_code = 204 uri = /switch-ports
23172025-01-27T09:35:43.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63289
23182025-01-27T09:35:43.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63289 req_id = e4032121-e943-4877-b2a5-59b1f5cbb71f response_code = 200 uri = /v2p
23192025-01-27T09:35:43.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56965 req_id = e61064b9-b369-4d20-95d6-b4251111a62b response_code = 200 uri = /network-bootstore-config
23202025-01-27T09:35:46.601ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55587
23212025-01-27T09:35:46.601ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55587 req_id = 77387ee2-1038-44ca-a31f-715b5cbfe994 response_code = 200 uri = /baseboard
23222025-01-27T09:35:55.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6965 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = ea15318b-2807-43c1-b293-3d00fc0b0416 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
23232025-01-27T09:36:12.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50837
23242025-01-27T09:36:12.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50837 req_id = ed320cd9-90ec-47d9-b2d6-a27353dc025e response_code = 200 uri = /vpc-routes
23252025-01-27T09:36:12.361ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
23262025-01-27T09:36:12.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50837 req_id = 5c530614-b4db-4df7-9077-861890307dec response_code = 204 uri = /eip-gateways
23272025-01-27T09:36:12.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49976
23282025-01-27T09:36:12.369ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23292025-01-27T09:36:12.405ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23302025-01-27T09:36:12.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49976 req_id = 55d16189-8f5c-4416-8edd-43b1ea7cc170 response_code = 204 uri = /switch-ports
23312025-01-27T09:36:12.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51832
23322025-01-27T09:36:12.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49976 req_id = ce6cc31e-a753-44b6-91e0-16f5d71f313e response_code = 200 uri = /network-bootstore-config
23332025-01-27T09:36:12.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 524 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50837 req_id = b44fc345-29bc-4795-8e1d-48686d714698 response_code = 204 uri = /vpc-routes
23342025-01-27T09:36:12.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51832 req_id = 8d89ec08-0251-406e-bc73-dd7271c36cf3 response_code = 200 uri = /v2p
23352025-01-27T09:36:13.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49881
23362025-01-27T09:36:13.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49881 req_id = 481374e2-f7b1-4f92-b1be-f64fb964f755 response_code = 200 uri = /vpc-routes
23372025-01-27T09:36:13.076ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
23382025-01-27T09:36:13.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49881 req_id = 1a1f1dae-45c9-452b-8f32-1fde09447e58 response_code = 204 uri = /eip-gateways
23392025-01-27T09:36:13.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49881 req_id = c889a2d0-7121-4b13-b1c9-3db840edcf06 response_code = 204 uri = /vpc-routes
23402025-01-27T09:36:13.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48381
23412025-01-27T09:36:13.140ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23422025-01-27T09:36:13.179ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23432025-01-27T09:36:13.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97804 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48381 req_id = 620737a4-cd1f-4fe7-848b-67983e8f1bdc response_code = 204 uri = /switch-ports
23442025-01-27T09:36:13.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40324
23452025-01-27T09:36:13.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48381 req_id = 94b18a3f-f49f-4a44-b7cd-518ca7e8a9c6 response_code = 200 uri = /network-bootstore-config
23462025-01-27T09:36:13.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40324 req_id = 6c34ba2f-74fe-4cd1-9c1b-1c606f743fd1 response_code = 200 uri = /v2p
23472025-01-27T09:36:13.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53137
23482025-01-27T09:36:13.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53137 req_id = f492fa19-feb7-43b7-9718-75fcca3fb284 response_code = 200 uri = /vpc-routes
23492025-01-27T09:36:13.465ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
23502025-01-27T09:36:13.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53137 req_id = 4bc65759-cce7-421d-926d-3a524d184987 response_code = 204 uri = /eip-gateways
23512025-01-27T09:36:13.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57116
23522025-01-27T09:36:13.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57116 req_id = bc49fbe5-39be-40bc-a155-5c2de5afe286 response_code = 200 uri = /v2p
23532025-01-27T09:36:13.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53137 req_id = 64d696d9-f458-4157-a793-680293d02151 response_code = 204 uri = /vpc-routes
23542025-01-27T09:36:13.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45572
23552025-01-27T09:36:13.530ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23562025-01-27T09:36:13.566ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23572025-01-27T09:36:13.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90096 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45572 req_id = ae949def-aa62-46c5-8ef3-0d4807a52bba response_code = 204 uri = /switch-ports
23582025-01-27T09:36:13.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45572 req_id = ab2bb171-6f22-4ba7-acd5-b023348783ec response_code = 200 uri = /network-bootstore-config
23592025-01-27T09:36:16.635ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59554
23602025-01-27T09:36:16.635ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59554 req_id = 90e5fa79-9315-41e7-a661-f3cbc8a38c17 response_code = 200 uri = /baseboard
23612025-01-27T09:36:25.907ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7957 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 46cf2545-732f-4b99-9333-f3a8fee466dd response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
23622025-01-27T09:36:42.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51928
23632025-01-27T09:36:42.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51928 req_id = 7c632d72-d4b6-48e8-94e1-2fa5d4831078 response_code = 200 uri = /vpc-routes
23642025-01-27T09:36:42.600ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
23652025-01-27T09:36:42.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51928 req_id = 0b47bbff-4aec-456f-9b9f-dece8210f71a response_code = 204 uri = /eip-gateways
23662025-01-27T09:36:42.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49759
23672025-01-27T09:36:42.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49759 req_id = 3606d20f-18f8-49ed-bfbc-708206f90697 response_code = 200 uri = /v2p
23682025-01-27T09:36:42.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51928 req_id = d7bd663b-0280-4164-944b-59caa8a9f7f2 response_code = 204 uri = /vpc-routes
23692025-01-27T09:36:42.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49262
23702025-01-27T09:36:42.736ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23712025-01-27T09:36:42.773ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23722025-01-27T09:36:42.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119952 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49262 req_id = 16165c67-220d-41a7-aff5-43492a363bdb response_code = 204 uri = /switch-ports
23732025-01-27T09:36:42.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40254
23742025-01-27T09:36:42.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49262 req_id = 9c7333f9-80ad-440d-82be-6fbc2e8ff259 response_code = 200 uri = /network-bootstore-config
23752025-01-27T09:36:42.857ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23762025-01-27T09:36:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23772025-01-27T09:36:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23782025-01-27T09:36:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23792025-01-27T09:36:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23802025-01-27T09:36:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23812025-01-27T09:36:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23822025-01-27T09:36:42.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40254 req_id = 436367e8-7551-4d59-88f9-f31a1f5edd51 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23832025-01-27T09:36:43.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40512
23842025-01-27T09:36:43.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40512 req_id = b7f1d706-d3d0-486b-9d96-57c02bfdb04e response_code = 200 uri = /vpc-routes
23852025-01-27T09:36:43.384ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
23862025-01-27T09:36:43.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40512 req_id = d09f0a09-b176-4b63-8302-6e52c487f0a4 response_code = 204 uri = /eip-gateways
23872025-01-27T09:36:43.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40512 req_id = 646f2781-3737-4fa6-9021-b5e41f168a3d response_code = 204 uri = /vpc-routes
23882025-01-27T09:36:43.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48243
23892025-01-27T09:36:43.454ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23902025-01-27T09:36:43.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23912025-01-27T09:36:43.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48243 req_id = ee9d8754-97fd-41ef-b5f0-826ee7af40ee response_code = 204 uri = /switch-ports
23922025-01-27T09:36:43.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50352
23932025-01-27T09:36:43.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64878
23942025-01-27T09:36:43.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48243 req_id = 0aaf8c0e-1e4b-43c3-a576-22ecfbfb4107 response_code = 200 uri = /network-bootstore-config
23952025-01-27T09:36:43.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50352 req_id = d1253af7-6349-4170-bb35-5af7ed49da0d response_code = 200 uri = /v2p
23962025-01-27T09:36:43.555ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23972025-01-27T09:36:43.555ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23982025-01-27T09:36:43.555ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23992025-01-27T09:36:43.555ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24002025-01-27T09:36:43.556ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24012025-01-27T09:36:43.556ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24022025-01-27T09:36:43.556ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24032025-01-27T09:36:43.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 556 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64878 req_id = ef20903c-99cc-453c-b762-768da983a594 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24042025-01-27T09:36:43.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41977
24052025-01-27T09:36:43.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41977 req_id = bc5f3f2e-aa7f-469b-9b6d-2c982eb2cb8b response_code = 200 uri = /vpc-routes
24062025-01-27T09:36:43.600ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
24072025-01-27T09:36:43.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41977 req_id = ea48e3af-ffb7-47b1-b7cf-0b05894426d5 response_code = 204 uri = /eip-gateways
24082025-01-27T09:36:43.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65103
24092025-01-27T09:36:43.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65103 req_id = 8351d0a2-2756-4979-8269-f45447526b75 response_code = 200 uri = /v2p
24102025-01-27T09:36:43.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41977 req_id = 7d9e185f-4a4a-409b-82f2-1fb5880719be response_code = 204 uri = /vpc-routes
24112025-01-27T09:36:43.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51855
24122025-01-27T09:36:43.889ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24132025-01-27T09:36:43.925ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24142025-01-27T09:36:43.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89616 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51855 req_id = 7dd0b122-6fab-4cf9-b09c-020ee6e641b2 response_code = 204 uri = /switch-ports
24152025-01-27T09:36:43.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48087
24162025-01-27T09:36:43.979ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24172025-01-27T09:36:43.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51855 req_id = a60fdb6a-b99f-49ba-bc2d-739494407991 response_code = 200 uri = /network-bootstore-config
24182025-01-27T09:36:43.979ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24192025-01-27T09:36:43.979ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24202025-01-27T09:36:43.979ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24212025-01-27T09:36:43.979ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24222025-01-27T09:36:43.979ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24232025-01-27T09:36:43.979ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24242025-01-27T09:36:43.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 384 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48087 req_id = 6104c4ce-2413-4e78-99b7-4bb537642628 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24252025-01-27T09:36:46.667ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64605
24262025-01-27T09:36:46.667ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64605 req_id = 949d9903-5646-476a-8dfe-f6bcd76c6358 response_code = 200 uri = /baseboard
24272025-01-27T09:36:55.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7800 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 90938161-d97f-4c4d-8754-324d7a8935c9 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
24282025-01-27T09:37:12.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45945
24292025-01-27T09:37:12.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45945 req_id = 2f5fb9bb-3dc2-449b-9ffd-e1ea6c7d06ef response_code = 200 uri = /vpc-routes
24302025-01-27T09:37:12.336ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
24312025-01-27T09:37:12.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45945 req_id = e03b3d00-9e7e-439c-8e41-3cc7ec7f4374 response_code = 204 uri = /eip-gateways
24322025-01-27T09:37:12.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45945 req_id = bb4a2f06-fff4-4842-9b75-aac6fdc3b6e7 response_code = 204 uri = /vpc-routes
24332025-01-27T09:37:12.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46887
24342025-01-27T09:37:12.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46887 req_id = c57b89e3-b649-4121-b73a-1b39d85007bb response_code = 200 uri = /v2p
24352025-01-27T09:37:12.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35561
24362025-01-27T09:37:12.426ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24372025-01-27T09:37:12.461ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24382025-01-27T09:37:12.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35561 req_id = 903f48bd-e7c2-4412-bb2e-eb9ccb7a4cca response_code = 204 uri = /switch-ports
24392025-01-27T09:37:12.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35561 req_id = 83d46fae-688b-4fef-af41-2c8585364f05 response_code = 200 uri = /network-bootstore-config
24402025-01-27T09:37:12.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60769
24412025-01-27T09:37:12.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60769 req_id = 5fa548f0-4802-4170-b85c-a38b64d1dce7 response_code = 200 uri = /vpc-routes
24422025-01-27T09:37:13.005ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
24432025-01-27T09:37:13.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60769 req_id = b0f13abf-af33-4277-86ac-20ee323e3045 response_code = 204 uri = /eip-gateways
24442025-01-27T09:37:13.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60769 req_id = 396ab677-1270-470f-8940-5b1a7edbd52a response_code = 204 uri = /vpc-routes
24452025-01-27T09:37:13.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57383
24462025-01-27T09:37:13.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57383 req_id = da408777-e31a-4326-9737-b927b5231515 response_code = 200 uri = /v2p
24472025-01-27T09:37:13.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50559
24482025-01-27T09:37:13.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24492025-01-27T09:37:13.248ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24502025-01-27T09:37:13.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50559 req_id = ded4c1d6-6f5e-426b-8dcf-a74b87b0951b response_code = 204 uri = /switch-ports
24512025-01-27T09:37:13.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50559 req_id = c622f32d-cf13-4039-b7c2-086d0731cd2c response_code = 200 uri = /network-bootstore-config
24522025-01-27T09:37:13.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36221
24532025-01-27T09:37:13.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36221 req_id = 0edb4251-3ae2-4cdf-aea5-b038d206a844 response_code = 200 uri = /vpc-routes
24542025-01-27T09:37:13.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
24552025-01-27T09:37:13.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36221 req_id = bb64abb6-d9f8-49ab-8786-c0afd32a80e2 response_code = 204 uri = /eip-gateways
24562025-01-27T09:37:13.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36221 req_id = 8d524397-76d5-453f-bd35-2b6fb4339c8a response_code = 204 uri = /vpc-routes
24572025-01-27T09:37:13.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60927
24582025-01-27T09:37:13.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60927 req_id = 84213a3a-54c3-4161-9fe0-8ce970fbcaf2 response_code = 200 uri = /v2p
24592025-01-27T09:37:13.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57619
24602025-01-27T09:37:13.598ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24612025-01-27T09:37:13.636ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24622025-01-27T09:37:13.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96015 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57619 req_id = d72b2dc9-d3e4-4fa9-8f25-5e2a8f08e227 response_code = 204 uri = /switch-ports
24632025-01-27T09:37:13.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57619 req_id = 06fb59c6-7b65-4273-8169-67a7e61fe77d response_code = 200 uri = /network-bootstore-config
24642025-01-27T09:37:16.700ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35854
24652025-01-27T09:37:16.701ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35854 req_id = 983fbaae-c4ff-488d-8150-8f5eb9178b06 response_code = 200 uri = /baseboard
24662025-01-27T09:37:25.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7097 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = e26b07cc-c6a7-4f11-9537-edecab354868 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
24672025-01-27T09:37:42.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56150
24682025-01-27T09:37:42.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56150 req_id = 51ae8857-e66f-4951-9615-a16cf4bab34d response_code = 200 uri = /vpc-routes
24692025-01-27T09:37:42.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63466
24702025-01-27T09:37:42.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63466 req_id = a007fbd4-6d46-48fc-9de1-a813536316b7 response_code = 200 uri = /v2p
24712025-01-27T09:37:42.497ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
24722025-01-27T09:37:42.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56150 req_id = 710cd994-3c77-402c-a1c1-c154d37462b3 response_code = 204 uri = /eip-gateways
24732025-01-27T09:37:42.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56150 req_id = aa62dc37-c9b2-44e0-a260-c2e1d279b4e9 response_code = 204 uri = /vpc-routes
24742025-01-27T09:37:42.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44545
24752025-01-27T09:37:42.616ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24762025-01-27T09:37:42.652ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24772025-01-27T09:37:42.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44545 req_id = 50f907c4-36b5-4d74-ba11-26dd569321fe response_code = 204 uri = /switch-ports
24782025-01-27T09:37:42.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44545 req_id = c9288b9b-7fe2-41c1-bee7-93ef29f47d8b response_code = 200 uri = /network-bootstore-config
24792025-01-27T09:37:43.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37996
24802025-01-27T09:37:43.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37996 req_id = 5844c0b0-9578-47b5-a0d5-1b485630ddaa response_code = 200 uri = /vpc-routes
24812025-01-27T09:37:43.117ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
24822025-01-27T09:37:43.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37996 req_id = 5b0915f4-cc61-4ce9-a0bc-fa1deedd65e1 response_code = 204 uri = /eip-gateways
24832025-01-27T09:37:43.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37996 req_id = 0602f8da-22ec-424f-93b7-7f23da4ddd4a response_code = 204 uri = /vpc-routes
24842025-01-27T09:37:43.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46945
24852025-01-27T09:37:43.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46945 req_id = 971a4858-c9fa-4204-a48f-eb314aa9b7b0 response_code = 200 uri = /v2p
24862025-01-27T09:37:43.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38580
24872025-01-27T09:37:43.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24882025-01-27T09:37:43.256ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24892025-01-27T09:37:43.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128116 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38580 req_id = df4e3a2e-61ac-4f68-82b6-f4c27bc23062 response_code = 204 uri = /switch-ports
24902025-01-27T09:37:43.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38580 req_id = 80de8954-8643-4e51-93d5-d9c592b1c7ae response_code = 200 uri = /network-bootstore-config
24912025-01-27T09:37:43.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51709
24922025-01-27T09:37:43.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51709 req_id = 42fd76f1-74b4-45ad-9714-58af39676ef2 response_code = 200 uri = /vpc-routes
24932025-01-27T09:37:43.597ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
24942025-01-27T09:37:43.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51709 req_id = 8a758909-ad7d-4f34-b3e2-087f06fb8c24 response_code = 204 uri = /eip-gateways
24952025-01-27T09:37:43.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51709 req_id = 6e0eeebc-8b2a-4af6-aa3c-7bf88448463c response_code = 204 uri = /vpc-routes
24962025-01-27T09:37:43.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41805
24972025-01-27T09:37:43.696ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24982025-01-27T09:37:43.732ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24992025-01-27T09:37:43.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41805 req_id = 9aa9e41d-e5cd-4ea2-9934-8896e6b84da7 response_code = 204 uri = /switch-ports
25002025-01-27T09:37:43.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37507
25012025-01-27T09:37:43.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41805 req_id = e1b0956c-4336-45c2-a7dd-97c723bf3d53 response_code = 200 uri = /network-bootstore-config
25022025-01-27T09:37:43.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37507 req_id = 83f304a6-303c-4f5c-a089-f8435622237b response_code = 200 uri = /v2p
25032025-01-27T09:37:46.734ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59684
25042025-01-27T09:37:46.734ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59684 req_id = 3a00899a-c486-4dd4-9521-12adaeae3691 response_code = 200 uri = /baseboard
25052025-01-27T09:37:55.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8223 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 9885777f-cb66-48ea-bb02-066aab27e4f0 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
25062025-01-27T09:38:12.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59661
25072025-01-27T09:38:12.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59661 req_id = 217c3296-8657-4f53-9e53-94831a1d125f response_code = 200 uri = /vpc-routes
25082025-01-27T09:38:12.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
25092025-01-27T09:38:12.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59661 req_id = 2f9f3298-b54f-444f-9500-a860bd35d8d3 response_code = 204 uri = /eip-gateways
25102025-01-27T09:38:12.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59661 req_id = 00db241e-aa44-4bf6-9af2-155eba921228 response_code = 204 uri = /vpc-routes
25112025-01-27T09:38:12.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43840
25122025-01-27T09:38:12.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43840 req_id = 2075cdb1-e93f-4aa3-bee0-cdda917b4646 response_code = 200 uri = /v2p
25132025-01-27T09:38:12.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43942
25142025-01-27T09:38:12.605ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25152025-01-27T09:38:12.639ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25162025-01-27T09:38:12.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87115 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43942 req_id = 653e4898-04e5-4492-98d3-9d51072ddbdc response_code = 204 uri = /switch-ports
25172025-01-27T09:38:12.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43942 req_id = e628cf0b-3c2b-434b-b5ae-7ceb21678142 response_code = 200 uri = /network-bootstore-config
25182025-01-27T09:38:12.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47070
25192025-01-27T09:38:12.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47070 req_id = 063094ee-5a74-4174-807e-84aa039cb967 response_code = 200 uri = /vpc-routes
25202025-01-27T09:38:13.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50921
25212025-01-27T09:38:13.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50921 req_id = 72f0cde6-986b-4d8e-8034-751d2a66ff74 response_code = 200 uri = /v2p
25222025-01-27T09:38:13.135ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
25232025-01-27T09:38:13.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47070 req_id = 17c6e750-7fce-47eb-81ff-624b4c9e0230 response_code = 204 uri = /eip-gateways
25242025-01-27T09:38:13.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47070 req_id = bb0f3544-6095-46aa-bf60-08c05e78a5bc response_code = 204 uri = /vpc-routes
25252025-01-27T09:38:13.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42718
25262025-01-27T09:38:13.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25272025-01-27T09:38:13.181ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25282025-01-27T09:38:13.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94210 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42718 req_id = b204c63e-5e41-40dd-aeba-27bec9b3f3a8 response_code = 204 uri = /switch-ports
25292025-01-27T09:38:13.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42718 req_id = 819fa2a6-1b0f-406d-aa46-4a665e1ef34c response_code = 200 uri = /network-bootstore-config
25302025-01-27T09:38:13.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61866
25312025-01-27T09:38:13.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61866 req_id = 55f7ed53-459c-4253-868f-99232ccd1674 response_code = 200 uri = /vpc-routes
25322025-01-27T09:38:13.467ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
25332025-01-27T09:38:13.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61866 req_id = 5a12bafa-3270-4679-a50e-3f2382bb3c77 response_code = 204 uri = /eip-gateways
25342025-01-27T09:38:13.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61866 req_id = 9490afae-a7c1-43e7-9b97-5d13af05e235 response_code = 204 uri = /vpc-routes
25352025-01-27T09:38:13.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64478
25362025-01-27T09:38:13.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64478 req_id = 342b6ca7-3b7c-4f7f-ad18-b498cc33ca8c response_code = 200 uri = /v2p
25372025-01-27T09:38:13.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57154
25382025-01-27T09:38:13.668ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25392025-01-27T09:38:13.699ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25402025-01-27T09:38:13.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83717 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57154 req_id = d0810b91-be9b-4a85-8fc3-a773a88255b2 response_code = 204 uri = /switch-ports
25412025-01-27T09:38:13.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57154 req_id = 181848a8-34f3-48c7-8fbb-d81761450a9c response_code = 200 uri = /network-bootstore-config
25422025-01-27T09:38:16.767ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56605
25432025-01-27T09:38:16.767ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56605 req_id = d7dde594-9da6-47ed-acf5-927ffeff5728 response_code = 200 uri = /baseboard
25442025-01-27T09:38:25.908ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10025 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 0a06b80b-3aeb-4afa-93c4-9a5f70f32556 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
25452025-01-27T09:38:42.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40367
25462025-01-27T09:38:42.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40367 req_id = 2455b151-5e59-4d98-a847-dbe2d97981a3 response_code = 200 uri = /vpc-routes
25472025-01-27T09:38:42.604ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
25482025-01-27T09:38:42.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40367 req_id = ebf04c83-2b40-4b50-8acb-892a892f6e83 response_code = 204 uri = /eip-gateways
25492025-01-27T09:38:42.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40367 req_id = 954ffb34-977f-42d3-9ff6-50f44687e498 response_code = 204 uri = /vpc-routes
25502025-01-27T09:38:42.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44910
25512025-01-27T09:38:42.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44910 req_id = ca11a066-c85a-4e9a-97e0-0d169e2c676a response_code = 200 uri = /v2p
25522025-01-27T09:38:42.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55603
25532025-01-27T09:38:42.671ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25542025-01-27T09:38:42.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25552025-01-27T09:38:42.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88654 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55603 req_id = 076a0a8c-4d15-4be1-8b41-de2fa1697c72 response_code = 204 uri = /switch-ports
25562025-01-27T09:38:42.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55603 req_id = df3b93b3-44c2-40e0-a72f-66349ffb3d4b response_code = 200 uri = /network-bootstore-config
25572025-01-27T09:38:43.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44862
25582025-01-27T09:38:43.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44862 req_id = 186ca1f9-2d10-43d2-8f64-171a18577879 response_code = 200 uri = /vpc-routes
25592025-01-27T09:38:43.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
25602025-01-27T09:38:43.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44862 req_id = ba2f0acb-4cee-4a27-9396-bf6ed5fe6a92 response_code = 204 uri = /eip-gateways
25612025-01-27T09:38:43.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38875
25622025-01-27T09:38:43.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38875 req_id = 78747ac6-1f02-4ca7-9355-45b55c43486c response_code = 200 uri = /v2p
25632025-01-27T09:38:43.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44862 req_id = 7e2264f6-1840-4ef7-b97f-73dfe5f18344 response_code = 204 uri = /vpc-routes
25642025-01-27T09:38:43.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39790
25652025-01-27T09:38:43.383ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25662025-01-27T09:38:43.426ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25672025-01-27T09:38:43.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102029 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39790 req_id = d9656e47-bceb-416c-b6d9-b2a1ec40a074 response_code = 204 uri = /switch-ports
25682025-01-27T09:38:43.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39790 req_id = 7c54cb89-baa2-4451-bb85-baf919341b75 response_code = 200 uri = /network-bootstore-config
25692025-01-27T09:38:43.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55164
25702025-01-27T09:38:43.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55164 req_id = 046df3d1-ecd9-4a32-a62a-e5721443393b response_code = 200 uri = /vpc-routes
25712025-01-27T09:38:43.594ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
25722025-01-27T09:38:43.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55164 req_id = 366c87f7-25dd-45bc-a4aa-8d5774e504e3 response_code = 204 uri = /eip-gateways
25732025-01-27T09:38:43.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55164 req_id = 38ab5f2f-4739-407a-a131-706a051cfd0a response_code = 204 uri = /vpc-routes
25742025-01-27T09:38:43.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61268
25752025-01-27T09:38:43.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61268 req_id = b58a0ad1-3ea3-4665-b0ec-074ba3170df6 response_code = 200 uri = /v2p
25762025-01-27T09:38:43.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41597
25772025-01-27T09:38:43.821ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25782025-01-27T09:38:43.856ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25792025-01-27T09:38:43.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93106 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41597 req_id = f2ca7f67-9257-4d57-9841-a3336a7b282a response_code = 204 uri = /switch-ports
25802025-01-27T09:38:43.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41597 req_id = 05934cea-ef1a-4ef4-927d-527723e17c64 response_code = 200 uri = /network-bootstore-config
25812025-01-27T09:38:46.799ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62934
25822025-01-27T09:38:46.799ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62934 req_id = 56fa556e-e0ed-404c-923d-ae524008acc5 response_code = 200 uri = /baseboard
25832025-01-27T09:38:55.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8156 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = be2e914c-4a62-4f62-bea4-ae823144bc79 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
25842025-01-27T09:39:12.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59168
25852025-01-27T09:39:12.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59168 req_id = a61baf50-56c8-4765-8365-473c194e9c8e response_code = 200 uri = /v2p
25862025-01-27T09:39:12.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38062
25872025-01-27T09:39:12.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38062 req_id = 9d6594cd-3168-46e7-a547-b0ca8f52b4f4 response_code = 200 uri = /vpc-routes
25882025-01-27T09:39:12.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
25892025-01-27T09:39:12.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38062 req_id = 5d4d0dbf-86c1-4aa7-9816-844773f4eb03 response_code = 204 uri = /eip-gateways
25902025-01-27T09:39:12.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38062 req_id = cc099132-149c-4f8f-9495-235a8534ddbd response_code = 204 uri = /vpc-routes
25912025-01-27T09:39:12.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40045
25922025-01-27T09:39:12.488ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25932025-01-27T09:39:12.526ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25942025-01-27T09:39:12.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87399 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40045 req_id = 744838b9-b74c-4e39-931a-87fbf8ff6d22 response_code = 204 uri = /switch-ports
25952025-01-27T09:39:12.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40045 req_id = 38b4c370-f13a-4175-824f-85680477885c response_code = 200 uri = /network-bootstore-config
25962025-01-27T09:39:12.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35467
25972025-01-27T09:39:12.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35467 req_id = 580f1f73-7711-4d28-bf47-fd0bf7b1b013 response_code = 200 uri = /vpc-routes
25982025-01-27T09:39:12.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
25992025-01-27T09:39:12.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35467 req_id = 0f87d806-1851-4781-9a39-4e4cdf8d1596 response_code = 204 uri = /eip-gateways
26002025-01-27T09:39:12.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35467 req_id = a848b554-a271-4398-9753-1b78ad23c11e response_code = 204 uri = /vpc-routes
26012025-01-27T09:39:13.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33567
26022025-01-27T09:39:13.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33567 req_id = dd0d486f-1ca0-4fe5-baf7-54a7f7abf486 response_code = 200 uri = /v2p
26032025-01-27T09:39:13.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52323
26042025-01-27T09:39:13.071ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26052025-01-27T09:39:13.104ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26062025-01-27T09:39:13.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86070 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52323 req_id = 4a95e461-9023-48a2-b20e-b2c61ed38779 response_code = 204 uri = /switch-ports
26072025-01-27T09:39:13.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52323 req_id = c9eeae5c-fc7e-4fb7-a8b4-6a85d85ad41b response_code = 200 uri = /network-bootstore-config
26082025-01-27T09:39:13.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61652
26092025-01-27T09:39:13.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61652 req_id = 29334bf7-8ab5-40ea-985f-699d2a8fb918 response_code = 200 uri = /vpc-routes
26102025-01-27T09:39:13.454ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
26112025-01-27T09:39:13.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61652 req_id = 71801ae2-aaa4-4b8f-8d0f-74ec1eadd971 response_code = 204 uri = /eip-gateways
26122025-01-27T09:39:13.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44449
26132025-01-27T09:39:13.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44449 req_id = 6988e038-6d81-44f4-afaf-b408c7c47d3c response_code = 200 uri = /v2p
26142025-01-27T09:39:13.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61652 req_id = 005b298f-3bbd-4a87-be05-bead22391d9a response_code = 204 uri = /vpc-routes
26152025-01-27T09:39:13.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56291
26162025-01-27T09:39:13.621ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26172025-01-27T09:39:13.656ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26182025-01-27T09:39:13.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87519 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56291 req_id = 65e8aff5-3ec9-4872-b067-5306ea57d7be response_code = 204 uri = /switch-ports
26192025-01-27T09:39:13.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56291 req_id = 2de062a0-958f-4a12-8041-bd0b0f554d7f response_code = 200 uri = /network-bootstore-config
26202025-01-27T09:39:16.830ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45771
26212025-01-27T09:39:16.830ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45771 req_id = 90701fe5-96aa-40e9-ad89-77ecf90eb9ef response_code = 200 uri = /baseboard
26222025-01-27T09:39:22.446ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
26232025-01-27T09:39:22.446ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26242025-01-27T09:39:22.478ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 111978, tv_nsec: 366222671 } time_to_next_cleanup = 599.99999497s
26252025-01-27T09:39:25.905ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7432 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = ca9f5bb7-eebb-4c22-9887-7802d37c1068 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
26262025-01-27T09:39:36.929ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
26272025-01-27T09:39:42.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45222
26282025-01-27T09:39:42.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45222 req_id = a87088f4-035a-43f3-bb19-b93af8188953 response_code = 200 uri = /vpc-routes
26292025-01-27T09:39:42.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
26302025-01-27T09:39:42.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45222 req_id = 3d2eaf02-153b-4735-bab7-dce91f095a3c response_code = 204 uri = /eip-gateways
26312025-01-27T09:39:42.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45222 req_id = 1c4ecd1c-ca66-4805-a1ec-cdf2b46a9854 response_code = 204 uri = /vpc-routes
26322025-01-27T09:39:42.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36394
26332025-01-27T09:39:42.586ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26342025-01-27T09:39:42.624ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26352025-01-27T09:39:42.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88961 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36394 req_id = 102c0596-0835-4185-8f4d-51dbd2966bbb response_code = 204 uri = /switch-ports
26362025-01-27T09:39:42.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62818
26372025-01-27T09:39:42.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36394 req_id = 606099f3-5e24-4cd4-96a0-ebdb706d64a1 response_code = 200 uri = /network-bootstore-config
26382025-01-27T09:39:42.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62818 req_id = ac13512b-a2be-4500-af2e-d76b4376cd23 response_code = 200 uri = /v2p
26392025-01-27T09:39:43.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63042
26402025-01-27T09:39:43.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63042 req_id = d4c8e4e9-58b3-4998-8bd7-0a947a0e34ac response_code = 200 uri = /vpc-routes
26412025-01-27T09:39:43.142ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
26422025-01-27T09:39:43.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63042 req_id = 1aa5ce22-f41c-4dfe-ade1-d4e28786e7de response_code = 204 uri = /eip-gateways
26432025-01-27T09:39:43.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63042 req_id = 96e092be-0a81-4fc4-8b8b-d95c42f8c8a9 response_code = 204 uri = /vpc-routes
26442025-01-27T09:39:43.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56494
26452025-01-27T09:39:43.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56494 req_id = 74f198a2-79eb-4c02-847e-6fe227899ec9 response_code = 200 uri = /v2p
26462025-01-27T09:39:43.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52195
26472025-01-27T09:39:43.283ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26482025-01-27T09:39:43.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26492025-01-27T09:39:43.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130697 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52195 req_id = 0e23a4da-11b6-41e6-a554-133f50f12639 response_code = 204 uri = /switch-ports
26502025-01-27T09:39:43.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52195 req_id = e17ec14a-7676-41d6-9d7b-879296bca56c response_code = 200 uri = /network-bootstore-config
26512025-01-27T09:39:43.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39184
26522025-01-27T09:39:43.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39184 req_id = 0a9624a1-867a-438d-85e8-1dec657870dd response_code = 200 uri = /vpc-routes
26532025-01-27T09:39:43.570ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
26542025-01-27T09:39:43.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39184 req_id = 40e84b7c-dbbb-4c93-bc95-c7e8a85f2ea7 response_code = 204 uri = /eip-gateways
26552025-01-27T09:39:43.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39184 req_id = b3dbe59c-4841-4f28-8a7e-309393af9fdb response_code = 204 uri = /vpc-routes
26562025-01-27T09:39:43.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63916
26572025-01-27T09:39:43.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63916 req_id = b5b1e12f-7165-4042-8d56-2f2df3086dbb response_code = 200 uri = /v2p
26582025-01-27T09:39:43.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53837
26592025-01-27T09:39:43.849ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26602025-01-27T09:39:43.888ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26612025-01-27T09:39:43.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93790 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53837 req_id = 07ca6b79-8dbb-4a62-b644-7a9fc1945c32 response_code = 204 uri = /switch-ports
26622025-01-27T09:39:43.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53837 req_id = f86f0de1-ff76-4d66-a1e1-64a145ab4742 response_code = 200 uri = /network-bootstore-config
26632025-01-27T09:39:46.861ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59170
26642025-01-27T09:39:46.861ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59170 req_id = 95665af0-a0fd-4b29-a789-687b0e22ef33 response_code = 200 uri = /baseboard
26652025-01-27T09:39:55.904ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7141 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 62ace10c-b55d-4e18-af64-f7ba0b61bac5 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
26662025-01-27T09:40:12.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64751
26672025-01-27T09:40:12.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64751 req_id = 2d3656e2-ae57-42f5-8a1e-8c0e62ed717e response_code = 200 uri = /vpc-routes
26682025-01-27T09:40:12.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40251
26692025-01-27T09:40:12.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40251 req_id = db9cab62-47c1-4647-bef4-b6834721ba44 response_code = 200 uri = /v2p
26702025-01-27T09:40:12.447ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
26712025-01-27T09:40:12.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64751 req_id = 58ac0ffb-f43f-4780-a39c-cfed95b6aa90 response_code = 204 uri = /eip-gateways
26722025-01-27T09:40:12.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64751 req_id = 73b3022a-1042-4bd9-bc80-889f4fc8e5f2 response_code = 204 uri = /vpc-routes
26732025-01-27T09:40:12.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40707
26742025-01-27T09:40:12.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26752025-01-27T09:40:12.522ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26762025-01-27T09:40:12.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92126 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40707 req_id = 79bcb345-c819-48f1-9fac-cbfedc7b3de0 response_code = 204 uri = /switch-ports
26772025-01-27T09:40:12.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40707 req_id = 2fe62f46-9bc8-4990-a5fe-e3ecf562f13c response_code = 200 uri = /network-bootstore-config
26782025-01-27T09:40:13.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61292
26792025-01-27T09:40:13.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61292 req_id = 9b451498-b082-4912-8319-933526a22631 response_code = 200 uri = /vpc-routes
26802025-01-27T09:40:13.017ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
26812025-01-27T09:40:13.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61292 req_id = b95e60a6-0239-40a7-a5ec-c8c96a04ecf5 response_code = 204 uri = /eip-gateways
26822025-01-27T09:40:13.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41274
26832025-01-27T09:40:13.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41274 req_id = e9567b83-4e19-4695-9a1a-51a4e943b153 response_code = 200 uri = /v2p
26842025-01-27T09:40:13.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61292 req_id = af127940-9686-4d2a-8f50-62d832e8efec response_code = 204 uri = /vpc-routes
26852025-01-27T09:40:13.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52544
26862025-01-27T09:40:13.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26872025-01-27T09:40:13.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26882025-01-27T09:40:13.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52544 req_id = aaeb8490-c11a-4a1a-b1c9-6321ee7c0f30 response_code = 204 uri = /switch-ports
26892025-01-27T09:40:13.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52544 req_id = 9ac61dd4-715c-45cd-8665-c51db9c91aa1 response_code = 200 uri = /network-bootstore-config
26902025-01-27T09:40:13.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53423
26912025-01-27T09:40:13.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53423 req_id = 4c584127-a4f4-4687-9a5b-be2952a2ba6b response_code = 200 uri = /v2p
26922025-01-27T09:40:13.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43157
26932025-01-27T09:40:13.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43157 req_id = 9bf7c942-7939-480c-863c-e348969797fe response_code = 200 uri = /vpc-routes
26942025-01-27T09:40:13.531ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
26952025-01-27T09:40:13.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43157 req_id = 119e809b-74d1-4b9e-8221-f8ece514841e response_code = 204 uri = /eip-gateways
26962025-01-27T09:40:13.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43157 req_id = a76b7105-79c3-42cf-ab6a-fc46493a38ad response_code = 204 uri = /vpc-routes
26972025-01-27T09:40:13.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40300
26982025-01-27T09:40:13.618ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26992025-01-27T09:40:13.656ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27002025-01-27T09:40:13.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40300 req_id = b712f9f4-e56e-4fa0-bf5c-a6c1d125345c response_code = 204 uri = /switch-ports
27012025-01-27T09:40:13.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40300 req_id = 3a448e09-6aa8-4dbc-b562-bf1f5b86e942 response_code = 200 uri = /network-bootstore-config
27022025-01-27T09:40:16.895ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63236
27032025-01-27T09:40:16.895ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63236 req_id = 9f5783ac-05c5-4059-b5e1-8d17b79d1c2d response_code = 200 uri = /baseboard
27042025-01-27T09:40:25.906ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8110 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = f4a9bb34-f035-43e6-9b9a-c0a8f3e71f80 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
27052025-01-27T09:40:42.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45497
27062025-01-27T09:40:42.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45497 req_id = 2b8c76fc-707e-45f0-9cdc-f00d2292b09a response_code = 200 uri = /vpc-routes
27072025-01-27T09:40:42.451ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
27082025-01-27T09:40:42.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45497 req_id = 56e96926-4987-4998-a6e5-1ab3713a9ac3 response_code = 204 uri = /eip-gateways
27092025-01-27T09:40:42.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45497 req_id = ab75b78f-9133-49fd-9e98-6682f24ed868 response_code = 204 uri = /vpc-routes
27102025-01-27T09:40:42.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45329
27112025-01-27T09:40:42.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45329 req_id = 702938b4-0791-46c6-aa74-012a874f5b05 response_code = 200 uri = /v2p
27122025-01-27T09:40:42.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53347
27132025-01-27T09:40:42.721ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27142025-01-27T09:40:42.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27152025-01-27T09:40:42.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53347 req_id = 8535cc3c-eb60-4bf9-acba-6e2c71d9c17d response_code = 204 uri = /switch-ports
27162025-01-27T09:40:42.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53347 req_id = 4a1ea78f-212c-4e76-88b0-2361d74b0be3 response_code = 200 uri = /network-bootstore-config
27172025-01-27T09:40:43.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43277
27182025-01-27T09:40:43.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43277 req_id = 03c878f4-4141-461d-a5ca-a21035720d91 response_code = 200 uri = /vpc-routes
27192025-01-27T09:40:43.175ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
27202025-01-27T09:40:43.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43277 req_id = ecc2532a-2725-4cff-ba1d-e01fdc606703 response_code = 204 uri = /eip-gateways
27212025-01-27T09:40:43.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43277 req_id = 08feb7b9-5582-4418-8d37-346eae19076e response_code = 204 uri = /vpc-routes
27222025-01-27T09:40:43.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47663
27232025-01-27T09:40:43.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47663 req_id = d3d33dca-3b91-4d38-b852-d7137b0d6956 response_code = 200 uri = /vpc-routes
27242025-01-27T09:40:43.557ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
27252025-01-27T09:40:43.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47663 req_id = 9877e660-6117-4fe9-b17c-434739ed3f00 response_code = 204 uri = /eip-gateways
27262025-01-27T09:40:43.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47663 req_id = f810f939-aac6-4ed9-9d26-d31ccccda81e response_code = 204 uri = /vpc-routes
27272025-01-27T09:40:43.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47541
27282025-01-27T09:40:43.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47541 req_id = 9359fe71-77d9-4945-8c9d-dd5b38d46a8e response_code = 200 uri = /v2p
27292025-01-27T09:40:43.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48165
27302025-01-27T09:40:43.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27312025-01-27T09:40:43.693ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27322025-01-27T09:40:43.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100497 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48165 req_id = e4df6fe2-e8b8-4cdb-bea6-b1cc5240f78d response_code = 204 uri = /switch-ports
27332025-01-27T09:40:43.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46228
27342025-01-27T09:40:43.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48165 req_id = ef51f5d3-9fbc-4e98-a6b9-7970323dac0a response_code = 200 uri = /network-bootstore-config
27352025-01-27T09:40:43.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46228 req_id = 0ee5d080-4bf4-4e9e-a3af-d3029de9d1ef response_code = 200 uri = /v2p
27362025-01-27T09:40:43.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49102
27372025-01-27T09:40:43.883ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27382025-01-27T09:40:43.919ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27392025-01-27T09:40:43.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90832 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49102 req_id = 8943c64e-76ef-48ff-9c68-121578c52393 response_code = 204 uri = /switch-ports
27402025-01-27T09:40:43.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49102 req_id = 4c65990f-0ab1-493f-a6fb-b1e809ef8d2a response_code = 200 uri = /network-bootstore-config
27412025-01-27T09:40:46.928ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40828
27422025-01-27T09:40:46.928ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40828 req_id = 0a798745-cd21-4c27-834c-eb8a1330f2b4 response_code = 200 uri = /baseboard
27432025-01-27T09:40:55.904ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7126 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 95369f4f-9557-40df-b096-bbe725cd2bba response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
27442025-01-27T09:41:12.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44628
27452025-01-27T09:41:12.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44628 req_id = 413a826a-8c8a-4aaf-91cb-9cb43054d50b response_code = 200 uri = /vpc-routes
27462025-01-27T09:41:12.438ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
27472025-01-27T09:41:12.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44628 req_id = 64e3a2bc-0164-4ac0-8830-f09ee29d9d36 response_code = 204 uri = /eip-gateways
27482025-01-27T09:41:12.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44628 req_id = 8aa6ea9d-c3a7-4c7f-aba1-5a9a9898a745 response_code = 204 uri = /vpc-routes
27492025-01-27T09:41:12.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51076
27502025-01-27T09:41:12.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51076 req_id = 1f10f578-e8df-4d16-b9b5-67aaefe1d41a response_code = 200 uri = /v2p
27512025-01-27T09:41:12.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62765
27522025-01-27T09:41:12.538ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27532025-01-27T09:41:12.575ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27542025-01-27T09:41:12.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92561 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62765 req_id = ad9fb555-3d31-4191-84d1-31e57be46375 response_code = 204 uri = /switch-ports
27552025-01-27T09:41:12.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62765 req_id = 6ec4623c-700a-4f4a-b527-1539d95598c2 response_code = 200 uri = /network-bootstore-config
27562025-01-27T09:41:12.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61825
27572025-01-27T09:41:12.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61825 req_id = 0ebebf2b-9bbc-4dae-96bb-a61bd4970433 response_code = 200 uri = /vpc-routes
27582025-01-27T09:41:13.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
27592025-01-27T09:41:13.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61825 req_id = cf9c4e1e-0e88-4a11-88e1-0867b8c90de3 response_code = 204 uri = /eip-gateways
27602025-01-27T09:41:13.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37338
27612025-01-27T09:41:13.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37338 req_id = 9073e461-0953-42ab-8e48-8f6ee0797d76 response_code = 200 uri = /v2p
27622025-01-27T09:41:13.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61825 req_id = 42205577-b8a8-4a6a-adb0-2202a696e554 response_code = 204 uri = /vpc-routes
27632025-01-27T09:41:13.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50152
27642025-01-27T09:41:13.079ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27652025-01-27T09:41:13.116ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27662025-01-27T09:41:13.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89496 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50152 req_id = d64e3ae3-20ec-484b-aae5-6874a3de4c2c response_code = 204 uri = /switch-ports
27672025-01-27T09:41:13.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50152 req_id = 6bbc063a-82fc-41d5-b297-ac7edb6a5a11 response_code = 200 uri = /network-bootstore-config
27682025-01-27T09:41:13.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48361
27692025-01-27T09:41:13.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48361 req_id = e0f6a0e4-9885-4a8c-ba58-eed0cb16c850 response_code = 200 uri = /vpc-routes
27702025-01-27T09:41:13.495ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
27712025-01-27T09:41:13.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48361 req_id = a758dbc5-2b5d-490a-ba20-141ee535bf87 response_code = 204 uri = /eip-gateways
27722025-01-27T09:41:13.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48361 req_id = 91ca287a-8c1d-479e-98c3-90eaa6552f35 response_code = 204 uri = /vpc-routes
27732025-01-27T09:41:13.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56849
27742025-01-27T09:41:13.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56849 req_id = a6dadf31-c542-4a42-9d46-aa4e1ff6d04a response_code = 200 uri = /v2p
27752025-01-27T09:41:13.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44782
27762025-01-27T09:41:13.598ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27772025-01-27T09:41:13.635ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27782025-01-27T09:41:13.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91413 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44782 req_id = e1930434-0e97-42fb-a594-90fc109a1866 response_code = 204 uri = /switch-ports
27792025-01-27T09:41:13.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44782 req_id = 9097693a-64e0-4fd1-89d1-03727933ac56 response_code = 200 uri = /network-bootstore-config
27802025-01-27T09:41:16.962ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54165
27812025-01-27T09:41:16.962ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54165 req_id = 8d537785-8f06-4092-87e2-02b41f9d406c response_code = 200 uri = /baseboard
27822025-01-27T09:41:25.903ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7151 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 26916142-9b5f-4505-8023-810aa450d476 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
27832025-01-27T09:41:42.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55188
27842025-01-27T09:41:42.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55188 req_id = 44ba9b82-50c3-41f9-881d-b4652aa11545 response_code = 200 uri = /vpc-routes
27852025-01-27T09:41:42.534ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
27862025-01-27T09:41:42.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55188 req_id = d6dd2e21-4df3-44e5-9886-149237572eb9 response_code = 204 uri = /eip-gateways
27872025-01-27T09:41:42.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49923
27882025-01-27T09:41:42.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49923 req_id = b21c7f91-762a-4b11-94b3-72efcd0d125f response_code = 200 uri = /v2p
27892025-01-27T09:41:42.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34905
27902025-01-27T09:41:42.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27912025-01-27T09:41:42.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27922025-01-27T09:41:42.660ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:177
27932025-01-27T09:41:42.660ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:177
27942025-01-27T09:41:42.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55188 req_id = ed0f2cf7-eeb4-4162-b96c-503894f2452a response_code = 204 uri = /vpc-routes
27952025-01-27T09:41:42.673ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27962025-01-27T09:41:42.673ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0
27972025-01-27T09:41:42.695ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27982025-01-27T09:41:42.695ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1990e07a-cfb7-436f-b017-73d119d10c34
27992025-01-27T09:41:42.716ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28002025-01-27T09:41:42.716ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_423760c6-8db9-4b47-b42b-49adac69df39
28012025-01-27T09:41:42.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47083
28022025-01-27T09:41:42.732ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28032025-01-27T09:41:42.738ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28042025-01-27T09:41:42.738ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe
28052025-01-27T09:41:42.761ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28062025-01-27T09:41:42.761ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57255367-8a48-44c0-b878-15bd0dd194f1
28072025-01-27T09:41:42.769ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28082025-01-27T09:41:42.784ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28092025-01-27T09:41:42.784ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3879af65-27ae-439f-861c-67ca34b4edf2
28102025-01-27T09:41:42.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52654
28112025-01-27T09:41:42.810ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28122025-01-27T09:41:42.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28132025-01-27T09:41:42.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28142025-01-27T09:41:42.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28152025-01-27T09:41:42.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28162025-01-27T09:41:42.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28172025-01-27T09:41:42.810ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28182025-01-27T09:41:42.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 958 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52654 req_id = 6b32d99f-d4f5-435e-a617-b184ac04b3a7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28192025-01-27T09:41:42.821ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28202025-01-27T09:41:42.821ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55
28212025-01-27T09:41:42.858ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28222025-01-27T09:41:42.859ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a
28232025-01-27T09:41:42.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133417 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47083 req_id = 014aed20-be58-4041-9449-f91f4db1496f response_code = 204 uri = /switch-ports
28242025-01-27T09:41:42.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47083 req_id = 227f7e2a-2750-4f35-8313-5277cd3bfb98 response_code = 200 uri = /network-bootstore-config
28252025-01-27T09:41:42.893ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28262025-01-27T09:41:42.893ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9
28272025-01-27T09:41:42.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 253852 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34905 req_id = e675a73b-5a6b-4d2e-a860-05179c108704 response_code = 200 uri = /inventory
28282025-01-27T09:41:43.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36313
28292025-01-27T09:41:43.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36313 req_id = 695c0d87-f8bc-48cb-b1eb-c0cff26379e2 response_code = 200 uri = /vpc-routes
28302025-01-27T09:41:43.148ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
28312025-01-27T09:41:43.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36313 req_id = ea3de0cb-506f-4d87-bc2a-c4899106a13e response_code = 204 uri = /eip-gateways
28322025-01-27T09:41:43.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36313 req_id = 86e8fbc1-215b-4c5e-b246-f3938208712a response_code = 204 uri = /vpc-routes
28332025-01-27T09:41:43.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47827
28342025-01-27T09:41:43.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47827 req_id = d0cc7a4e-df3f-4be7-ad71-5cd7cd9a811d response_code = 200 uri = /v2p
28352025-01-27T09:41:43.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58541
28362025-01-27T09:41:43.435ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28372025-01-27T09:41:43.435ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28382025-01-27T09:41:43.435ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:177
28392025-01-27T09:41:43.436ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:177
28402025-01-27T09:41:43.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54440
28412025-01-27T09:41:43.443ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28422025-01-27T09:41:43.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28432025-01-27T09:41:43.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28442025-01-27T09:41:43.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28452025-01-27T09:41:43.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28462025-01-27T09:41:43.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28472025-01-27T09:41:43.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28482025-01-27T09:41:43.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54440 req_id = 3a444adb-8e99-4363-a8d6-ac13211c8f52 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28492025-01-27T09:41:43.448ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28502025-01-27T09:41:43.448ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0
28512025-01-27T09:41:43.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35970
28522025-01-27T09:41:43.465ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28532025-01-27T09:41:43.470ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28542025-01-27T09:41:43.470ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1990e07a-cfb7-436f-b017-73d119d10c34
28552025-01-27T09:41:43.492ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28562025-01-27T09:41:43.492ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_423760c6-8db9-4b47-b42b-49adac69df39
28572025-01-27T09:41:43.499ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28582025-01-27T09:41:43.517ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28592025-01-27T09:41:43.517ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe
28602025-01-27T09:41:43.540ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28612025-01-27T09:41:43.540ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57255367-8a48-44c0-b878-15bd0dd194f1
28622025-01-27T09:41:43.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97392 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35970 req_id = 5f24be49-5c7a-4f7c-8706-6aae87afae6e response_code = 204 uri = /switch-ports
28632025-01-27T09:41:43.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35970 req_id = 149b6c4f-2f6d-4baa-88d9-c8ca5312e20a response_code = 200 uri = /network-bootstore-config
28642025-01-27T09:41:43.563ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28652025-01-27T09:41:43.563ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3879af65-27ae-439f-861c-67ca34b4edf2
28662025-01-27T09:41:43.586ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28672025-01-27T09:41:43.586ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55
28682025-01-27T09:41:43.606ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28692025-01-27T09:41:43.606ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a
28702025-01-27T09:41:43.626ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28712025-01-27T09:41:43.626ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9
28722025-01-27T09:41:43.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202510 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58541 req_id = d50f48a8-5f61-40e3-864a-af03dcc0049c response_code = 200 uri = /inventory
28732025-01-27T09:41:43.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47999
28742025-01-27T09:41:43.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47999 req_id = eb446ff8-d64f-469e-b2f0-a29f758ce074 response_code = 200 uri = /vpc-routes
28752025-01-27T09:41:43.737ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
28762025-01-27T09:41:43.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47999 req_id = 0bcc3f1a-31ae-4af9-bf98-c795f2694368 response_code = 204 uri = /eip-gateways
28772025-01-27T09:41:43.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47999 req_id = 22578f88-9420-4517-94de-4ecefc9cedf2 response_code = 204 uri = /vpc-routes
28782025-01-27T09:41:43.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39685
28792025-01-27T09:41:43.819ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28802025-01-27T09:41:43.819ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28812025-01-27T09:41:43.819ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/config/omicron-zones.json file = common/src/ledger.rs:177
28822025-01-27T09:41:43.819ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/config/omicron-zones.json file = common/src/ledger.rs:177
28832025-01-27T09:41:43.833ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bee98bfa-dfb4-4a8f-92f6-17149ee9def0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28842025-01-27T09:41:43.833ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bee98bfa-dfb4-4a8f-92f6-17149ee9def0
28852025-01-27T09:41:43.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34955
28862025-01-27T09:41:43.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28872025-01-27T09:41:43.864ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1990e07a-cfb7-436f-b017-73d119d10c34 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28882025-01-27T09:41:43.864ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1990e07a-cfb7-436f-b017-73d119d10c34
28892025-01-27T09:41:43.891ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28902025-01-27T09:41:43.894ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 423760c6-8db9-4b47-b42b-49adac69df39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28912025-01-27T09:41:43.896ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_423760c6-8db9-4b47-b42b-49adac69df39
28922025-01-27T09:41:43.922ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa79cf53-9240-461b-ab34-a909ac57a8fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28932025-01-27T09:41:43.922ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa79cf53-9240-461b-ab34-a909ac57a8fe
28942025-01-27T09:41:43.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48731
28952025-01-27T09:41:43.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48731 req_id = d395818e-3848-43b9-afde-16650cde7256 response_code = 200 uri = /v2p
28962025-01-27T09:41:43.946ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57255367-8a48-44c0-b878-15bd0dd194f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28972025-01-27T09:41:43.946ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57255367-8a48-44c0-b878-15bd0dd194f1
28982025-01-27T09:41:43.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111992 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34955 req_id = 1d4021e3-426f-4ac1-97a6-a0fdf5192e48 response_code = 204 uri = /switch-ports
28992025-01-27T09:41:43.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34955 req_id = b8157dec-20f8-4c56-8427-6c3416dac367 response_code = 200 uri = /network-bootstore-config
29002025-01-27T09:41:43.971ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3879af65-27ae-439f-861c-67ca34b4edf2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29012025-01-27T09:41:43.971ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3879af65-27ae-439f-861c-67ca34b4edf2
29022025-01-27T09:41:43.996ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fffdedc2-8da9-4b18-8b94-676a50c56a55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29032025-01-27T09:41:43.996ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fffdedc2-8da9-4b18-8b94-676a50c56a55
29042025-01-27T09:41:44.017ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4907ecd-72b0-4b94-88db-0ed5d4c83a8a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29052025-01-27T09:41:44.017ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e4907ecd-72b0-4b94-88db-0ed5d4c83a8a
29062025-01-27T09:41:44.038ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d2e77e6-d25f-4a9a-973f-7ad5072e27d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29072025-01-27T09:41:44.038ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5d2e77e6-d25f-4a9a-973f-7ad5072e27d9
29082025-01-27T09:41:44.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39685 req_id = edbb9d0a-59f2-45d8-9e8d-29c5698c85ec response_code = 200 uri = /inventory
29092025-01-27T09:41:44.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47930
29102025-01-27T09:41:44.141ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 90a0d1ca-5d4c-47f2-bf06-0a8cd74d722b, kind: Service { id: a15e36e8-b39a-414b-9d9d-d9079f61ed97 }, name: Name("external-dns-a15e36e8-b39a-414b-9d9d-d9079f61ed97"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f06774e6-6977-4b6e-a117-76b047a2ad92, kind: Service { id: 973be945-abc3-45ec-9b5d-b6b0e143999f }, name: Name("external-dns-973be945-abc3-45ec-9b5d-b6b0e143999f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 442e8dad-33c6-4cd0-a668-fde879cad901, kind: Service { id: 38339a12-b1a8-49b8-a1a9-3eea1fc5d180 }, name: Name("nexus-38339a12-b1a8-49b8-a1a9-3eea1fc5d180"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 255])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 482266d2-e9cd-4399-97f4-83dc207b794e, kind: Service { id: 31e6d238-77dc-443c-83f4-2b834aaac06c }, name: Name("nexus-31e6d238-77dc-443c-83f4-2b834aaac06c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 155])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60c92a39-8ba5-4f56-8ae1-aae3f6da748a, kind: Service { id: 1283cfe5-16ee-4e4b-b00b-94393a95c90e }, name: Name("nexus-1283cfe5-16ee-4e4b-b00b-94393a95c90e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 91])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29112025-01-27T09:41:44.141ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
29122025-01-27T09:41:44.141ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29132025-01-27T09:41:44.141ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29142025-01-27T09:41:44.141ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29152025-01-27T09:41:44.141ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29162025-01-27T09:41:44.141ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29172025-01-27T09:41:44.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47930 req_id = 3735e682-89a6-4fcc-8537-a0edbee902cd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29182025-01-27T09:41:46.996ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42375
29192025-01-27T09:41:46.996ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42375 req_id = 103b204c-5030-453e-8643-4ea3d7cbcad2 response_code = 200 uri = /baseboard
29202025-01-27T09:41:55.904ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8102 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 95a39bd7-62d9-4168-9441-05ca51892fee response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
29212025-01-27T09:42:12.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46603
29222025-01-27T09:42:12.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46603 req_id = 4c590ad5-8b4b-4d61-a4d7-e429871b8f3e response_code = 200 uri = /vpc-routes
29232025-01-27T09:42:12.330ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
29242025-01-27T09:42:12.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46603 req_id = 432635e6-f7d4-46a9-8f67-69190bfcfee3 response_code = 204 uri = /eip-gateways
29252025-01-27T09:42:12.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49179
29262025-01-27T09:42:12.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49179 req_id = 447bc1ff-c84b-406d-b602-f681fff4ae30 response_code = 200 uri = /v2p
29272025-01-27T09:42:12.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46603 req_id = a904bc1d-3733-42e7-ac49-50787749d6a9 response_code = 204 uri = /vpc-routes
29282025-01-27T09:42:12.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62357
29292025-01-27T09:42:12.418ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29302025-01-27T09:42:12.454ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29312025-01-27T09:42:12.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89181 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62357 req_id = b0981008-ab01-40ac-97fb-9a159c0a5457 response_code = 204 uri = /switch-ports
29322025-01-27T09:42:12.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62357 req_id = 79192bb2-268b-4724-9919-a9b68d2eef3b response_code = 200 uri = /network-bootstore-config
29332025-01-27T09:42:12.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58482
29342025-01-27T09:42:12.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58482 req_id = 4d83057a-2181-4621-a187-2664dd749a3d response_code = 200 uri = /vpc-routes
29352025-01-27T09:42:13.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
29362025-01-27T09:42:13.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58482 req_id = 3e722068-2ff0-4a8e-9145-705b979dfe87 response_code = 204 uri = /eip-gateways
29372025-01-27T09:42:13.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35913
29382025-01-27T09:42:13.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35913 req_id = 25c504a6-8818-4b35-bbca-431917da8d5b response_code = 200 uri = /v2p
29392025-01-27T09:42:13.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58482 req_id = b4bb8547-ec5c-4528-8548-6bb6107cdf73 response_code = 204 uri = /vpc-routes
29402025-01-27T09:42:13.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55591
29412025-01-27T09:42:13.150ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29422025-01-27T09:42:13.186ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29432025-01-27T09:42:13.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104488 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55591 req_id = 3485883a-6bec-47c8-bedc-cfbb9202ab66 response_code = 204 uri = /switch-ports
29442025-01-27T09:42:13.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55591 req_id = fbc0c991-0edf-4823-8b5b-3099ad39a95f response_code = 200 uri = /network-bootstore-config
29452025-01-27T09:42:13.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64131
29462025-01-27T09:42:13.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64131 req_id = f01b3cd6-774b-43cc-aed3-ef3787d335d3 response_code = 200 uri = /vpc-routes
29472025-01-27T09:42:13.507ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
29482025-01-27T09:42:13.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64131 req_id = 3532e136-b906-4d42-95fd-930135e4f3ce response_code = 204 uri = /eip-gateways
29492025-01-27T09:42:13.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64131 req_id = 1b8bb867-d490-436a-8fbf-840fec960619 response_code = 204 uri = /vpc-routes
29502025-01-27T09:42:13.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49451
29512025-01-27T09:42:13.535ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29522025-01-27T09:42:13.572ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29532025-01-27T09:42:13.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49451 req_id = 4fd65f01-d2d8-41e5-89aa-b992be20245d response_code = 204 uri = /switch-ports
29542025-01-27T09:42:13.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65507
29552025-01-27T09:42:13.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65507 req_id = 3e751c8f-db44-4d2f-9564-df559a8eacca response_code = 200 uri = /v2p
29562025-01-27T09:42:13.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49451 req_id = af65d52f-f5ce-4721-a302-4da49394c6b1 response_code = 200 uri = /network-bootstore-config
29572025-01-27T09:42:17.029ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62903
29582025-01-27T09:42:17.029ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62903 req_id = 1d2de370-b3e2-4c01-944a-3ab7308417eb response_code = 200 uri = /baseboard
29592025-01-27T09:42:25.904ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7529 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 275a6610-5b36-4bb8-bece-341cb847dc11 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
29602025-01-27T09:42:42.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41818
29612025-01-27T09:42:42.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41818 req_id = 3f792788-f996-4af3-bc40-cd0d2f15a183 response_code = 200 uri = /vpc-routes
29622025-01-27T09:42:42.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36734
29632025-01-27T09:42:42.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36734 req_id = 67a1a469-ea31-463c-88ec-ec8ecb10fc10 response_code = 200 uri = /v2p
29642025-01-27T09:42:42.601ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
29652025-01-27T09:42:42.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41818 req_id = 3ecb6b84-d281-4c98-9352-2e8de0adb56b response_code = 204 uri = /eip-gateways
29662025-01-27T09:42:42.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41818 req_id = 7cdf825b-08a2-4227-8127-bbde50a5c274 response_code = 204 uri = /vpc-routes
29672025-01-27T09:42:42.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56439
29682025-01-27T09:42:42.677ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29692025-01-27T09:42:42.715ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29702025-01-27T09:42:42.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91757 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56439 req_id = 7379b5fa-004c-49dc-b5a7-e33cf7d33085 response_code = 204 uri = /switch-ports
29712025-01-27T09:42:42.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56439 req_id = f317112f-47b3-4f26-9e0d-1e3c5e7eed4f response_code = 200 uri = /network-bootstore-config
29722025-01-27T09:42:43.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55833
29732025-01-27T09:42:43.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55833 req_id = 02e27d46-95c1-4e27-94f9-141a2e624a57 response_code = 200 uri = /vpc-routes
29742025-01-27T09:42:43.158ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
29752025-01-27T09:42:43.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55833 req_id = f530a046-956b-4b84-9a1e-936e10caa276 response_code = 204 uri = /eip-gateways
29762025-01-27T09:42:43.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57436
29772025-01-27T09:42:43.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57436 req_id = ef30ce27-12d2-493e-810c-ae64cb143229 response_code = 200 uri = /v2p
29782025-01-27T09:42:43.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55833 req_id = 066e32c3-dce7-4984-8561-3fb26fc5ddaa response_code = 204 uri = /vpc-routes
29792025-01-27T09:42:43.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60098
29802025-01-27T09:42:43.352ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29812025-01-27T09:42:43.390ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29822025-01-27T09:42:43.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95107 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60098 req_id = 126ae92a-fd3d-40db-b8e8-08e03b7bb661 response_code = 204 uri = /switch-ports
29832025-01-27T09:42:43.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60098 req_id = 00be5b8a-85f0-483b-90ce-4e08644a31ce response_code = 200 uri = /network-bootstore-config
29842025-01-27T09:42:43.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64061
29852025-01-27T09:42:43.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64061 req_id = c1960a8e-3b7e-4a69-a2be-b4dcc6cdeb50 response_code = 200 uri = /vpc-routes
29862025-01-27T09:42:43.616ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
29872025-01-27T09:42:43.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64061 req_id = 31d9a98e-a0e2-4ade-a292-dbcdc76e1f81 response_code = 204 uri = /eip-gateways
29882025-01-27T09:42:43.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64061 req_id = 9d7484af-64d6-4696-b3cc-198ecc3acb3b response_code = 204 uri = /vpc-routes
29892025-01-27T09:42:43.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59365
29902025-01-27T09:42:43.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59365 req_id = 0269e42b-d698-4d58-b28f-ff101d6b61be response_code = 200 uri = /v2p
29912025-01-27T09:42:43.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34732
29922025-01-27T09:42:43.867ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29932025-01-27T09:42:43.906ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29942025-01-27T09:42:43.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95599 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34732 req_id = 280d763f-9f39-4ae0-93b6-2a03edcb40b2 response_code = 204 uri = /switch-ports
29952025-01-27T09:42:43.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34732 req_id = f7279a75-3d4e-4888-8127-dbc30b77cc10 response_code = 200 uri = /network-bootstore-config
29962025-01-27T09:42:47.063ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42018
29972025-01-27T09:42:47.064ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42018 req_id = a2a8dcf8-062f-4a85-84f6-8479150e0e9a response_code = 200 uri = /baseboard
29982025-01-27T09:42:55.904ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8221 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = 3385d451-4d6e-4d23-acc5-7a9b79f8fa05 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
29992025-01-27T09:43:12.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41171
30002025-01-27T09:43:12.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41171 req_id = 4e8c1938-b411-4296-83b2-b779af6001cd response_code = 200 uri = /vpc-routes
30012025-01-27T09:43:12.408ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
30022025-01-27T09:43:12.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41171 req_id = 8f572f49-3c26-4189-8299-3878ce122761 response_code = 204 uri = /eip-gateways
30032025-01-27T09:43:12.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41171 req_id = cfd2ccd4-5e1d-464e-9fda-848290ff605f response_code = 204 uri = /vpc-routes
30042025-01-27T09:43:12.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63796
30052025-01-27T09:43:12.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63796 req_id = 7cbf57a9-c192-4cb8-b462-1992c72dfd05 response_code = 200 uri = /v2p
30062025-01-27T09:43:12.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50039
30072025-01-27T09:43:12.476ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
30082025-01-27T09:43:12.513ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
30092025-01-27T09:43:12.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89900 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50039 req_id = 055da4be-e0b4-4b38-8012-4e037c5b0d27 response_code = 204 uri = /switch-ports
30102025-01-27T09:43:12.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50039 req_id = 977b510e-cfdb-4e28-9c55-247d4f9a2dab response_code = 200 uri = /network-bootstore-config
30112025-01-27T09:43:12.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41628
30122025-01-27T09:43:12.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41628 req_id = 3f15d491-c06b-47d2-8e91-29a7fcc10f5e response_code = 200 uri = /vpc-routes
30132025-01-27T09:43:12.908ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
30142025-01-27T09:43:12.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41628 req_id = eaf44ffa-b558-4366-ab79-f4fef2951ea4 response_code = 204 uri = /eip-gateways
30152025-01-27T09:43:12.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41628 req_id = c0299663-b0d4-4adc-9905-121d849423db response_code = 204 uri = /vpc-routes
30162025-01-27T09:43:13.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53953
30172025-01-27T09:43:13.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53953 req_id = 2fefc16b-258d-44b3-9c2f-b739c27598d2 response_code = 200 uri = /v2p
30182025-01-27T09:43:13.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34642
30192025-01-27T09:43:13.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
30202025-01-27T09:43:13.145ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
30212025-01-27T09:43:13.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34642 req_id = ab98ae23-8b64-490d-ac4e-18fc4b86c519 response_code = 204 uri = /switch-ports
30222025-01-27T09:43:13.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34642 req_id = 92b5ee48-7a5e-4c94-9f0d-7f5ff1d79d26 response_code = 200 uri = /network-bootstore-config
30232025-01-27T09:43:13.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37349
30242025-01-27T09:43:13.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37349 req_id = 99f690df-a211-40b8-a8f6-b956be19aa95 response_code = 200 uri = /vpc-routes
30252025-01-27T09:43:13.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
30262025-01-27T09:43:13.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37349 req_id = db8508c2-1654-4146-9ae3-dbe9af75394a response_code = 204 uri = /eip-gateways
30272025-01-27T09:43:13.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53041
30282025-01-27T09:43:13.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53041 req_id = 510e1af3-d95f-47e9-bc09-754b649955cb response_code = 200 uri = /v2p
30292025-01-27T09:43:13.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37349 req_id = 5335ffd5-e774-4121-86d2-b0d2f52d757b response_code = 204 uri = /vpc-routes
30302025-01-27T09:43:13.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34740
30312025-01-27T09:43:13.597ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
30322025-01-27T09:43:13.637ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
30332025-01-27T09:43:13.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102479 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34740 req_id = d070b543-3422-4409-9c2a-4871bef38311 response_code = 204 uri = /switch-ports
30342025-01-27T09:43:13.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34740 req_id = da78bfe5-6677-4973-afce-d5dffe6b03b9 response_code = 200 uri = /network-bootstore-config
30352025-01-27T09:43:17.095ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63013
30362025-01-27T09:43:17.095ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63013 req_id = 49c36f1a-ba1e-425a-9d40-3449a19a6330 response_code = 200 uri = /baseboard
30372025-01-27T09:43:19.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50602
30382025-01-27T09:43:19.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50602 req_id = d20bbf37-90ff-4144-9144-7b505d97098e response_code = 200 uri = /v2p
30392025-01-27T09:43:19.601ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14282033) }
30402025-01-27T09:43:19.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1005 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50602 req_id = 9e113086-7094-4357-bcbf-2b44e0fc2d0a response_code = 204 uri = /v2p
30412025-01-27T09:43:19.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42506
30422025-01-27T09:43:19.724ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a2100e3e-ebbf-46fc-a7a8-af0405ceb305, kind: Instance { id: 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14282033), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2100e3e-ebbf-46fc-a7a8-af0405ceb305, kind: Instance { id: 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14282033), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2100e3e-ebbf-46fc-a7a8-af0405ceb305, kind: Instance { id: 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14282033), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14282033))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2100e3e-ebbf-46fc-a7a8-af0405ceb305, kind: Instance { id: 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14282033), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: f8a18d5a-c9c1-4731-957d-f7312ecf346d, slot: 0, read_only: false, vcr_json: .., name: "disk-eb943d92030" }], boot_settings: Some(InstanceBootSettings { order: [f8a18d5a-c9c1-4731-957d-f7312ecf346d] }), cloud_init_bytes: Some(..) } instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 metadata = InstanceMetadata { silo_id: f3801bad-ccc9-4a61-b9dc-6cf0cc9ace9e, project_id: afc0370c-77b4-4125-b163-3923cf169ce8 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-27T09:43:19.720431165Z }
30432025-01-27T09:43:19.724ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 migration_id = None propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30442025-01-27T09:43:19.724ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 migration_id = None propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a2100e3e-ebbf-46fc-a7a8-af0405ceb305, kind: Instance { id: 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14282033), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2100e3e-ebbf-46fc-a7a8-af0405ceb305, kind: Instance { id: 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14282033), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2100e3e-ebbf-46fc-a7a8-af0405ceb305, kind: Instance { id: 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14282033), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14282033))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a2100e3e-ebbf-46fc-a7a8-af0405ceb305, kind: Instance { id: 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14282033), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: f8a18d5a-c9c1-4731-957d-f7312ecf346d, slot: 0, read_only: false, vcr_json: .., name: "disk-eb943d92030" }], boot_settings: Some(InstanceBootSettings { order: [f8a18d5a-c9c1-4731-957d-f7312ecf346d] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-27T09:43:19.720431165Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30452025-01-27T09:43:19.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3645 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42506 req_id = 71936b91-5ced-4613-ae09-0c008879825c response_code = 200 uri = /vmms/b374b00b-11fb-4050-bbcc-f1b6db7691fb
30462025-01-27T09:43:19.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60709
30472025-01-27T09:43:19.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60709 req_id = 6ac9cb4a-8a54-43ec-8528-d1062bd73d2c response_code = 200 uri = /vmms/b374b00b-11fb-4050-bbcc-f1b6db7691fb/state
30482025-01-27T09:43:19.810ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 14282033 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30492025-01-27T09:43:19.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30502025-01-27T09:43:19.846ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb file = illumos-utils/src/zone.rs:325 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30512025-01-27T09:43:19.869ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb file = illumos-utils/src/zone.rs:363 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30522025-01-27T09:43:19.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36489
30532025-01-27T09:43:19.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36489 req_id = 76af3b17-7c6e-43fb-b1d6-30cf57687551 response_code = 200 uri = /vpc-routes
30542025-01-27T09:43:19.913ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {a2100e3e-ebbf-46fc-a7a8-af0405ceb305: {10.151.2.176: {0971bb7a-90be-40da-b92d-cd0db00252b7}, 10.151.2.175: {0971bb7a-90be-40da-b92d-cd0db00252b7}}} }
30552025-01-27T09:43:21.328ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30562025-01-27T09:43:21.328ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb zone file = illumos-utils/src/running_zone.rs:488 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb zone = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30572025-01-27T09:43:21.539ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 43.731313ms file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb zone = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30582025-01-27T09:43:21.591ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 133.101849ms file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb zone = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30592025-01-27T09:43:21.743ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 242.797723ms file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb zone = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30602025-01-27T09:43:21.999ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 221.728289ms file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb zone = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30612025-01-27T09:43:22.237ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 1.110772692s file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb zone = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30622025-01-27T09:43:23.359ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 1.365245117s file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb zone = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30632025-01-27T09:43:24.735ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 568.546861ms file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb zone = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30642025-01-27T09:43:25.314ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 1.486056937s file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb zone = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30652025-01-27T09:43:25.904ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8072 local_addr = [fd00:1122:3344:101::1]:34990 method = GET remote_addr = [fd00:1122:3344:101::d]:58433 req_id = dfbb5e1c-1730-4faa-bd1d-f8cc04f652e0 response_code = 200 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e uri = /d4e670d1-037a-4b75-80e2-234f2762bd9e
30662025-01-27T09:43:26.828ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb file = sled-agent/src/instance.rs:2068 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30672025-01-27T09:43:26.837ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 45.049451ms file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30682025-01-27T09:43:26.891ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb") failed: Property not found. retry in 139.471379ms file = illumos-utils/src/svc.rs:42 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30692025-01-27T09:43:27.041ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30702025-01-27T09:43:27.079ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30712025-01-27T09:43:27.216ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30722025-01-27T09:43:27.217ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-27T09:43:27.217842923Z } file = sled-agent/src/instance.rs:781 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30732025-01-27T09:43:27.217ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-27T09:43:27.217842923Z } propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30742025-01-27T09:43:27.217ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-27T09:43:27.217842923Z }, migration_in: None, migration_out: None }
30752025-01-27T09:43:27.218ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
30762025-01-27T09:43:27.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7305319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36489 req_id = 956683ce-f4a8-48cf-a2f2-7e2bb8e5254b response_code = 204 uri = /eip-gateways
30772025-01-27T09:43:27.245ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-27T09:43:27.245771642Z } file = sled-agent/src/instance.rs:781 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30782025-01-27T09:43:27.245ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-27T09:43:27.245771642Z } propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30792025-01-27T09:43:27.245ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-27T09:43:27.245771642Z }, migration_in: None, migration_out: None }
30802025-01-27T09:43:27.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 488 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36489 req_id = 3f6031fe-d149-46e1-828d-c19f7d13e212 response_code = 204 uri = /vpc-routes
30812025-01-27T09:43:37.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47493
30822025-01-27T09:43:37.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 501 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47493 req_id = 15341099-390e-4f82-9d56-b25923bc99b4 response_code = 200 uri = /vmms/b374b00b-11fb-4050-bbcc-f1b6db7691fb/state
30832025-01-27T09:43:37.450ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-27T09:43:37.450088771Z } file = sled-agent/src/instance.rs:781 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30842025-01-27T09:43:37.450ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-27T09:43:37.450088771Z } propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30852025-01-27T09:43:37.450ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-27T09:43:37.450088771Z }, migration_in: None, migration_out: None }
30862025-01-27T09:43:37.460ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-27T09:43:37.460241247Z } file = sled-agent/src/instance.rs:781 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30872025-01-27T09:43:37.460ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-27T09:43:37.460241247Z } propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30882025-01-27T09:43:37.460ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30892025-01-27T09:43:37.460ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30902025-01-27T09:43:37.460ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14582254955230385964 n_samples = 6 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
30912025-01-27T09:43:37.460ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 413199625347176018 n_samples = 6 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
30922025-01-27T09:43:37.460ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30932025-01-27T09:43:37.460ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/9bf2ba33-d3cb-4144-b51f-90c70d8d5724/debug/bundle/zone", "/pool/int/cad27d61-4ea4-49f1-9eb2-c04cb25a9e5b/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/bee98bfa-dfb4-4a8f-92f6-17149ee9def0/crypt/debug", "/pool/ext/1990e07a-cfb7-436f-b017-73d119d10c34/crypt/debug", "/pool/ext/423760c6-8db9-4b47-b42b-49adac69df39/crypt/debug", "/pool/ext/fa79cf53-9240-461b-ab34-a909ac57a8fe/crypt/debug", "/pool/ext/57255367-8a48-44c0-b878-15bd0dd194f1/crypt/debug", "/pool/ext/3879af65-27ae-439f-861c-67ca34b4edf2/crypt/debug", "/pool/ext/fffdedc2-8da9-4b18-8b94-676a50c56a55/crypt/debug", "/pool/ext/e4907ecd-72b0-4b94-88db-0ed5d4c83a8a/crypt/debug", "/pool/ext/5d2e77e6-d25f-4a9a-973f-7ad5072e27d9/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb
30942025-01-27T09:43:38.078ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb", bundle_id: 17f6710a-e5d7-46e2-92e7-1ccd4bb99f52 }, time_created: 2025-01-27T09:43:37.461023525Z, version: 0, cause: TerminatedInstance }
30952025-01-27T09:43:38.078ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_b374b00b-11fb-4050-bbcc-f1b6db7691fb file = sled-agent/src/instance.rs:1314 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30962025-01-27T09:43:39.818ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
30972025-01-27T09:43:39.834ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(14282033), kind: System }
30982025-01-27T09:43:39.834ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(14282033), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30992025-01-27T09:43:39.835ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-27T09:43:39.835220685Z }, migration_in: None, migration_out: None }
31002025-01-27T09:43:39.867ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-27T09:43:39.835220685Z }, migration_in: None, migration_out: None }
31012025-01-27T09:43:39.872ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = 0ca49833-6392-48ba-924a-b5ff6bcf1fb4 propolis_id = b374b00b-11fb-4050-bbcc-f1b6db7691fb
31022025-01-27T09:43:40.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54451
31032025-01-27T09:43:40.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54451 req_id = f96aa69e-0e5c-44b4-b043-2c15fe1a8cf4 response_code = 200 uri = /vpc-routes
31042025-01-27T09:43:40.349ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {a2100e3e-ebbf-46fc-a7a8-af0405ceb305: {10.151.2.176: {0971bb7a-90be-40da-b92d-cd0db00252b7}, 10.151.2.175: {0971bb7a-90be-40da-b92d-cd0db00252b7}}} }
31052025-01-27T09:43:40.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54451 req_id = c816f347-fda0-4355-8058-3e5e7c5f1d3b response_code = 204 uri = /eip-gateways
31062025-01-27T09:43:40.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54451 req_id = 6eaa711a-27e9-4b1b-9b0f-f9a8ca16ac3a response_code = 204 uri = /vpc-routes
31072025-01-27T09:43:40.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57977
31082025-01-27T09:43:40.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57977 req_id = f9666b18-957d-424f-b053-fe0dff0e2a77 response_code = 200 uri = /v2p
31092025-01-27T09:43:40.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59079
31102025-01-27T09:43:40.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59079 req_id = 0dfc710b-9cb6-423a-8f5b-a5b358eda416 response_code = 200 uri = /v2p
31112025-01-27T09:43:40.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42525
31122025-01-27T09:43:40.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42525 req_id = 2c2a331f-d1d3-4af4-8233-745242b5ba24 response_code = 200 uri = /vpc-routes
31132025-01-27T09:43:40.896ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
31142025-01-27T09:43:40.896ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e
31152025-01-27T09:43:40.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42525 req_id = 6717eba3-008a-408f-879b-22ffbe6c5749 response_code = 204 uri = /eip-gateways
31162025-01-27T09:43:40.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42525 req_id = 4644dd73-8665-411b-adc8-11febcc7f291 response_code = 204 uri = /vpc-routes
31172025-01-27T09:43:41.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45668
31182025-01-27T09:43:41.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45668 req_id = b0464ab6-de26-4ef7-8a8f-ea13725e5d00 response_code = 200 uri = /vpc-routes
31192025-01-27T09:43:41.434ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
31202025-01-27T09:43:41.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45668 req_id = 399949ca-cfd3-48af-8f21-15c589a7f3d3 response_code = 204 uri = /eip-gateways
31212025-01-27T09:43:41.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45668 req_id = de6f9f98-ca2b-40b3-a82b-96522f13e002 response_code = 204 uri = /vpc-routes
31222025-01-27T09:43:42.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63417
31232025-01-27T09:43:42.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63417 req_id = 35d01f7c-00ed-4e64-86fd-8485dd40e92a response_code = 200 uri = /vpc-routes
31242025-01-27T09:43:42.485ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
31252025-01-27T09:43:42.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63417 req_id = 5c2f4e35-e6b8-4930-9d4a-68c111b564e9 response_code = 204 uri = /eip-gateways
31262025-01-27T09:43:42.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63417 req_id = 788d300a-90cb-4691-9dd8-07b7d180b948 response_code = 204 uri = /vpc-routes
31272025-01-27T09:43:42.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42729
31282025-01-27T09:43:42.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42729 req_id = 1bdc1cd3-20c0-4498-964e-424ccb5ad531 response_code = 200 uri = /v2p
31292025-01-27T09:43:42.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57723
31302025-01-27T09:43:42.681ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
31312025-01-27T09:43:42.715ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
31322025-01-27T09:43:42.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89491 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57723 req_id = 58d098fb-3bfd-4ac3-8dad-aa98f1848ffb response_code = 204 uri = /switch-ports
31332025-01-27T09:43:42.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57723 req_id = 922f9436-e15e-46c9-90bd-bab61029f055 response_code = 200 uri = /network-bootstore-config
31342025-01-27T09:43:43.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58934
31352025-01-27T09:43:43.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58934 req_id = 20c27079-3a6f-47b4-af78-156d64633ca2 response_code = 200 uri = /vpc-routes
31362025-01-27T09:43:43.134ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
31372025-01-27T09:43:43.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58934 req_id = 80b7f917-c896-46da-9b5a-e28f8107be5b response_code = 204 uri = /eip-gateways
31382025-01-27T09:43:43.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43983
31392025-01-27T09:43:43.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43983 req_id = b1457721-f43d-45c4-9d56-f3ed24ff26c3 response_code = 200 uri = /v2p
31402025-01-27T09:43:43.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58934 req_id = f1d7cf53-0f48-4e7b-bffb-93c64c805c16 response_code = 204 uri = /vpc-routes
31412025-01-27T09:43:43.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63054
31422025-01-27T09:43:43.331ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
31432025-01-27T09:43:43.379ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
31442025-01-27T09:43:43.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111534 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63054 req_id = f0947614-48d4-46e6-9adf-81995c986dbb response_code = 204 uri = /switch-ports
31452025-01-27T09:43:43.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63054 req_id = 3fef7770-3d15-4701-ba80-35ccb3228696 response_code = 200 uri = /network-bootstore-config
31462025-01-27T09:43:43.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60657
31472025-01-27T09:43:43.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60657 req_id = 38d226cf-b101-4130-9c1a-d18bbd36a9e2 response_code = 200 uri = /v2p
31482025-01-27T09:43:43.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37380
31492025-01-27T09:43:43.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37380 req_id = 2fb669f2-dd32-43dc-8f1c-30f99ef68281 response_code = 200 uri = /vpc-routes
31502025-01-27T09:43:43.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d4e670d1-037a-4b75-80e2-234f2762bd9e values = ExternalIpGatewayMap { mappings: {} }
31512025-01-27T09:43:43.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37380 req_id = 87652256-1b58-45d1-a4a9-a09b75ea35b9 response_code = 204 uri = /eip-gateways
31522025-01-27T09:43:43.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37380 req_id = 41085358-8849-489f-95bd-1fda9668f808 response_code = 204 uri = /vpc-routes
31532025-01-27T09:43:43.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41146
31542025-01-27T09:43:43.785ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
31552025-01-27T09:43:43.822ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
31562025-01-27T09:43:43.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89596 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41146 req_id = 94a311de-abfe-4005-bee5-dbe6385b2fdc response_code = 204 uri = /switch-ports
31572025-01-27T09:43:43.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41146 req_id = f1469493-e943-4baf-bee1-41b66e5f92c1 response_code = 200 uri = /network-bootstore-config