Max level shown:
1 [ Jan 25 03:51:04 Enabled. ]
2 [ Jan 25 03:51:04 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 25 03:51:04 Method "start" exited with status 0. ]
4 [ Jan 25 03:51:04 Rereading configuration. ]
5 [ Jan 25 03:51:04 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-25T03:51:04.365ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-25T03:51:04.365ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-25T03:51:04.418ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-25T03:51:04.418ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-25T03:51:04.533ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-25T03:51:04.542ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-25T03:51:04.550ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-25T03:51:05.154ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-25T03:51:05.294ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-25T03:51:05.294ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-25T03:51:05.294ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-25T03:51:05.294ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-25T03:51:05.294ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-01-25T03:51:05.294ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-01-25T03:51:05.297ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-25T03:51:05.297ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-25T03:51:05.297ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-25T03:51:05.297ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-25T03:51:05.297ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-25T03:51:05.297ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-25T03:51:05.297ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-25T03:51:05.297ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-25T03:51:05.297ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-25T03:51:05.308ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-25T03:51:05.308ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool)
322025-01-25T03:51:05.406ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal }
332025-01-25T03:51:05.769ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-25T03:51:05.769ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-25T03:51:05.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-25T03:51:05.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-25T03:51:05.769ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-25T03:51:05.770ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-25T03:51:05.770ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-25T03:51:05.777ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-25T03:51:05.777ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool)
422025-01-25T03:51:05.866ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal }
432025-01-25T03:51:06.230ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-25T03:51:06.230ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-25T03:51:06.230ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-25T03:51:06.230ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-25T03:51:06.230ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-25T03:51:06.230ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-25T03:51:06.230ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-25T03:51:06.230ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-25T03:51:06.230ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-25T03:51:06.230ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
532025-01-25T03:51:06.230ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542025-01-25T03:51:06.230ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-25T03:51:06.230ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-25T03:51:06.230ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-25T03:51:06.230ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-25T03:51:06.230ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-25T03:51:06.230ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-25T03:51:06.230ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-25T03:51:06.230ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-25T03:51:06.230ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-25T03:51:06.231ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-25T03:51:06.231ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-25T03:51:06.231ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-25T03:51:06.231ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-25T03:51:06.231ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-25T03:51:06.231ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-25T03:51:06.231ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-25T03:51:06.231ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
752025-01-25T03:51:06.231ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
762025-01-25T03:51:06.231ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792025-01-25T03:51:06.231ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-25T03:51:06.231ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-01-25T03:51:06.231ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-01-25T03:51:06.231ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-01-25T03:51:06.231ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-25T03:51:06.231ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882025-01-25T03:51:06.231ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
892025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
902025-01-25T03:51:06.231ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912025-01-25T03:51:06.231ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-25T03:51:06.231ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-25T03:51:06.231ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942025-01-25T03:51:06.231ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-25T03:51:06.231ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-25T03:51:06.231ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-25T03:51:06.231ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-01-25T03:51:06.231ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-01-25T03:51:06.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-25T03:51:06.231ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-25T03:51:06.231ZINFOSledAgent (bootstore): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-25T03:51:06.231ZINFOSledAgent (bootstore): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-25T03:51:06.231ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-25T03:51:06.231ZINFOSledAgent (bootstore): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-25T03:51:06.231ZINFOSledAgent (bootstore): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-25T03:51:06.231ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-25T03:51:06.231ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-25T03:51:06.231ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-25T03:51:06.242ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-25T03:51:06.242ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1410, tv_nsec: 224321324 } time_to_next_cleanup = 599.999947568s
1142025-01-25T03:51:06.242ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-25T03:51:06.242ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-25T03:51:06.242ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-25T03:51:06.242ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-25T03:51:06.245ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-25T03:51:06.247ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-25T03:51:06.248ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-25T03:51:06.248ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-25T03:51:06.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-25T03:51:06.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-25T03:51:06.248ZINFOSledAgent (RSS): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-25T03:51:06.248ZINFOSledAgent (RSS): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-25T03:51:06.248ZINFOSledAgent (RSS): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-25T03:51:06.248ZINFOSledAgent (RSS): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-25T03:51:06.248ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-25T03:51:06.248ZINFOSledAgent (RSS): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-25T03:51:06.248ZINFOSledAgent (RSS): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-25T03:51:06.248ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-25T03:51:06.248ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-25T03:51:06.248ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-25T03:51:06.248ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-25T03:51:06.248ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-25T03:51:06.248ZINFOSledAgent (bootstore): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-25T03:51:06.249ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-25T03:51:06.249ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-25T03:51:06.249ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a (sled), rack_id: 42a05221-d852-42ad-b6fd-11b17ffaeead, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-25T03:51:06.250ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-25T03:51:06.250ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-25T03:51:06.254ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-25T03:51:06.260ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-25T03:51:06.260ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-25T03:51:06.265ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-25T03:51:06.265ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-25T03:51:06.265ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:57591
1482025-01-25T03:51:06.265ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a (sled), rack_id: 42a05221-d852-42ad-b6fd-11b17ffaeead, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-25T03:51:06.265ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-25T03:51:06.265ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-25T03:51:06.265ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-25T03:51:06.265ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-25T03:51:06.265ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-25T03:51:06.265ZINFOSledAgent (StorageManager): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-25T03:51:06.265ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562025-01-25T03:51:06.265ZINFOSledAgent (StorageManager): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-25T03:51:06.265ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-25T03:51:06.265ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-25T03:51:06.265ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-25T03:51:06.265ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-25T03:51:06.265ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-25T03:51:06.282ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-25T03:51:06.303ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-25T03:51:06.320ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-25T03:51:06.328ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
1662025-01-25T03:51:06.328ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-25T03:51:06.328ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
1682025-01-25T03:51:06.328ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-25T03:51:06.331ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 73.580248ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4f6d2432-e1e1-4d09-9ee3-8939bf0781a2", "content-length": "124", "date": "Sat, 25 Jan 2025 03:51:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4f6d2432-e1e1-4d09-9ee3-8939bf0781a2" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-25T03:51:06.341ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_04cd7a7f-a882-495d-8185-a9a5ea285a59/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-25T03:51:06.365ZINFOSledAgent: successfully created encrypted zvol: name="oxi_04cd7a7f-a882-495d-8185-a9a5ea285a59/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-25T03:51:06.365ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_04cd7a7f-a882-495d-8185-a9a5ea285a59/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-25T03:51:06.370ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
1742025-01-25T03:51:06.370ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-25T03:51:06.370ZINFOSledAgent (BackingFs): Ensuring dataset oxi_04cd7a7f-a882-495d-8185-a9a5ea285a59/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-25T03:51:06.407ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-25T03:51:06.410ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 75.656412ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "79e4ab16-51a8-4b6a-8d81-11da14d9afe4", "content-length": "124", "date": "Sat, 25 Jan 2025 03:51:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "79e4ab16-51a8-4b6a-8d81-11da14d9afe4" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-25T03:51:06.441ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-25T03:51:06.486ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-25T03:51:06.487ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 122.57729ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1178e74e-1026-4fe2-be6b-00d27c20fad0", "content-length": "124", "date": "Sat, 25 Jan 2025 03:51:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1178e74e-1026-4fe2-be6b-00d27c20fad0" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-25T03:51:06.610ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822025-01-25T03:51:06.610ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 257.838283ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bbe8dbbd-71f8-4d99-a989-23b18edb32ff", "content-length": "124", "date": "Sat, 25 Jan 2025 03:51:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bbe8dbbd-71f8-4d99-a989-23b18edb32ff" } file = clients/ddm-admin-client/src/lib.rs:177
1832025-01-25T03:51:06.662ZINFOSledAgent (BackingFs): Mounting oxi_04cd7a7f-a882-495d-8185-a9a5ea285a59/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842025-01-25T03:51:06.675ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852025-01-25T03:51:06.675ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862025-01-25T03:51:06.675ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872025-01-25T03:51:06.675ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882025-01-25T03:51:06.869ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-25T03:51:06.873ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 300.156999ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2162bdba-2ae5-488a-b219-8a50aae6f1fd", "content-length": "124", "date": "Sat, 25 Jan 2025 03:51:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2162bdba-2ae5-488a-b219-8a50aae6f1fd" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-25T03:51:07.174ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-25T03:51:07.175ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 128.518937ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9fa90362-56c0-4809-bfc4-ace8a4eb8b9d", "content-length": "124", "date": "Sat, 25 Jan 2025 03:51:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9fa90362-56c0-4809-bfc4-ace8a4eb8b9d" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-25T03:51:07.304ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-25T03:51:07.304ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 227.110649ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fc72befd-d40b-46d9-b205-9712f9c4fe45", "content-length": "124", "date": "Sat, 25 Jan 2025 03:51:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fc72befd-d40b-46d9-b205-9712f9c4fe45" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-25T03:51:07.408ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
1952025-01-25T03:51:07.414ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:57087 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
1962025-01-25T03:51:07.414ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
1972025-01-25T03:51:07.414ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:57087 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
1982025-01-25T03:51:07.415ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 277.732378ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
1992025-01-25T03:51:07.416ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2002025-01-25T03:51:07.416ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2012025-01-25T03:51:07.416ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2022025-01-25T03:51:07.416ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-25T03:51:07.532ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042025-01-25T03:51:07.694ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 321.187729ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2052025-01-25T03:51:08.017ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.443350261s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2062025-01-25T03:51:09.462ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.046305725s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2072025-01-25T03:51:10.005ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2082025-01-25T03:51:10.005ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2092025-01-25T03:51:10.005ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2102025-01-25T03:51:10.005ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2112025-01-25T03:51:10.005ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2122025-01-25T03:51:10.005ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2132025-01-25T03:51:10.007ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2142025-01-25T03:51:10.009ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2152025-01-25T03:51:10.009ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='4df2ab5b-bee1-4568-b5bb-805f0705a864'/> <propval type="astring" name="rack_id" value='42a05221-d852-42ad-b6fd-11b17ffaeead'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feaa:a61a'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='42a05221-d852-42ad-b6fd-11b17ffaeead'/> <propval type="astring" name="sled_id" value='7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a'/> <propval type="astring" name="rack_uuid" value='42a05221-d852-42ad-b6fd-11b17ffaeead'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a'/> <propval type="astring" name="rack_uuid" value='42a05221-d852-42ad-b6fd-11b17ffaeead'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-25T03:51:10.009ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-25T03:51:10.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 70.039526ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-25T03:51:10.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 98.733493ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-25T03:51:10.510ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.054031388s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2202025-01-25T03:51:10.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 252.081847ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-25T03:51:10.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 271.772286ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-25T03:51:11.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.080462213s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-01-25T03:51:12.566ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.738406979s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2242025-01-25T03:51:12.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 780.044841ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-01-25T03:51:13.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.233052147s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-01-25T03:51:14.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 550.254158ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2272025-01-25T03:51:15.936ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/nexus.rs:527 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2282025-01-25T03:51:15.967ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292025-01-25T03:51:15.967ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2302025-01-25T03:51:15.968ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2312025-01-25T03:51:15.968ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322025-01-25T03:51:15.968ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2332025-01-25T03:51:15.968ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-25T03:51:15.968ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-01-25T03:51:15.968ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362025-01-25T03:51:15.968ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372025-01-25T03:51:15.969ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2382025-01-25T03:51:15.969ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:57591
2392025-01-25T03:51:16.186ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2402025-01-25T03:51:16.187ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2412025-01-25T03:51:16.192ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422025-01-25T03:51:16.192ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2432025-01-25T03:51:16.192ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442025-01-25T03:51:16.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40810
2452025-01-25T03:51:16.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-01-25T03:51:16.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472025-01-25T03:51:16.482ZINFOSledAgent (ServiceManager): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-01-25T03:51:16.482ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:188
2492025-01-25T03:51:16.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 533 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40810 req_id = 2ad2efb9-4ce0-483e-83ce-c760d5771432 response_code = 200 uri = /inventory
2502025-01-25T03:51:16.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42376
2512025-01-25T03:51:16.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42376 req_id = 71d8a7cd-9708-4759-9072-709f4d27b256 response_code = 200 uri = /sled-role
2522025-01-25T03:51:16.543ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 1e443136-1001-4e3e-a564-2e12dea77820 (physical_disk), pool_id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 36713b94-4314-4cea-8f3d-3d769a6da20f (physical_disk), pool_id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 3e017a81-5101-4ccf-a8ff-225406a3907d (physical_disk), pool_id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 58630250-761e-4c9d-988d-ac3167223c8d (physical_disk), pool_id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5e92db06-194a-4268-9ead-b38dc0ff9981 (physical_disk), pool_id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 647631fd-1add-43a0-8d3b-e439afea67c4 (physical_disk), pool_id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: a5a0aa78-414f-44cc-8fa6-be92f0f46cda (physical_disk), pool_id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: b62adcc8-8b26-449a-875a-07cf0231a402 (physical_disk), pool_id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e60fe21f-4765-40f2-991a-78e562607a10 (physical_disk), pool_id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532025-01-25T03:51:16.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50593
2542025-01-25T03:51:16.543ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2552025-01-25T03:51:16.544ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 1e443136-1001-4e3e-a564-2e12dea77820 (physical_disk), pool_id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 36713b94-4314-4cea-8f3d-3d769a6da20f (physical_disk), pool_id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 3e017a81-5101-4ccf-a8ff-225406a3907d (physical_disk), pool_id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 58630250-761e-4c9d-988d-ac3167223c8d (physical_disk), pool_id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5e92db06-194a-4268-9ead-b38dc0ff9981 (physical_disk), pool_id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 647631fd-1add-43a0-8d3b-e439afea67c4 (physical_disk), pool_id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: a5a0aa78-414f-44cc-8fa6-be92f0f46cda (physical_disk), pool_id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: b62adcc8-8b26-449a-875a-07cf0231a402 (physical_disk), pool_id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e60fe21f-4765-40f2-991a-78e562607a10 (physical_disk), pool_id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2562025-01-25T03:51:16.544ZINFOSledAgent (StorageManager): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572025-01-25T03:51:16.544ZINFOSledAgent (StorageManager): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582025-01-25T03:51:16.544ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2592025-01-25T03:51:16.544ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602025-01-25T03:51:16.544ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612025-01-25T03:51:16.544ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622025-01-25T03:51:16.544ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632025-01-25T03:51:16.694ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642025-01-25T03:51:16.694ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool)
2652025-01-25T03:51:16.970ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/probe_manager.rs:231 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2662025-01-25T03:51:17.395ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.214572908s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2672025-01-25T03:51:17.418ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14040775082169136304 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2682025-01-25T03:51:17.419ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13712341694280551368 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2692025-01-25T03:51:17.858ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2702025-01-25T03:51:17.872ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }
2712025-01-25T03:51:17.880ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2722025-01-25T03:51:17.880ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2732025-01-25T03:51:17.880ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2742025-01-25T03:51:17.880ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2752025-01-25T03:51:17.880ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762025-01-25T03:51:17.880ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772025-01-25T03:51:17.880ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2782025-01-25T03:51:17.913ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2792025-01-25T03:51:17.921ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/zone file = sled-storage/src/dataset.rs:302
2802025-01-25T03:51:17.971ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/probe_manager.rs:231 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
2812025-01-25T03:51:18.057ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28 file = sled-storage/src/dataset.rs:388
2822025-01-25T03:51:18.065ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2832025-01-25T03:51:18.065ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2842025-01-25T03:51:18.065ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2852025-01-25T03:51:18.065ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2862025-01-25T03:51:18.065ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2872025-01-25T03:51:18.076ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2882025-01-25T03:51:18.076ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool)
2892025-01-25T03:51:18.171ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }
2902025-01-25T03:51:18.179ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2912025-01-25T03:51:18.179ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2922025-01-25T03:51:18.179ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2932025-01-25T03:51:18.179ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2942025-01-25T03:51:18.179ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952025-01-25T03:51:18.179ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2962025-01-25T03:51:18.179ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2972025-01-25T03:51:18.216ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2982025-01-25T03:51:18.224ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b/crypt/zone file = sled-storage/src/dataset.rs:302
2992025-01-25T03:51:18.363ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b file = sled-storage/src/dataset.rs:388
3002025-01-25T03:51:18.371ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3012025-01-25T03:51:18.371ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3022025-01-25T03:51:18.371ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3032025-01-25T03:51:18.371ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3042025-01-25T03:51:18.371ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3052025-01-25T03:51:18.381ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3062025-01-25T03:51:18.381ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool)
3072025-01-25T03:51:18.473ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }
3082025-01-25T03:51:18.480ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3092025-01-25T03:51:18.480ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3102025-01-25T03:51:18.480ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3112025-01-25T03:51:18.480ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3122025-01-25T03:51:18.480ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132025-01-25T03:51:18.480ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3142025-01-25T03:51:18.480ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3152025-01-25T03:51:18.512ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3162025-01-25T03:51:18.519ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/zone file = sled-storage/src/dataset.rs:302
3172025-01-25T03:51:18.657ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a file = sled-storage/src/dataset.rs:388
3182025-01-25T03:51:18.666ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3192025-01-25T03:51:18.666ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3202025-01-25T03:51:18.666ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3212025-01-25T03:51:18.666ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3222025-01-25T03:51:18.666ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232025-01-25T03:51:18.676ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3242025-01-25T03:51:18.676ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool)
3252025-01-25T03:51:18.773ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }
3262025-01-25T03:51:18.781ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3272025-01-25T03:51:18.781ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3282025-01-25T03:51:18.781ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3292025-01-25T03:51:18.781ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3302025-01-25T03:51:18.781ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312025-01-25T03:51:18.782ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322025-01-25T03:51:18.782ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3332025-01-25T03:51:18.817ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3342025-01-25T03:51:18.825ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone file = sled-storage/src/dataset.rs:302
3352025-01-25T03:51:18.964ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_44c151b9-2034-4667-9c87-189bf684b2e4 file = sled-storage/src/dataset.rs:388
3362025-01-25T03:51:18.972ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3372025-01-25T03:51:18.972ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3382025-01-25T03:51:18.972ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3392025-01-25T03:51:18.972ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402025-01-25T03:51:18.972ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412025-01-25T03:51:18.976ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/probe_manager.rs:231 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
3422025-01-25T03:51:18.982ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3432025-01-25T03:51:18.982ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool)
3442025-01-25T03:51:19.082ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }
3452025-01-25T03:51:19.090ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3462025-01-25T03:51:19.090ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3472025-01-25T03:51:19.090ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3482025-01-25T03:51:19.090ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3492025-01-25T03:51:19.090ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502025-01-25T03:51:19.090ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3512025-01-25T03:51:19.090ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3522025-01-25T03:51:19.126ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3532025-01-25T03:51:19.134ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/zone file = sled-storage/src/dataset.rs:302
3542025-01-25T03:51:19.273ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c file = sled-storage/src/dataset.rs:388
3552025-01-25T03:51:19.281ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3562025-01-25T03:51:19.281ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3572025-01-25T03:51:19.281ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3582025-01-25T03:51:19.281ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3592025-01-25T03:51:19.281ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3602025-01-25T03:51:19.291ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3612025-01-25T03:51:19.291ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 97661079-bff0-45d9-bae2-2b9215898f21 (zpool)
3622025-01-25T03:51:19.386ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }
3632025-01-25T03:51:19.394ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3642025-01-25T03:51:19.394ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3652025-01-25T03:51:19.394ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3662025-01-25T03:51:19.394ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3672025-01-25T03:51:19.394ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682025-01-25T03:51:19.394ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3692025-01-25T03:51:19.394ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3702025-01-25T03:51:19.430ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3712025-01-25T03:51:19.439ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone file = sled-storage/src/dataset.rs:302
3722025-01-25T03:51:19.580ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_97661079-bff0-45d9-bae2-2b9215898f21 file = sled-storage/src/dataset.rs:388
3732025-01-25T03:51:19.588ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3742025-01-25T03:51:19.588ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3752025-01-25T03:51:19.588ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3762025-01-25T03:51:19.588ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3772025-01-25T03:51:19.588ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3782025-01-25T03:51:19.597ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3792025-01-25T03:51:19.597ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool)
3802025-01-25T03:51:19.705ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }
3812025-01-25T03:51:19.713ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3822025-01-25T03:51:19.713ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3832025-01-25T03:51:19.713ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3842025-01-25T03:51:19.713ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3852025-01-25T03:51:19.713ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862025-01-25T03:51:19.714ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872025-01-25T03:51:19.714ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3882025-01-25T03:51:19.749ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892025-01-25T03:51:19.757ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone file = sled-storage/src/dataset.rs:302
3902025-01-25T03:51:19.894ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3 file = sled-storage/src/dataset.rs:388
3912025-01-25T03:51:19.902ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922025-01-25T03:51:19.902ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932025-01-25T03:51:19.902ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942025-01-25T03:51:19.902ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952025-01-25T03:51:19.902ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962025-01-25T03:51:19.911ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3972025-01-25T03:51:19.911ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool)
3982025-01-25T03:51:20.007ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }
3992025-01-25T03:51:20.016ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4002025-01-25T03:51:20.016ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4012025-01-25T03:51:20.016ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4022025-01-25T03:51:20.016ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4032025-01-25T03:51:20.016ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042025-01-25T03:51:20.017ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052025-01-25T03:51:20.017ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4062025-01-25T03:51:20.020ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/probe_manager.rs:231 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4072025-01-25T03:51:20.053ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4082025-01-25T03:51:20.061ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f/crypt/zone file = sled-storage/src/dataset.rs:302
4092025-01-25T03:51:20.198ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f file = sled-storage/src/dataset.rs:388
4102025-01-25T03:51:20.206ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4112025-01-25T03:51:20.206ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4122025-01-25T03:51:20.206ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4132025-01-25T03:51:20.206ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4142025-01-25T03:51:20.206ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4152025-01-25T03:51:20.217ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4162025-01-25T03:51:20.217ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool)
4172025-01-25T03:51:20.312ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }
4182025-01-25T03:51:20.319ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4192025-01-25T03:51:20.319ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4202025-01-25T03:51:20.319ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4212025-01-25T03:51:20.319ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4222025-01-25T03:51:20.319ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232025-01-25T03:51:20.320ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242025-01-25T03:51:20.320ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4252025-01-25T03:51:20.366ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4262025-01-25T03:51:20.374ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/zone file = sled-storage/src/dataset.rs:302
4272025-01-25T03:51:20.515ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_30589e38-7481-4de9-b63b-77c66cbf4a51 file = sled-storage/src/dataset.rs:388
4282025-01-25T03:51:20.523ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4292025-01-25T03:51:20.523ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4302025-01-25T03:51:20.523ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-01-25T03:51:20.523ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04cd7a7f-a882-495d-8185-a9a5ea285a59 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b504f21a-ab7c-41ff-9869-9461f9b13936 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4322025-01-25T03:51:20.523ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4332025-01-25T03:51:20.523ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4342025-01-25T03:51:20.523ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352025-01-25T03:51:20.524ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4362025-01-25T03:51:20.524ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4372025-01-25T03:51:20.524ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4382025-01-25T03:51:20.524ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4392025-01-25T03:51:20.524ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4402025-01-25T03:51:20.524ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4412025-01-25T03:51:20.524ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4422025-01-25T03:51:20.524ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4432025-01-25T03:51:20.524ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4442025-01-25T03:51:20.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3980602 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50593 req_id = f1af1912-a10b-4afa-a394-30f5d886b654 response_code = 200 uri = /omicron-physical-disks
4452025-01-25T03:51:20.556ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {02b453e0-cad9-418c-91e0-9ca58b6199d7 (dataset): DatasetConfig { id: 02b453e0-cad9-418c-91e0-9ca58b6199d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11432422-c00a-413d-9034-6aac5e930d82 (dataset): DatasetConfig { id: 11432422-c00a-413d-9034-6aac5e930d82 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 117a807c-2d00-4bc1-8c90-3aec3cd61b2c (dataset): DatasetConfig { id: 117a807c-2d00-4bc1-8c90-3aec3cd61b2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 11a791db-4041-4823-829c-7db3b0253065 (dataset): DatasetConfig { id: 11a791db-4041-4823-829c-7db3b0253065 (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 121aaf9b-60e3-4c2a-822e-dfe8b8bc02c5 (dataset): DatasetConfig { id: 121aaf9b-60e3-4c2a-822e-dfe8b8bc02c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18a1a5d7-3396-458c-8bef-104004f6a9d7 (dataset): DatasetConfig { id: 18a1a5d7-3396-458c-8bef-104004f6a9d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1da0d69d-c9cf-407f-ade1-a4237fefa5a1 (dataset): DatasetConfig { id: 1da0d69d-c9cf-407f-ade1-a4237fefa5a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1eb891e8-4738-421a-ab18-b23aaba35f27 (dataset): DatasetConfig { id: 1eb891e8-4738-421a-ab18-b23aaba35f27 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fb112a0-365d-484c-b755-449ddac9df3b (dataset): DatasetConfig { id: 1fb112a0-365d-484c-b755-449ddac9df3b (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22f0266c-bec3-4d93-be85-36a87d3607bd (dataset): DatasetConfig { id: 22f0266c-bec3-4d93-be85-36a87d3607bd (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25f5645e-5eab-4c98-a7b8-4382c7739b48 (dataset): DatasetConfig { id: 25f5645e-5eab-4c98-a7b8-4382c7739b48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 277910ec-bc75-4064-a14e-95a0459214de (dataset): DatasetConfig { id: 277910ec-bc75-4064-a14e-95a0459214de (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 27931c0d-a8f7-45d3-a4ba-8524a23ee78b (dataset): DatasetConfig { id: 27931c0d-a8f7-45d3-a4ba-8524a23ee78b (dataset), name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29b22408-14bf-4f20-8442-44bdd3012abc (dataset): DatasetConfig { id: 29b22408-14bf-4f20-8442-44bdd3012abc (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c32d053-e88d-4454-8d2c-009d2ede63eb (dataset): DatasetConfig { id: 2c32d053-e88d-4454-8d2c-009d2ede63eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2ec8e787-7ec2-4814-8d9f-69d2e5bfe04e (dataset): DatasetConfig { id: 2ec8e787-7ec2-4814-8d9f-69d2e5bfe04e (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fa1a777-32f3-48fa-9772-1e165432dd30 (dataset): DatasetConfig { id: 2fa1a777-32f3-48fa-9772-1e165432dd30 (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34bfff3a-5177-4de4-9117-90aae69fc55b (dataset): DatasetConfig { id: 34bfff3a-5177-4de4-9117-90aae69fc55b (dataset), name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 373bd986-f26a-4972-9977-bdc52d9c90c4 (dataset): DatasetConfig { id: 373bd986-f26a-4972-9977-bdc52d9c90c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c7db2a6-b276-47d7-b74e-51be8cfcb24d (dataset): DatasetConfig { id: 3c7db2a6-b276-47d7-b74e-51be8cfcb24d (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cabde6f-c4a3-474e-9138-3d7644264761 (dataset): DatasetConfig { id: 3cabde6f-c4a3-474e-9138-3d7644264761 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44b441af-5a0d-4fe8-8d2c-7ddc5f9b6e1f (dataset): DatasetConfig { id: 44b441af-5a0d-4fe8-8d2c-7ddc5f9b6e1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a09513e-4750-4546-8c38-dff9d8fefb57 (dataset): DatasetConfig { id: 4a09513e-4750-4546-8c38-dff9d8fefb57 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bd0713f-c246-42ab-88a3-aeec7aee37ed (dataset): DatasetConfig { id: 4bd0713f-c246-42ab-88a3-aeec7aee37ed (dataset), name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54425f27-4616-431e-a2aa-703c81c9094d (dataset): DatasetConfig { id: 54425f27-4616-431e-a2aa-703c81c9094d (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5813b0d1-2559-4057-84f9-436dfe4cf6a9 (dataset): DatasetConfig { id: 5813b0d1-2559-4057-84f9-436dfe4cf6a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59ac6c3f-8844-4e4e-81b1-b3f5ab2ae7ed (dataset): DatasetConfig { id: 59ac6c3f-8844-4e4e-81b1-b3f5ab2ae7ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66d2fa8f-022f-482c-b567-3e1b3e628506 (dataset): DatasetConfig { id: 66d2fa8f-022f-482c-b567-3e1b3e628506 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 690094c0-c343-40ad-acc9-5ccc7ff0af34 (dataset): DatasetConfig { id: 690094c0-c343-40ad-acc9-5ccc7ff0af34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72104d0e-c3cc-4eaa-86d1-e6107b1b12e8 (dataset): DatasetConfig { id: 72104d0e-c3cc-4eaa-86d1-e6107b1b12e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7221bb86-bd34-41f3-8c03-25d10dccab5c (dataset): DatasetConfig { id: 7221bb86-bd34-41f3-8c03-25d10dccab5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80136036-9407-4ac9-bdc1-46959985d616 (dataset): DatasetConfig { id: 80136036-9407-4ac9-bdc1-46959985d616 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8111bdba-935c-4e0f-bacb-f218feb3a189 (dataset): DatasetConfig { id: 8111bdba-935c-4e0f-bacb-f218feb3a189 (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83a12971-f2dd-4b80-9e70-b01d54050a0b (dataset): DatasetConfig { id: 83a12971-f2dd-4b80-9e70-b01d54050a0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89884543-5735-4ded-afeb-9e8185e19654 (dataset): DatasetConfig { id: 89884543-5735-4ded-afeb-9e8185e19654 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8af54a4f-f6d9-44b4-a9fa-c25bafe1f597 (dataset): DatasetConfig { id: 8af54a4f-f6d9-44b4-a9fa-c25bafe1f597 (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f995f24-0f79-42e5-9a0a-184fe8ca71d5 (dataset): DatasetConfig { id: 8f995f24-0f79-42e5-9a0a-184fe8ca71d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92d5dd74-3cb4-41c9-bf79-c0eb1ee598d3 (dataset): DatasetConfig { id: 92d5dd74-3cb4-41c9-bf79-c0eb1ee598d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95e847aa-e7e3-46e9-9f24-1f64cbbc17d1 (dataset): DatasetConfig { id: 95e847aa-e7e3-46e9-9f24-1f64cbbc17d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9775326f-583e-45da-b166-fd92484a6072 (dataset): DatasetConfig { id: 9775326f-583e-45da-b166-fd92484a6072 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9c2c83c0-29b2-4d57-80a1-5a5525ac0971 (dataset): DatasetConfig { id: 9c2c83c0-29b2-4d57-80a1-5a5525ac0971 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f0b5e04-6935-4da6-aec5-cb7b0de2aafe (dataset): DatasetConfig { id: 9f0b5e04-6935-4da6-aec5-cb7b0de2aafe (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f52dd9c-d1e7-4fda-bcbb-61e105130191 (dataset): DatasetConfig { id: 9f52dd9c-d1e7-4fda-bcbb-61e105130191 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a047a448-ca63-4861-95b7-93fdff476d33 (dataset): DatasetConfig { id: a047a448-ca63-4861-95b7-93fdff476d33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1eee07a-2acd-425b-acef-6ce36739fc55 (dataset): DatasetConfig { id: a1eee07a-2acd-425b-acef-6ce36739fc55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6956cbe-abc9-492f-911c-1b1a5ec00f87 (dataset): DatasetConfig { id: a6956cbe-abc9-492f-911c-1b1a5ec00f87 (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae5cb0f9-8006-446c-b11a-c23e144ab6e6 (dataset): DatasetConfig { id: ae5cb0f9-8006-446c-b11a-c23e144ab6e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1ed27ee-1c71-42f9-9ea7-3f0383070cea (dataset): DatasetConfig { id: b1ed27ee-1c71-42f9-9ea7-3f0383070cea (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b22fa7f1-c384-4631-a87a-4327577eced4 (dataset): DatasetConfig { id: b22fa7f1-c384-4631-a87a-4327577eced4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b23957a8-543b-4dff-a60b-0a74e0829317 (dataset): DatasetConfig { id: b23957a8-543b-4dff-a60b-0a74e0829317 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b25b1c72-c0eb-4d12-89c7-dd4e13bef2ad (dataset): DatasetConfig { id: b25b1c72-c0eb-4d12-89c7-dd4e13bef2ad (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c309bc61-b3e2-4859-b190-6ca12b0eecf0 (dataset): DatasetConfig { id: c309bc61-b3e2-4859-b190-6ca12b0eecf0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c732dfb6-c2f2-4f4e-83a6-c2dbd2333fa3 (dataset): DatasetConfig { id: c732dfb6-c2f2-4f4e-83a6-c2dbd2333fa3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c85db5ba-067f-4130-86cf-bd0a38c7751a (dataset): DatasetConfig { id: c85db5ba-067f-4130-86cf-bd0a38c7751a (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca74fe62-c3da-4c54-9c9a-edff319cafda (dataset): DatasetConfig { id: ca74fe62-c3da-4c54-9c9a-edff319cafda (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0922896-fe7f-4869-9908-723f49c19a51 (dataset): DatasetConfig { id: d0922896-fe7f-4869-9908-723f49c19a51 (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3276405-6ff6-48e2-ae6e-725e9fb717cc (dataset): DatasetConfig { id: d3276405-6ff6-48e2-ae6e-725e9fb717cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d80f1d99-2144-40eb-8936-8ace515d9ea2 (dataset): DatasetConfig { id: d80f1d99-2144-40eb-8936-8ace515d9ea2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8708673-a32a-4772-a049-95daeb961441 (dataset): DatasetConfig { id: d8708673-a32a-4772-a049-95daeb961441 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d870b921-2415-4958-95e9-807c38d1f191 (dataset): DatasetConfig { id: d870b921-2415-4958-95e9-807c38d1f191 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7433379-a787-4367-a4ed-472ebdc1d035 (dataset): DatasetConfig { id: e7433379-a787-4367-a4ed-472ebdc1d035 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e91c64e4-a831-4b27-97ce-c1f8d037158c (dataset): DatasetConfig { id: e91c64e4-a831-4b27-97ce-c1f8d037158c (dataset), name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed1a39fd-f692-40eb-9dbe-c38e19a49004 (dataset): DatasetConfig { id: ed1a39fd-f692-40eb-9dbe-c38e19a49004 (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, eeb08e0e-6efc-4735-b135-e9dde3e94817 (dataset): DatasetConfig { id: eeb08e0e-6efc-4735-b135-e9dde3e94817 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6c19cea-03be-472c-9b0c-114f5e6652f9 (dataset): DatasetConfig { id: f6c19cea-03be-472c-9b0c-114f5e6652f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc1f514b-e945-4d2f-9238-c590a9c1fc39 (dataset): DatasetConfig { id: fc1f514b-e945-4d2f-9238-c590a9c1fc39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4462025-01-25T03:51:20.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44346
4472025-01-25T03:51:20.557ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4482025-01-25T03:51:20.557ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {02b453e0-cad9-418c-91e0-9ca58b6199d7 (dataset): DatasetConfig { id: 02b453e0-cad9-418c-91e0-9ca58b6199d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11432422-c00a-413d-9034-6aac5e930d82 (dataset): DatasetConfig { id: 11432422-c00a-413d-9034-6aac5e930d82 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 117a807c-2d00-4bc1-8c90-3aec3cd61b2c (dataset): DatasetConfig { id: 117a807c-2d00-4bc1-8c90-3aec3cd61b2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 11a791db-4041-4823-829c-7db3b0253065 (dataset): DatasetConfig { id: 11a791db-4041-4823-829c-7db3b0253065 (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 121aaf9b-60e3-4c2a-822e-dfe8b8bc02c5 (dataset): DatasetConfig { id: 121aaf9b-60e3-4c2a-822e-dfe8b8bc02c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18a1a5d7-3396-458c-8bef-104004f6a9d7 (dataset): DatasetConfig { id: 18a1a5d7-3396-458c-8bef-104004f6a9d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1da0d69d-c9cf-407f-ade1-a4237fefa5a1 (dataset): DatasetConfig { id: 1da0d69d-c9cf-407f-ade1-a4237fefa5a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1eb891e8-4738-421a-ab18-b23aaba35f27 (dataset): DatasetConfig { id: 1eb891e8-4738-421a-ab18-b23aaba35f27 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fb112a0-365d-484c-b755-449ddac9df3b (dataset): DatasetConfig { id: 1fb112a0-365d-484c-b755-449ddac9df3b (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22f0266c-bec3-4d93-be85-36a87d3607bd (dataset): DatasetConfig { id: 22f0266c-bec3-4d93-be85-36a87d3607bd (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25f5645e-5eab-4c98-a7b8-4382c7739b48 (dataset): DatasetConfig { id: 25f5645e-5eab-4c98-a7b8-4382c7739b48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 277910ec-bc75-4064-a14e-95a0459214de (dataset): DatasetConfig { id: 277910ec-bc75-4064-a14e-95a0459214de (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 27931c0d-a8f7-45d3-a4ba-8524a23ee78b (dataset): DatasetConfig { id: 27931c0d-a8f7-45d3-a4ba-8524a23ee78b (dataset), name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29b22408-14bf-4f20-8442-44bdd3012abc (dataset): DatasetConfig { id: 29b22408-14bf-4f20-8442-44bdd3012abc (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c32d053-e88d-4454-8d2c-009d2ede63eb (dataset): DatasetConfig { id: 2c32d053-e88d-4454-8d2c-009d2ede63eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2ec8e787-7ec2-4814-8d9f-69d2e5bfe04e (dataset): DatasetConfig { id: 2ec8e787-7ec2-4814-8d9f-69d2e5bfe04e (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fa1a777-32f3-48fa-9772-1e165432dd30 (dataset): DatasetConfig { id: 2fa1a777-32f3-48fa-9772-1e165432dd30 (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34bfff3a-5177-4de4-9117-90aae69fc55b (dataset): DatasetConfig { id: 34bfff3a-5177-4de4-9117-90aae69fc55b (dataset), name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 373bd986-f26a-4972-9977-bdc52d9c90c4 (dataset): DatasetConfig { id: 373bd986-f26a-4972-9977-bdc52d9c90c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c7db2a6-b276-47d7-b74e-51be8cfcb24d (dataset): DatasetConfig { id: 3c7db2a6-b276-47d7-b74e-51be8cfcb24d (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cabde6f-c4a3-474e-9138-3d7644264761 (dataset): DatasetConfig { id: 3cabde6f-c4a3-474e-9138-3d7644264761 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44b441af-5a0d-4fe8-8d2c-7ddc5f9b6e1f (dataset): DatasetConfig { id: 44b441af-5a0d-4fe8-8d2c-7ddc5f9b6e1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a09513e-4750-4546-8c38-dff9d8fefb57 (dataset): DatasetConfig { id: 4a09513e-4750-4546-8c38-dff9d8fefb57 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bd0713f-c246-42ab-88a3-aeec7aee37ed (dataset): DatasetConfig { id: 4bd0713f-c246-42ab-88a3-aeec7aee37ed (dataset), name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54425f27-4616-431e-a2aa-703c81c9094d (dataset): DatasetConfig { id: 54425f27-4616-431e-a2aa-703c81c9094d (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5813b0d1-2559-4057-84f9-436dfe4cf6a9 (dataset): DatasetConfig { id: 5813b0d1-2559-4057-84f9-436dfe4cf6a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59ac6c3f-8844-4e4e-81b1-b3f5ab2ae7ed (dataset): DatasetConfig { id: 59ac6c3f-8844-4e4e-81b1-b3f5ab2ae7ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66d2fa8f-022f-482c-b567-3e1b3e628506 (dataset): DatasetConfig { id: 66d2fa8f-022f-482c-b567-3e1b3e628506 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 690094c0-c343-40ad-acc9-5ccc7ff0af34 (dataset): DatasetConfig { id: 690094c0-c343-40ad-acc9-5ccc7ff0af34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72104d0e-c3cc-4eaa-86d1-e6107b1b12e8 (dataset): DatasetConfig { id: 72104d0e-c3cc-4eaa-86d1-e6107b1b12e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7221bb86-bd34-41f3-8c03-25d10dccab5c (dataset): DatasetConfig { id: 7221bb86-bd34-41f3-8c03-25d10dccab5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80136036-9407-4ac9-bdc1-46959985d616 (dataset): DatasetConfig { id: 80136036-9407-4ac9-bdc1-46959985d616 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8111bdba-935c-4e0f-bacb-f218feb3a189 (dataset): DatasetConfig { id: 8111bdba-935c-4e0f-bacb-f218feb3a189 (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83a12971-f2dd-4b80-9e70-b01d54050a0b (dataset): DatasetConfig { id: 83a12971-f2dd-4b80-9e70-b01d54050a0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89884543-5735-4ded-afeb-9e8185e19654 (dataset): DatasetConfig { id: 89884543-5735-4ded-afeb-9e8185e19654 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8af54a4f-f6d9-44b4-a9fa-c25bafe1f597 (dataset): DatasetConfig { id: 8af54a4f-f6d9-44b4-a9fa-c25bafe1f597 (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f995f24-0f79-42e5-9a0a-184fe8ca71d5 (dataset): DatasetConfig { id: 8f995f24-0f79-42e5-9a0a-184fe8ca71d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92d5dd74-3cb4-41c9-bf79-c0eb1ee598d3 (dataset): DatasetConfig { id: 92d5dd74-3cb4-41c9-bf79-c0eb1ee598d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95e847aa-e7e3-46e9-9f24-1f64cbbc17d1 (dataset): DatasetConfig { id: 95e847aa-e7e3-46e9-9f24-1f64cbbc17d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9775326f-583e-45da-b166-fd92484a6072 (dataset): DatasetConfig { id: 9775326f-583e-45da-b166-fd92484a6072 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9c2c83c0-29b2-4d57-80a1-5a5525ac0971 (dataset): DatasetConfig { id: 9c2c83c0-29b2-4d57-80a1-5a5525ac0971 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f0b5e04-6935-4da6-aec5-cb7b0de2aafe (dataset): DatasetConfig { id: 9f0b5e04-6935-4da6-aec5-cb7b0de2aafe (dataset), name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f52dd9c-d1e7-4fda-bcbb-61e105130191 (dataset): DatasetConfig { id: 9f52dd9c-d1e7-4fda-bcbb-61e105130191 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a047a448-ca63-4861-95b7-93fdff476d33 (dataset): DatasetConfig { id: a047a448-ca63-4861-95b7-93fdff476d33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1eee07a-2acd-425b-acef-6ce36739fc55 (dataset): DatasetConfig { id: a1eee07a-2acd-425b-acef-6ce36739fc55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6956cbe-abc9-492f-911c-1b1a5ec00f87 (dataset): DatasetConfig { id: a6956cbe-abc9-492f-911c-1b1a5ec00f87 (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae5cb0f9-8006-446c-b11a-c23e144ab6e6 (dataset): DatasetConfig { id: ae5cb0f9-8006-446c-b11a-c23e144ab6e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1ed27ee-1c71-42f9-9ea7-3f0383070cea (dataset): DatasetConfig { id: b1ed27ee-1c71-42f9-9ea7-3f0383070cea (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b22fa7f1-c384-4631-a87a-4327577eced4 (dataset): DatasetConfig { id: b22fa7f1-c384-4631-a87a-4327577eced4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b23957a8-543b-4dff-a60b-0a74e0829317 (dataset): DatasetConfig { id: b23957a8-543b-4dff-a60b-0a74e0829317 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b25b1c72-c0eb-4d12-89c7-dd4e13bef2ad (dataset): DatasetConfig { id: b25b1c72-c0eb-4d12-89c7-dd4e13bef2ad (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c309bc61-b3e2-4859-b190-6ca12b0eecf0 (dataset): DatasetConfig { id: c309bc61-b3e2-4859-b190-6ca12b0eecf0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c732dfb6-c2f2-4f4e-83a6-c2dbd2333fa3 (dataset): DatasetConfig { id: c732dfb6-c2f2-4f4e-83a6-c2dbd2333fa3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c85db5ba-067f-4130-86cf-bd0a38c7751a (dataset): DatasetConfig { id: c85db5ba-067f-4130-86cf-bd0a38c7751a (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca74fe62-c3da-4c54-9c9a-edff319cafda (dataset): DatasetConfig { id: ca74fe62-c3da-4c54-9c9a-edff319cafda (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0922896-fe7f-4869-9908-723f49c19a51 (dataset): DatasetConfig { id: d0922896-fe7f-4869-9908-723f49c19a51 (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3276405-6ff6-48e2-ae6e-725e9fb717cc (dataset): DatasetConfig { id: d3276405-6ff6-48e2-ae6e-725e9fb717cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d80f1d99-2144-40eb-8936-8ace515d9ea2 (dataset): DatasetConfig { id: d80f1d99-2144-40eb-8936-8ace515d9ea2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8708673-a32a-4772-a049-95daeb961441 (dataset): DatasetConfig { id: d8708673-a32a-4772-a049-95daeb961441 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d870b921-2415-4958-95e9-807c38d1f191 (dataset): DatasetConfig { id: d870b921-2415-4958-95e9-807c38d1f191 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7433379-a787-4367-a4ed-472ebdc1d035 (dataset): DatasetConfig { id: e7433379-a787-4367-a4ed-472ebdc1d035 (dataset), name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e91c64e4-a831-4b27-97ce-c1f8d037158c (dataset): DatasetConfig { id: e91c64e4-a831-4b27-97ce-c1f8d037158c (dataset), name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed1a39fd-f692-40eb-9dbe-c38e19a49004 (dataset): DatasetConfig { id: ed1a39fd-f692-40eb-9dbe-c38e19a49004 (dataset), name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, eeb08e0e-6efc-4735-b135-e9dde3e94817 (dataset): DatasetConfig { id: eeb08e0e-6efc-4735-b135-e9dde3e94817 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6c19cea-03be-472c-9b0c-114f5e6652f9 (dataset): DatasetConfig { id: f6c19cea-03be-472c-9b0c-114f5e6652f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc1f514b-e945-4d2f-9238-c590a9c1fc39 (dataset): DatasetConfig { id: fc1f514b-e945-4d2f-9238-c590a9c1fc39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4492025-01-25T03:51:20.557ZINFOSledAgent (StorageManager): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4502025-01-25T03:51:20.557ZINFOSledAgent (StorageManager): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512025-01-25T03:51:20.557ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4522025-01-25T03:51:20.572ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532025-01-25T03:51:20.572ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542025-01-25T03:51:20.572ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone/oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418"), full_name: "oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone/oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418" } file = sled-storage/src/manager.rs:1431
4552025-01-25T03:51:20.634ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-01-25T03:51:20.634ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4572025-01-25T03:51:20.634ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0" } file = sled-storage/src/manager.rs:1431
4582025-01-25T03:51:20.692ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-01-25T03:51:20.692ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4602025-01-25T03:51:20.692ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97661079-bff0-45d9-bae2-2b9215898f21/crypt/debug"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/debug" } file = sled-storage/src/manager.rs:1431
4612025-01-25T03:51:20.721ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-25T03:51:20.721ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-01-25T03:51:20.721ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/zone/oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0"), full_name: "oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/zone/oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0" } file = sled-storage/src/manager.rs:1431
4642025-01-25T03:51:20.779ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-01-25T03:51:20.779ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-01-25T03:51:20.779ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976" } file = sled-storage/src/manager.rs:1431
4672025-01-25T03:51:20.837ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-25T03:51:20.837ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-01-25T03:51:20.837ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/zone/oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806"), full_name: "oxp_30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/zone/oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806" } file = sled-storage/src/manager.rs:1431
4702025-01-25T03:51:20.895ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-25T03:51:20.895ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722025-01-25T03:51:20.895ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f/crucible" } file = sled-storage/src/manager.rs:1431
4732025-01-25T03:51:20.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-25T03:51:20.943ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752025-01-25T03:51:20.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f" } file = sled-storage/src/manager.rs:1431
4762025-01-25T03:51:21.002ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-25T03:51:21.002ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-01-25T03:51:21.002ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/zone/oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af"), full_name: "oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/zone/oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af" } file = sled-storage/src/manager.rs:1431
4792025-01-25T03:51:21.022ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/probe_manager.rs:231 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
4802025-01-25T03:51:21.062ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812025-01-25T03:51:21.062ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822025-01-25T03:51:21.062ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4832025-01-25T03:51:21.110ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842025-01-25T03:51:21.110ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4852025-01-25T03:51:21.110ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35b7f17f-2139-4f31-b2d5-c4c76891288f/crypt/debug"), full_name: "oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f/crypt/debug" } file = sled-storage/src/manager.rs:1431
4862025-01-25T03:51:21.141ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872025-01-25T03:51:21.141ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4882025-01-25T03:51:21.141ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/debug"), full_name: "oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/debug" } file = sled-storage/src/manager.rs:1431
4892025-01-25T03:51:21.169ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902025-01-25T03:51:21.169ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4912025-01-25T03:51:21.170ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35b7f17f-2139-4f31-b2d5-c4c76891288f/crypt/zone"), full_name: "oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f/crypt/zone" } file = sled-storage/src/manager.rs:1431
4922025-01-25T03:51:21.198ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-01-25T03:51:21.198ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942025-01-25T03:51:21.198ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/zone/oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), full_name: "oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/zone/oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b" } file = sled-storage/src/manager.rs:1431
4952025-01-25T03:51:21.257ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-01-25T03:51:21.257ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4972025-01-25T03:51:21.257ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/debug"), full_name: "oxp_30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/debug" } file = sled-storage/src/manager.rs:1431
4982025-01-25T03:51:21.286ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-01-25T03:51:21.286ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002025-01-25T03:51:21.286ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone/oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5"), full_name: "oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone/oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5" } file = sled-storage/src/manager.rs:1431
5012025-01-25T03:51:21.349ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-01-25T03:51:21.349ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-01-25T03:51:21.350ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5042025-01-25T03:51:21.399ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-01-25T03:51:21.399ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5062025-01-25T03:51:21.399ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed06efc8-6c57-4076-806f-3a742bb46e6b/crypt/debug"), full_name: "oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b/crypt/debug" } file = sled-storage/src/manager.rs:1431
5072025-01-25T03:51:21.428ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-01-25T03:51:21.428ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5092025-01-25T03:51:21.428ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/zone"), full_name: "oxp_30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/zone" } file = sled-storage/src/manager.rs:1431
5102025-01-25T03:51:21.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-01-25T03:51:21.457ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5122025-01-25T03:51:21.457ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/zone"), full_name: "oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5132025-01-25T03:51:21.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-01-25T03:51:21.485ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152025-01-25T03:51:21.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crucible" } file = sled-storage/src/manager.rs:1431
5162025-01-25T03:51:21.535ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-01-25T03:51:21.535ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5182025-01-25T03:51:21.535ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/zone"), full_name: "oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/zone" } file = sled-storage/src/manager.rs:1431
5192025-01-25T03:51:21.564ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-01-25T03:51:21.564ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5212025-01-25T03:51:21.564ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5222025-01-25T03:51:21.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-25T03:51:21.615ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5242025-01-25T03:51:21.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed06efc8-6c57-4076-806f-3a742bb46e6b/crypt/zone"), full_name: "oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b/crypt/zone" } file = sled-storage/src/manager.rs:1431
5252025-01-25T03:51:21.643ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-01-25T03:51:21.643ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5272025-01-25T03:51:21.643ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crucible" } file = sled-storage/src/manager.rs:1431
5282025-01-25T03:51:21.691ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-01-25T03:51:21.691ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302025-01-25T03:51:21.691ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174" } file = sled-storage/src/manager.rs:1431
5312025-01-25T03:51:21.751ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-01-25T03:51:21.751ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332025-01-25T03:51:21.751ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7" } file = sled-storage/src/manager.rs:1431
5342025-01-25T03:51:21.814ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-25T03:51:21.814ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-01-25T03:51:21.814ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone/oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347"), full_name: "oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone/oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347" } file = sled-storage/src/manager.rs:1431
5372025-01-25T03:51:21.876ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-25T03:51:21.876ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392025-01-25T03:51:21.876ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5402025-01-25T03:51:21.927ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-25T03:51:21.927ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-01-25T03:51:21.927ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2" } file = sled-storage/src/manager.rs:1431
5432025-01-25T03:51:21.988ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-01-25T03:51:21.988ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-01-25T03:51:21.988ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971" } file = sled-storage/src/manager.rs:1431
5462025-01-25T03:51:22.025ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/probe_manager.rs:231 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
5472025-01-25T03:51:22.050ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-01-25T03:51:22.050ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5492025-01-25T03:51:22.050ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/zone/oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372"), full_name: "oxp_30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/zone/oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372" } file = sled-storage/src/manager.rs:1431
5502025-01-25T03:51:22.111ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-01-25T03:51:22.111ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522025-01-25T03:51:22.111ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/zone/oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043"), full_name: "oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/zone/oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043" } file = sled-storage/src/manager.rs:1431
5532025-01-25T03:51:22.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-25T03:51:22.172ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552025-01-25T03:51:22.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5562025-01-25T03:51:22.221ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-25T03:51:22.222ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5582025-01-25T03:51:22.222ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5592025-01-25T03:51:22.271ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-01-25T03:51:22.271ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5612025-01-25T03:51:22.271ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crucible" } file = sled-storage/src/manager.rs:1431
5622025-01-25T03:51:22.319ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-01-25T03:51:22.319ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642025-01-25T03:51:22.319ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed06efc8-6c57-4076-806f-3a742bb46e6b/crypt/zone/oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d"), full_name: "oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b/crypt/zone/oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d" } file = sled-storage/src/manager.rs:1431
5652025-01-25T03:51:22.381ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-01-25T03:51:22.381ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5672025-01-25T03:51:22.381ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/zone"), full_name: "oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5682025-01-25T03:51:22.410ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-01-25T03:51:22.410ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-01-25T03:51:22.410ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5712025-01-25T03:51:22.460ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-01-25T03:51:22.460ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5732025-01-25T03:51:22.460ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44c151b9-2034-4667-9c87-189bf684b2e4/crypt/debug"), full_name: "oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crypt/debug" } file = sled-storage/src/manager.rs:1431
5742025-01-25T03:51:22.490ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-01-25T03:51:22.490ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762025-01-25T03:51:22.490ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5772025-01-25T03:51:22.541ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782025-01-25T03:51:22.541ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5792025-01-25T03:51:22.541ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/zone/oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be"), full_name: "oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/zone/oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be" } file = sled-storage/src/manager.rs:1431
5802025-01-25T03:51:22.602ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812025-01-25T03:51:22.602ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5822025-01-25T03:51:22.602ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251" } file = sled-storage/src/manager.rs:1431
5832025-01-25T03:51:22.663ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-01-25T03:51:22.663ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5852025-01-25T03:51:22.663ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/zone/oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8"), full_name: "oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/zone/oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8" } file = sled-storage/src/manager.rs:1431
5862025-01-25T03:51:22.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-01-25T03:51:22.722ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5882025-01-25T03:51:22.722ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48" } file = sled-storage/src/manager.rs:1431
5892025-01-25T03:51:22.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-01-25T03:51:22.784ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912025-01-25T03:51:22.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a/crucible" } file = sled-storage/src/manager.rs:1431
5922025-01-25T03:51:22.832ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-01-25T03:51:22.832ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942025-01-25T03:51:22.832ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5952025-01-25T03:51:22.883ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-01-25T03:51:22.883ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-01-25T03:51:22.883ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/zone/oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073"), full_name: "oxp_30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/zone/oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073" } file = sled-storage/src/manager.rs:1431
5982025-01-25T03:51:22.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-01-25T03:51:22.943ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6002025-01-25T03:51:22.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/debug"), full_name: "oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/debug" } file = sled-storage/src/manager.rs:1431
6012025-01-25T03:51:22.974ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-25T03:51:22.974ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6032025-01-25T03:51:22.974ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone"), full_name: "oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone" } file = sled-storage/src/manager.rs:1431
6042025-01-25T03:51:23.004ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-25T03:51:23.004ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-01-25T03:51:23.004ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6072025-01-25T03:51:23.027ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/probe_manager.rs:231 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
6082025-01-25T03:51:23.054ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092025-01-25T03:51:23.054ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102025-01-25T03:51:23.054ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b/crucible" } file = sled-storage/src/manager.rs:1431
6112025-01-25T03:51:23.101ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122025-01-25T03:51:23.101ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6132025-01-25T03:51:23.101ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone/oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549"), full_name: "oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crypt/zone/oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549" } file = sled-storage/src/manager.rs:1431
6142025-01-25T03:51:23.164ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6152025-01-25T03:51:23.164ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6162025-01-25T03:51:23.164ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crucible" } file = sled-storage/src/manager.rs:1431
6172025-01-25T03:51:23.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6182025-01-25T03:51:23.212ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6192025-01-25T03:51:23.212ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone" } file = sled-storage/src/manager.rs:1431
6202025-01-25T03:51:23.242ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212025-01-25T03:51:23.242ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222025-01-25T03:51:23.242ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/zone/oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215"), full_name: "oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/zone/oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215" } file = sled-storage/src/manager.rs:1431
6232025-01-25T03:51:23.304ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242025-01-25T03:51:23.304ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6252025-01-25T03:51:23.304ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crucible" } file = sled-storage/src/manager.rs:1431
6262025-01-25T03:51:23.353ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272025-01-25T03:51:23.353ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6282025-01-25T03:51:23.353ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6292025-01-25T03:51:23.405ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302025-01-25T03:51:23.405ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6312025-01-25T03:51:23.405ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/zone/oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f" } file = sled-storage/src/manager.rs:1431
6322025-01-25T03:51:23.465ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332025-01-25T03:51:23.465ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6342025-01-25T03:51:23.465ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263" } file = sled-storage/src/manager.rs:1431
6352025-01-25T03:51:23.527ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362025-01-25T03:51:23.528ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6372025-01-25T03:51:23.528ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/debug"), full_name: "oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/debug" } file = sled-storage/src/manager.rs:1431
6382025-01-25T03:51:23.557ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392025-01-25T03:51:23.557ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6402025-01-25T03:51:23.557ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35b7f17f-2139-4f31-b2d5-c4c76891288f/crypt/zone/oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d"), full_name: "oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f/crypt/zone/oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d" } file = sled-storage/src/manager.rs:1431
6412025-01-25T03:51:23.616ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422025-01-25T03:51:23.616ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6432025-01-25T03:51:23.616ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/debug"), full_name: "oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/debug" } file = sled-storage/src/manager.rs:1431
6442025-01-25T03:51:23.646ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452025-01-25T03:51:23.646ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6462025-01-25T03:51:23.646ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_30589e38-7481-4de9-b63b-77c66cbf4a51/crucible" } file = sled-storage/src/manager.rs:1431
6472025-01-25T03:51:23.695ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-01-25T03:51:23.695ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492025-01-25T03:51:23.695ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone/oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f" } file = sled-storage/src/manager.rs:1431
6502025-01-25T03:51:23.761ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6512025-01-25T03:51:23.761ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6522025-01-25T03:51:23.761ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone"), full_name: "oxp_97661079-bff0-45d9-bae2-2b9215898f21/crypt/zone" } file = sled-storage/src/manager.rs:1431
6532025-01-25T03:51:23.791ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542025-01-25T03:51:23.791ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6552025-01-25T03:51:23.791ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
6562025-01-25T03:51:23.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3235001 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44346 req_id = 68f80547-0992-4eea-912f-dc9a4983000d response_code = 200 uri = /datasets
6572025-01-25T03:51:23.823ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 14431744-a5e9-444c-9874-670dfcb427f0 (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc4b56af-21ae-4fe1-aff8-4e981275d971 (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ff437f98-fe11-4ca3-8ca3-39df0f006418 (service), filesystem_pool: Some(ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6582025-01-25T03:51:23.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46133
6592025-01-25T03:51:23.824ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-01-25T03:51:23.824ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-01-25T03:51:23.833ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-01-25T03:51:23.833ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-01-25T03:51:23.842ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642025-01-25T03:51:23.842ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652025-01-25T03:51:23.850ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-25T03:51:23.850ZINFOSledAgent (ServiceManager): No ledger in /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:188
6672025-01-25T03:51:23.850ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:188
6682025-01-25T03:51:23.850ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-01-25T03:51:23.895ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-01-25T03:51:23.895ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-01-25T03:51:23.895ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-01-25T03:51:23.950ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0 file = illumos-utils/src/zone.rs:325
6732025-01-25T03:51:23.954ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971 file = illumos-utils/src/zone.rs:325
6742025-01-25T03:51:23.957ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418 file = illumos-utils/src/zone.rs:325
6752025-01-25T03:51:23.969ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0 file = illumos-utils/src/zone.rs:363
6762025-01-25T03:51:23.974ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971 file = illumos-utils/src/zone.rs:363
6772025-01-25T03:51:23.978ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418 file = illumos-utils/src/zone.rs:363
6782025-01-25T03:51:24.029ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/probe_manager.rs:231 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
6792025-01-25T03:51:25.031ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a) file = sled-agent/src/probe_manager.rs:231 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
6802025-01-25T03:51:25.597ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812025-01-25T03:51:25.597ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6822025-01-25T03:51:25.597ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
6832025-01-25T03:51:25.938ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9055193089543267733 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
6842025-01-25T03:51:25.938ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2521508239145423452 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
6852025-01-25T03:51:26.084ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6862025-01-25T03:51:26.084ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6872025-01-25T03:51:26.196ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6882025-01-25T03:51:26.197ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6892025-01-25T03:51:26.202ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6902025-01-25T03:51:26.202ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6912025-01-25T03:51:26.349ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
6922025-01-25T03:51:26.349ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
6932025-01-25T03:51:26.388ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
6942025-01-25T03:51:26.388ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
6952025-01-25T03:51:26.438ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
6962025-01-25T03:51:26.438ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
6972025-01-25T03:51:26.458ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
6982025-01-25T03:51:26.458ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
6992025-01-25T03:51:26.526ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
7002025-01-25T03:51:26.526ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
7012025-01-25T03:51:26.564ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7022025-01-25T03:51:26.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971") failed: Property not found. retry in 57.681028ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
7032025-01-25T03:51:26.574ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7042025-01-25T03:51:26.578ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
7052025-01-25T03:51:26.578ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7062025-01-25T03:51:26.623ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7072025-01-25T03:51:26.623ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7082025-01-25T03:51:26.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971") failed: Property not found. retry in 66.836378ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
7092025-01-25T03:51:26.660ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7102025-01-25T03:51:26.693ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7112025-01-25T03:51:26.693ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7122025-01-25T03:51:26.693ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7132025-01-25T03:51:26.693ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7142025-01-25T03:51:26.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 71.812161ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7152025-01-25T03:51:26.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7162025-01-25T03:51:26.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971") failed: Property not found. retry in 280.553986ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
7172025-01-25T03:51:26.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418") failed: Property not found. retry in 46.986891ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7182025-01-25T03:51:26.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 88.899238ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7192025-01-25T03:51:26.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418") failed: Property not found. retry in 77.770446ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7202025-01-25T03:51:26.908ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7212025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7222025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7232025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7242025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7252025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7262025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7272025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7282025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7292025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7302025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7312025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7322025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7332025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7342025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7352025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7362025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7372025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7382025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7392025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7402025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7412025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7422025-01-25T03:51:26.908ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7432025-01-25T03:51:26.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 162.746575ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7442025-01-25T03:51:27.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418") failed: Property not found. retry in 174.850816ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7452025-01-25T03:51:27.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971") failed: Property not found. retry in 592.599557ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
7462025-01-25T03:51:27.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 509.136834ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7472025-01-25T03:51:27.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418") failed: Property not found. retry in 486.847786ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7482025-01-25T03:51:27.420ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14040775082169136304 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
7492025-01-25T03:51:27.420ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13712341694280551368 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
7502025-01-25T03:51:27.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971") failed: Property not found. retry in 1.033246262s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
7512025-01-25T03:51:27.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 519.785404ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7522025-01-25T03:51:27.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418") failed: Property not found. retry in 677.821206ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7532025-01-25T03:51:28.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 689.210826ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7542025-01-25T03:51:28.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418") failed: Property not found. retry in 512.757581ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7552025-01-25T03:51:28.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971") failed: Property not found. retry in 1.305503983s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
7562025-01-25T03:51:28.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 596.620876ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7572025-01-25T03:51:28.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418") failed: Property not found. retry in 791.275595ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7582025-01-25T03:51:29.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 510.646702ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7592025-01-25T03:51:29.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418") failed: Property not found. retry in 1.018121937s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7602025-01-25T03:51:30.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971") failed: Property not found. retry in 1.239098366s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
7612025-01-25T03:51:30.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 1.080658434s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7622025-01-25T03:51:30.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418") failed: Property not found. retry in 814.129448ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7632025-01-25T03:51:31.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0") failed: Property not found. retry in 586.286953ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7642025-01-25T03:51:31.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971") failed: Property not found. retry in 882.389201ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
7652025-01-25T03:51:32.159ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_14431744-a5e9-444c-9874-670dfcb427f0
7662025-01-25T03:51:32.159ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_bc4b56af-21ae-4fe1-aff8-4e981275d971
7672025-01-25T03:51:32.159ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_ff437f98-fe11-4ca3-8ca3-39df0f006418
7682025-01-25T03:51:32.159ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692025-01-25T03:51:32.159ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7702025-01-25T03:51:32.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8335961 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46133 req_id = 00e23e8a-72ec-4794-9bf6-d0173ff2ff73 response_code = 204 uri = /omicron-zones
7712025-01-25T03:51:32.162ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722025-01-25T03:51:32.583ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 85.715116ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7732025-01-25T03:51:32.688ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742025-01-25T03:51:32.742ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7752025-01-25T03:51:32.789ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7762025-01-25T03:51:32.789ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7772025-01-25T03:51:32.822ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7782025-01-25T03:51:32.823ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7792025-01-25T03:51:32.823ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7802025-01-25T03:51:32.852ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 14431744-a5e9-444c-9874-670dfcb427f0 (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc4b56af-21ae-4fe1-aff8-4e981275d971 (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ff437f98-fe11-4ca3-8ca3-39df0f006418 (service), filesystem_pool: Some(ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b5fa8b96-372f-444c-845f-85e1d6609806 (service), filesystem_pool: Some(ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7851b0c5-ffeb-4cb5-b091-2c50163f5235, kind: Service { id: b5fa8b96-372f-444c-845f-85e1d6609806 }, name: Name("ntp-b5fa8b96-372f-444c-845f-85e1d6609806"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 104])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7812025-01-25T03:51:32.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32861
7822025-01-25T03:51:32.853ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-01-25T03:51:32.853ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-01-25T03:51:32.864ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-01-25T03:51:32.864ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-01-25T03:51:32.874ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872025-01-25T03:51:32.874ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882025-01-25T03:51:32.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7892025-01-25T03:51:32.884ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:177
7902025-01-25T03:51:32.884ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:177
7912025-01-25T03:51:32.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7922025-01-25T03:51:32.895ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7932025-01-25T03:51:32.927ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7942025-01-25T03:51:32.929ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7952025-01-25T03:51:32.929ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7962025-01-25T03:51:32.959ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 160, 104]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7972025-01-25T03:51:32.959ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7982025-01-25T03:51:32.960ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7992025-01-25T03:51:32.960ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
8002025-01-25T03:51:32.960ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
8012025-01-25T03:51:32.961ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8022025-01-25T03:51:32.985ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806 file = illumos-utils/src/zone.rs:325
8032025-01-25T03:51:33.005ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806 file = illumos-utils/src/zone.rs:363
8042025-01-25T03:51:33.603ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8052025-01-25T03:51:33.603ZINFOSledAgent (ServiceManager): Booting oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8062025-01-25T03:51:33.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806") failed: Property not found. retry in 42.775054ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8072025-01-25T03:51:33.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806") failed: Property not found. retry in 125.762596ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8082025-01-25T03:51:33.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806") failed: Property not found. retry in 184.300314ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8092025-01-25T03:51:34.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806") failed: Property not found. retry in 470.09979ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8102025-01-25T03:51:34.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806") failed: Property not found. retry in 508.473626ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8112025-01-25T03:51:35.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806") failed: Property not found. retry in 835.74389ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8122025-01-25T03:51:35.941ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9055193089543267733 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
8132025-01-25T03:51:35.941ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2521508239145423452 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
8142025-01-25T03:51:35.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806") failed: Property not found. retry in 1.468667634s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8152025-01-25T03:51:37.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14040775082169136304 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
8162025-01-25T03:51:37.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13712341694280551368 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
8172025-01-25T03:51:37.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806") failed: Property not found. retry in 1.103514863s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8182025-01-25T03:51:38.587ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806
8192025-01-25T03:51:38.587ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8202025-01-25T03:51:38.587ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212025-01-25T03:51:38.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5734990 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:32861 req_id = bdfb5e79-430e-4b13-955d-56ccbc4a5909 response_code = 204 uri = /omicron-zones
8222025-01-25T03:51:38.590ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8232025-01-25T03:51:38.620ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8242025-01-25T03:51:38.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53161
8252025-01-25T03:51:38.630ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8262025-01-25T03:51:38.630ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9641 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53161 req_id = 99b4ac52-af2a-4655-bd6e-fb8efe230e71 response_code = 500 uri = /timesync
8272025-01-25T03:51:38.632ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8282025-01-25T03:51:38.769ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292025-01-25T03:51:38.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37120
8302025-01-25T03:51:41.565ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13355025134375459214 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
8312025-01-25T03:51:41.719ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4585421942785742221 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
8322025-01-25T03:51:42.162ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3899579011353876591 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
8332025-01-25T03:51:42.778ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8342025-01-25T03:51:42.779ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37120 req_id = 46cbdd3a-ee5b-41e4-b697-f9d5a4c29752 response_code = 500 uri = /timesync
8352025-01-25T03:51:42.781ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362025-01-25T03:51:42.945ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8372025-01-25T03:51:42.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57183
8382025-01-25T03:51:42.954ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8392025-01-25T03:51:42.954ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57183 req_id = c4e9d5dd-e166-4746-b174-22adf4c6c9ff response_code = 500 uri = /timesync
8402025-01-25T03:51:42.956ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8412025-01-25T03:51:43.147ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8422025-01-25T03:51:43.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47735
8432025-01-25T03:51:43.156ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b5fa8b96-372f-444c-845f-85e1d6609806': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8442025-01-25T03:51:43.156ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9012 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47735 req_id = 50e77a8b-47d7-45ee-8483-0000e980a60e response_code = 500 uri = /timesync
8452025-01-25T03:51:43.159ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462025-01-25T03:51:43.407ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472025-01-25T03:51:43.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61813
8482025-01-25T03:51:43.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8591 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61813 req_id = 0c6da94d-51a1-41c0-8dc3-a9df0536b086 response_code = 200 uri = /timesync
8492025-01-25T03:51:43.417ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8502025-01-25T03:51:43.417ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512025-01-25T03:51:43.617ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8522025-01-25T03:51:43.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55664
8532025-01-25T03:51:43.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7980 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55664 req_id = b7bd8408-7239-402b-9269-baf9e69e727e response_code = 200 uri = /timesync
8542025-01-25T03:51:43.627ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8552025-01-25T03:51:43.627ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562025-01-25T03:51:43.988ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572025-01-25T03:51:43.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55023
8582025-01-25T03:51:43.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55023 req_id = 8c320c72-f3aa-478a-8759-100290f2328f response_code = 200 uri = /timesync
8592025-01-25T03:51:43.998ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8602025-01-25T03:51:43.998ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612025-01-25T03:51:44.442ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622025-01-25T03:51:44.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54497
8632025-01-25T03:51:44.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7879 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54497 req_id = ca385cea-5b83-40f2-90d8-ecad062dfdc7 response_code = 200 uri = /timesync
8642025-01-25T03:51:44.452ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8652025-01-25T03:51:44.452ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662025-01-25T03:51:45.003ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8672025-01-25T03:51:45.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59976
8682025-01-25T03:51:45.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59976 req_id = 9dceaf1f-a0c6-4317-be42-5445a57a87ac response_code = 200 uri = /timesync
8692025-01-25T03:51:45.014ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.012885996 } file = sled-agent/src/rack_setup/service.rs:743
8702025-01-25T03:51:45.014ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8712025-01-25T03:51:45.475ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8722025-01-25T03:51:45.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62555
8732025-01-25T03:51:45.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62555 req_id = 289d51f5-3c73-4260-b825-5c0e7eb566be response_code = 200 uri = /timesync
8742025-01-25T03:51:45.485ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.012005105 } file = sled-agent/src/rack_setup/service.rs:743
8752025-01-25T03:51:45.485ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8762025-01-25T03:51:45.924ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8772025-01-25T03:51:45.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48777
8782025-01-25T03:51:45.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8591 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48777 req_id = c143c1ae-0be6-438d-a50a-29d8e6e56dfe response_code = 200 uri = /timesync
8792025-01-25T03:51:45.934ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.010784437 } file = sled-agent/src/rack_setup/service.rs:743
8802025-01-25T03:51:45.934ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8812025-01-25T03:51:45.941ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9055193089543267733 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
8822025-01-25T03:51:45.941ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2521508239145423452 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
8832025-01-25T03:51:46.859ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8842025-01-25T03:51:46.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41407
8852025-01-25T03:51:46.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 20518 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41407 req_id = acfc839d-92cc-45c7-a062-14edf706a200 response_code = 200 uri = /timesync
8862025-01-25T03:51:46.884ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3324968578, ip_addr: 198.46.254.130, stratum: 3, ref_time: 1737777106.2179136, correction: -0.008666714 } file = sled-agent/src/rack_setup/service.rs:743
8872025-01-25T03:51:46.884ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8882025-01-25T03:51:46.914ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 14431744-a5e9-444c-9874-670dfcb427f0 (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc4b56af-21ae-4fe1-aff8-4e981275d971 (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ff437f98-fe11-4ca3-8ca3-39df0f006418 (service), filesystem_pool: Some(ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b5fa8b96-372f-444c-845f-85e1d6609806 (service), filesystem_pool: Some(ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7851b0c5-ffeb-4cb5-b091-2c50163f5235, kind: Service { id: b5fa8b96-372f-444c-845f-85e1d6609806 }, name: Name("ntp-b5fa8b96-372f-444c-845f-85e1d6609806"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 104])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8cea97fa-28c9-4b0f-9e73-afad58d0564f (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External } } } }, OmicronZoneConfig { id: b9c3c1cf-4198-4801-92ff-b34034577549 (service), filesystem_pool: Some(ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External } } } }, OmicronZoneConfig { id: a6b437c7-e984-4cba-93bd-4adbdc51b3be (service), filesystem_pool: Some(ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External } } } }, OmicronZoneConfig { id: 243f5941-2bcb-43e6-a6ea-9348b63d7372 (service), filesystem_pool: Some(ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8892025-01-25T03:51:46.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43147
8902025-01-25T03:51:46.915ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8912025-01-25T03:51:46.915ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8922025-01-25T03:51:46.926ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8932025-01-25T03:51:46.926ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8942025-01-25T03:51:46.935ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8952025-01-25T03:51:46.935ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8962025-01-25T03:51:46.946ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8972025-01-25T03:51:46.946ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8982025-01-25T03:51:46.955ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8992025-01-25T03:51:46.955ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9002025-01-25T03:51:46.964ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9012025-01-25T03:51:46.964ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9022025-01-25T03:51:46.972ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9032025-01-25T03:51:46.972ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Cockroach }, responder: ... }
9042025-01-25T03:51:46.981ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9052025-01-25T03:51:46.981ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9062025-01-25T03:51:46.990ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9072025-01-25T03:51:46.990ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:177
9082025-01-25T03:51:46.990ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:177
9092025-01-25T03:51:46.990ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9102025-01-25T03:51:47.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9112025-01-25T03:51:47.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9122025-01-25T03:51:47.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9132025-01-25T03:51:47.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9142025-01-25T03:51:47.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9152025-01-25T03:51:47.166ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372 file = illumos-utils/src/zone.rs:325
9162025-01-25T03:51:47.170ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549 file = illumos-utils/src/zone.rs:325
9172025-01-25T03:51:47.174ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f file = illumos-utils/src/zone.rs:325
9182025-01-25T03:51:47.178ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be file = illumos-utils/src/zone.rs:325
9192025-01-25T03:51:47.183ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 file = illumos-utils/src/zone.rs:325
9202025-01-25T03:51:47.188ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372 file = illumos-utils/src/zone.rs:363
9212025-01-25T03:51:47.192ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549 file = illumos-utils/src/zone.rs:363
9222025-01-25T03:51:47.196ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f file = illumos-utils/src/zone.rs:363
9232025-01-25T03:51:47.202ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be file = illumos-utils/src/zone.rs:363
9242025-01-25T03:51:47.207ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 file = illumos-utils/src/zone.rs:363
9252025-01-25T03:51:50.469ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8cea97fa-28c9-4b0f-9e73-afad58d0564f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9262025-01-25T03:51:50.469ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9272025-01-25T03:51:50.482ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9282025-01-25T03:51:50.482ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='243f5941-2bcb-43e6-a6ea-9348b63d7372'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9292025-01-25T03:51:50.482ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9302025-01-25T03:51:50.488ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9312025-01-25T03:51:50.514ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a6b437c7-e984-4cba-93bd-4adbdc51b3be'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9322025-01-25T03:51:50.514ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9332025-01-25T03:51:50.553ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b9c3c1cf-4198-4801-92ff-b34034577549'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9342025-01-25T03:51:50.553ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9352025-01-25T03:51:50.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 54.745915ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9362025-01-25T03:51:50.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 49.397762ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9372025-01-25T03:51:50.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 27.130904ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9382025-01-25T03:51:50.638ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 207.436392ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
9392025-01-25T03:51:50.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 74.407207ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9402025-01-25T03:51:50.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 81.475684ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9412025-01-25T03:51:50.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 72.070472ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9422025-01-25T03:51:50.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 104.9932ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9432025-01-25T03:51:51.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 63.02661ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9442025-01-25T03:51:51.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 138.899254ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9452025-01-25T03:51:51.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 124.116175ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9462025-01-25T03:51:51.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 170.683739ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9472025-01-25T03:51:51.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 122.509161ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9482025-01-25T03:51:51.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 105.918127ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9492025-01-25T03:51:51.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 328.234118ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9502025-01-25T03:51:51.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 244.337728ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9512025-01-25T03:51:51.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 563.076905ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9522025-01-25T03:51:51.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 216.839462ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9532025-01-25T03:51:51.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 254.438032ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9542025-01-25T03:51:51.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 245.517464ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9552025-01-25T03:51:51.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 598.487005ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9562025-01-25T03:51:52.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 948.842452ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9572025-01-25T03:51:52.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 825.443581ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9582025-01-25T03:51:52.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 724.896047ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9592025-01-25T03:51:52.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 721.951634ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9602025-01-25T03:51:52.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 571.381946ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9612025-01-25T03:51:52.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 1.467358678s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9622025-01-25T03:51:52.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 635.813809ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9632025-01-25T03:51:52.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 519.447191ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9642025-01-25T03:51:53.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 1.156234834s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9652025-01-25T03:51:53.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 553.606651ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9662025-01-25T03:51:53.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 1.127482096s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9672025-01-25T03:51:53.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 1.405275398s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9682025-01-25T03:51:53.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 1.280355669s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9692025-01-25T03:51:54.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 806.464208ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9702025-01-25T03:51:54.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 1.357256596s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9712025-01-25T03:51:54.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 1.085536749s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9722025-01-25T03:51:55.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 561.8275ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9732025-01-25T03:51:55.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 1.462669946s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9742025-01-25T03:51:55.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 655.875308ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9752025-01-25T03:51:55.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 760.961294ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9762025-01-25T03:51:55.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 1.326647978s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9772025-01-25T03:51:55.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 1.305739255s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9782025-01-25T03:51:55.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 757.544126ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9792025-01-25T03:51:56.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 1.183509441s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9802025-01-25T03:51:56.401ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60032
9812025-01-25T03:51:56.401ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60032 req_id = e943af3b-dd85-4eb5-bbcb-c98fe8cbee34 response_code = 200 uri = /baseboard
9822025-01-25T03:51:56.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 1.195537783s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9832025-01-25T03:51:56.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 1.233807529s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9842025-01-25T03:51:57.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 1.331663731s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9852025-01-25T03:51:57.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 647.726184ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9862025-01-25T03:51:57.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 705.709286ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9872025-01-25T03:51:57.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 1.489952174s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9882025-01-25T03:51:57.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 1.11278304s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9892025-01-25T03:51:57.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 818.63351ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9902025-01-25T03:51:58.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 653.07424ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9912025-01-25T03:51:58.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 801.777539ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9922025-01-25T03:51:58.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 711.254635ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9932025-01-25T03:51:58.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549") failed: Property not found. retry in 1.374046468s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
9942025-01-25T03:51:58.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 926.887687ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
9952025-01-25T03:51:59.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372") failed: Property not found. retry in 1.369901941s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
9962025-01-25T03:51:59.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 579.148524ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9972025-01-25T03:51:59.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f") failed: Property not found. retry in 1.316831511s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
9982025-01-25T03:51:59.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be") failed: Property not found. retry in 973.705491ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
9992025-01-25T03:51:59.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251") failed: Property not found. retry in 1.040457912s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
10002025-01-25T03:52:00.932ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_243f5941-2bcb-43e6-a6ea-9348b63d7372
10012025-01-25T03:52:00.932ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_b9c3c1cf-4198-4801-92ff-b34034577549
10022025-01-25T03:52:00.932ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_8cea97fa-28c9-4b0f-9e73-afad58d0564f
10032025-01-25T03:52:00.932ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_a6b437c7-e984-4cba-93bd-4adbdc51b3be
10042025-01-25T03:52:00.932ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251
10052025-01-25T03:52:00.932ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10062025-01-25T03:52:00.932ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10072025-01-25T03:52:00.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 14027209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43147 req_id = 58db0441-ebc3-4095-b7d5-310453576020 response_code = 204 uri = /omicron-zones
10082025-01-25T03:52:00.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62744
10092025-01-25T03:52:00.996ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 30038 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = c2dfa77f-8f94-4f41-9535-e179364e9c37 response_code = 500 uri = /cockroachdb
10102025-01-25T03:52:00.996ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c2dfa77f-8f94-4f41-9535-e179364e9c37", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c2dfa77f-8f94-4f41-9535-e179364e9c37" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 75.307815ms
10112025-01-25T03:52:01.099ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = 10bb7f86-8a63-4ee1-80b4-ec36c1a0dfcd response_code = 500 uri = /cockroachdb
10122025-01-25T03:52:01.099ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "10bb7f86-8a63-4ee1-80b4-ec36c1a0dfcd", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "10bb7f86-8a63-4ee1-80b4-ec36c1a0dfcd" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 98.049372ms
10132025-01-25T03:52:01.226ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26961 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = ed3231d3-9074-4901-9a17-b405bf3870f5 response_code = 500 uri = /cockroachdb
10142025-01-25T03:52:01.226ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ed3231d3-9074-4901-9a17-b405bf3870f5", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ed3231d3-9074-4901-9a17-b405bf3870f5" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 73.007448ms
10152025-01-25T03:52:01.329ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 30318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = ebdfcd5d-114e-417f-9a5a-3520a98093e6 response_code = 500 uri = /cockroachdb
10162025-01-25T03:52:01.329ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ebdfcd5d-114e-417f-9a5a-3520a98093e6", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ebdfcd5d-114e-417f-9a5a-3520a98093e6" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 166.738537ms
10172025-01-25T03:52:01.525ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = 8a440782-fd6d-4b4b-9abf-099a669e2f79 response_code = 500 uri = /cockroachdb
10182025-01-25T03:52:01.525ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8a440782-fd6d-4b4b-9abf-099a669e2f79", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8a440782-fd6d-4b4b-9abf-099a669e2f79" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 169.21084ms
10192025-01-25T03:52:01.723ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27830 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = b57a1e3a-b983-4961-b3f7-9d91eec74fb0 response_code = 500 uri = /cockroachdb
10202025-01-25T03:52:01.724ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b57a1e3a-b983-4961-b3f7-9d91eec74fb0", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b57a1e3a-b983-4961-b3f7-9d91eec74fb0" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 306.539127ms
10212025-01-25T03:52:02.057ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = 4c9249e0-b712-421b-97ef-f0c9ed981bea response_code = 500 uri = /cockroachdb
10222025-01-25T03:52:02.057ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4c9249e0-b712-421b-97ef-f0c9ed981bea", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4c9249e0-b712-421b-97ef-f0c9ed981bea" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 380.091208ms
10232025-01-25T03:52:02.464ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25471 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = ed83cb67-26c1-4046-874f-870bc166d163 response_code = 500 uri = /cockroachdb
10242025-01-25T03:52:02.464ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ed83cb67-26c1-4046-874f-870bc166d163", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ed83cb67-26c1-4046-874f-870bc166d163" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 245.218291ms
10252025-01-25T03:52:02.736ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25407 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = 9303343e-4af7-47b2-851a-16721ef44216 response_code = 500 uri = /cockroachdb
10262025-01-25T03:52:02.736ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9303343e-4af7-47b2-851a-16721ef44216", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9303343e-4af7-47b2-851a-16721ef44216" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 301.87991ms
10272025-01-25T03:52:03.067ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27281 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = 0cd97023-081b-4a37-9b07-664314509515 response_code = 500 uri = /cockroachdb
10282025-01-25T03:52:03.067ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0cd97023-081b-4a37-9b07-664314509515", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0cd97023-081b-4a37-9b07-664314509515" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 446.709647ms
10292025-01-25T03:52:03.540ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25411 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = c3a1b9f1-c327-4178-8e6f-ab8338a2951d response_code = 500 uri = /cockroachdb
10302025-01-25T03:52:03.541ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c3a1b9f1-c327-4178-8e6f-ab8338a2951d", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c3a1b9f1-c327-4178-8e6f-ab8338a2951d" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 484.001372ms
10312025-01-25T03:52:04.054ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = be5faf7f-aa0f-4ac1-b9a9-9d077161fea7 response_code = 500 uri = /cockroachdb
10322025-01-25T03:52:04.055ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "be5faf7f-aa0f-4ac1-b9a9-9d077161fea7", "content-length": "124", "date": "Sat, 25 Jan 2025 03:52:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "be5faf7f-aa0f-4ac1-b9a9-9d077161fea7" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 717.791115ms
10332025-01-25T03:52:04.804ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3752
10342025-01-25T03:52:26.394ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10352025-01-25T03:52:31.048ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10362025-01-25T03:52:31.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 26274440 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62744 req_id = a10a360f-31d6-4f93-b95e-514c7cda29b8 response_code = 204 uri = /cockroachdb
10372025-01-25T03:52:31.059ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41943
10382025-01-25T03:52:31.060ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 576 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41943 req_id = 975344f0-dac2-4599-9b50-8bf12827f950 response_code = 200 uri = /baseboard
10392025-01-25T03:52:31.067ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 408.313192ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
10402025-01-25T03:52:31.102ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 14431744-a5e9-444c-9874-670dfcb427f0 (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bc4b56af-21ae-4fe1-aff8-4e981275d971 (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ff437f98-fe11-4ca3-8ca3-39df0f006418 (service), filesystem_pool: Some(ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: b5fa8b96-372f-444c-845f-85e1d6609806 (service), filesystem_pool: Some(ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 7851b0c5-ffeb-4cb5-b091-2c50163f5235, kind: Service { id: b5fa8b96-372f-444c-845f-85e1d6609806 }, name: Name("ntp-b5fa8b96-372f-444c-845f-85e1d6609806"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 104])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 10c519d4-03bf-4cf2-8d6c-ef3fbbb3a251 (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8cea97fa-28c9-4b0f-9e73-afad58d0564f (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External } } } }, OmicronZoneConfig { id: b9c3c1cf-4198-4801-92ff-b34034577549 (service), filesystem_pool: Some(ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External } } } }, OmicronZoneConfig { id: a6b437c7-e984-4cba-93bd-4adbdc51b3be (service), filesystem_pool: Some(ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External } } } }, OmicronZoneConfig { id: 243f5941-2bcb-43e6-a6ea-9348b63d7372 (service), filesystem_pool: Some(ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External } } } }, OmicronZoneConfig { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 06a029c2-9185-403a-918b-57bcd0084263 (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b (service), filesystem_pool: Some(ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 18379ee0-32b1-4b61-87b6-31c1ba481347 (service), filesystem_pool: Some(ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 5e4e1fd3-bb75-4c56-9872-89984ccd731f (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0c37ca13-1efb-4c99-a1f7-51107ce082af (service), filesystem_pool: Some(ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 0ed61fdd-bc7b-48e5-a563-9b3ea7a41043 (service), filesystem_pool: Some(ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: ff74059f-28eb-4407-abaa-5851cedb9976 (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: eb2795ad-9316-4f3b-94cc-368822020e5f (service), filesystem_pool: Some(ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External } } } }, OmicronZoneConfig { id: e3432d18-2bc0-446a-aea2-d658a66b96c2 (service), filesystem_pool: Some(ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External } } } }, OmicronZoneConfig { id: ebec9864-cc93-4890-892d-757b505e9dc5 (service), filesystem_pool: Some(ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External } } } }, OmicronZoneConfig { id: da7f70e8-8b03-46fb-9245-1f11226e49a0 (service), filesystem_pool: Some(ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External } } } }, OmicronZoneConfig { id: 45506090-398c-4f24-a8c7-f676fca18073 (service), filesystem_pool: Some(ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8518c653-cb76-4005-ae46-03891cfb7ae8 (service), filesystem_pool: Some(ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External } } } }, OmicronZoneConfig { id: 489bba1e-fda0-475b-9bf2-7a18fe2d5c3d (service), filesystem_pool: Some(ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External } } } }, OmicronZoneConfig { id: 5215aca1-6983-4917-89ca-29d771b18215 (service), filesystem_pool: Some(ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External } } } }, OmicronZoneConfig { id: 30be1b55-8536-417c-8d01-860ec7deb59d (service), filesystem_pool: Some(ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10412025-01-25T03:52:31.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44883
10422025-01-25T03:52:31.104ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10432025-01-25T03:52:31.104ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10442025-01-25T03:52:31.118ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10452025-01-25T03:52:31.118ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10462025-01-25T03:52:31.128ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10472025-01-25T03:52:31.129ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10482025-01-25T03:52:31.139ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10492025-01-25T03:52:31.139ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10502025-01-25T03:52:31.148ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10512025-01-25T03:52:31.148ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10522025-01-25T03:52:31.158ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10532025-01-25T03:52:31.158ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10542025-01-25T03:52:31.168ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10552025-01-25T03:52:31.168ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10562025-01-25T03:52:31.176ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10572025-01-25T03:52:31.176ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10582025-01-25T03:52:31.184ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10592025-01-25T03:52:31.184ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10602025-01-25T03:52:31.192ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10612025-01-25T03:52:31.192ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10622025-01-25T03:52:31.202ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10632025-01-25T03:52:31.202ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10642025-01-25T03:52:31.213ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10652025-01-25T03:52:31.213ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10662025-01-25T03:52:31.223ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10672025-01-25T03:52:31.223ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, kind: Crucible }, responder: ... }
10682025-01-25T03:52:31.233ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10692025-01-25T03:52:31.233ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, kind: Crucible }, responder: ... }
10702025-01-25T03:52:31.243ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10712025-01-25T03:52:31.243ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, kind: Crucible }, responder: ... }
10722025-01-25T03:52:31.252ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10732025-01-25T03:52:31.252ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, kind: Crucible }, responder: ... }
10742025-01-25T03:52:31.263ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10752025-01-25T03:52:31.263ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, kind: Crucible }, responder: ... }
10762025-01-25T03:52:31.274ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10772025-01-25T03:52:31.274ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, kind: Crucible }, responder: ... }
10782025-01-25T03:52:31.284ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10792025-01-25T03:52:31.284ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, kind: Crucible }, responder: ... }
10802025-01-25T03:52:31.294ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10812025-01-25T03:52:31.294ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, kind: Crucible }, responder: ... }
10822025-01-25T03:52:31.305ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10832025-01-25T03:52:31.305ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:177
10842025-01-25T03:52:31.305ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:177
10852025-01-25T03:52:31.306ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10862025-01-25T03:52:31.455ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10872025-01-25T03:52:31.456ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10882025-01-25T03:52:31.456ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10892025-01-25T03:52:31.456ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10902025-01-25T03:52:31.456ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10912025-01-25T03:52:31.457ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10922025-01-25T03:52:31.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10932025-01-25T03:52:31.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10942025-01-25T03:52:31.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952025-01-25T03:52:31.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10962025-01-25T03:52:31.661ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10972025-01-25T03:52:31.661ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10982025-01-25T03:52:31.674ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10992025-01-25T03:52:31.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11002025-01-25T03:52:31.725ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11012025-01-25T03:52:31.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11022025-01-25T03:52:31.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11032025-01-25T03:52:31.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11042025-01-25T03:52:31.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11052025-01-25T03:52:31.725ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f file = illumos-utils/src/zone.rs:325
11062025-01-25T03:52:31.730ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976 file = illumos-utils/src/zone.rs:325
11072025-01-25T03:52:31.735ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d file = illumos-utils/src/zone.rs:325
11082025-01-25T03:52:31.739ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d file = illumos-utils/src/zone.rs:325
11092025-01-25T03:52:31.745ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5 file = illumos-utils/src/zone.rs:325
11102025-01-25T03:52:31.751ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043 file = illumos-utils/src/zone.rs:325
11112025-01-25T03:52:31.756ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2 file = illumos-utils/src/zone.rs:325
11122025-01-25T03:52:31.761ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347 file = illumos-utils/src/zone.rs:325
11132025-01-25T03:52:31.885ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f file = illumos-utils/src/zone.rs:363
11142025-01-25T03:52:31.890ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976 file = illumos-utils/src/zone.rs:363
11152025-01-25T03:52:31.895ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d file = illumos-utils/src/zone.rs:363
11162025-01-25T03:52:31.899ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d file = illumos-utils/src/zone.rs:363
11172025-01-25T03:52:31.904ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5 file = illumos-utils/src/zone.rs:363
11182025-01-25T03:52:31.911ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043 file = illumos-utils/src/zone.rs:363
11192025-01-25T03:52:31.915ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2 file = illumos-utils/src/zone.rs:363
11202025-01-25T03:52:31.920ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347 file = illumos-utils/src/zone.rs:363
11212025-01-25T03:52:31.926ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0 file = illumos-utils/src/zone.rs:325
11222025-01-25T03:52:31.931ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f file = illumos-utils/src/zone.rs:325
11232025-01-25T03:52:31.938ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073 file = illumos-utils/src/zone.rs:325
11242025-01-25T03:52:31.943ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8 file = illumos-utils/src/zone.rs:325
11252025-01-25T03:52:31.949ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215 file = illumos-utils/src/zone.rs:325
11262025-01-25T03:52:31.955ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af file = illumos-utils/src/zone.rs:325
11272025-01-25T03:52:32.023ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11282025-01-25T03:52:32.024ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0 file = illumos-utils/src/zone.rs:363
11292025-01-25T03:52:32.053ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f file = illumos-utils/src/zone.rs:363
11302025-01-25T03:52:32.092ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073 file = illumos-utils/src/zone.rs:363
11312025-01-25T03:52:32.097ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8 file = illumos-utils/src/zone.rs:363
11322025-01-25T03:52:32.110ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215 file = illumos-utils/src/zone.rs:363
11332025-01-25T03:52:32.118ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af file = illumos-utils/src/zone.rs:363
11342025-01-25T03:52:32.182ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11352025-01-25T03:52:32.240ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11362025-01-25T03:52:32.297ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11372025-01-25T03:52:32.365ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11382025-01-25T03:52:32.368ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11392025-01-25T03:52:32.368ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11402025-01-25T03:52:32.575ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 179, 217]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11412025-01-25T03:52:32.575ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11422025-01-25T03:52:32.580ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11432025-01-25T03:52:32.580ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11442025-01-25T03:52:32.639ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 190, 198]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11452025-01-25T03:52:32.639ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11462025-01-25T03:52:32.640ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11472025-01-25T03:52:32.640ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11482025-01-25T03:52:32.698ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 128, 160]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11492025-01-25T03:52:32.698ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11502025-01-25T03:52:32.702ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11512025-01-25T03:52:32.702ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11522025-01-25T03:52:32.772ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 223, 158]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11532025-01-25T03:52:32.772ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11542025-01-25T03:52:32.774ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11552025-01-25T03:52:32.774ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11562025-01-25T03:52:32.835ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 135, 162]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11572025-01-25T03:52:32.835ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11582025-01-25T03:52:32.835ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11592025-01-25T03:52:32.835ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11602025-01-25T03:52:32.845ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11612025-01-25T03:52:32.847ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11622025-01-25T03:52:32.902ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11632025-01-25T03:52:32.902ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11642025-01-25T03:52:32.902ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11652025-01-25T03:52:32.902ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11662025-01-25T03:52:32.903ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11672025-01-25T03:52:32.903ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11682025-01-25T03:52:32.903ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11692025-01-25T03:52:32.903ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11702025-01-25T03:52:32.903ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11712025-01-25T03:52:32.908ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11722025-01-25T03:52:32.911ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11732025-01-25T03:52:32.911ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11742025-01-25T03:52:32.911ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11752025-01-25T03:52:32.914ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11762025-01-25T03:52:32.931ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11772025-01-25T03:52:32.931ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11782025-01-25T03:52:32.940ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48 file = illumos-utils/src/zone.rs:325
11792025-01-25T03:52:33.699ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48 file = illumos-utils/src/zone.rs:363
11802025-01-25T03:52:33.714ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b file = illumos-utils/src/zone.rs:325
11812025-01-25T03:52:33.729ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7 file = illumos-utils/src/zone.rs:325
11822025-01-25T03:52:33.763ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263 file = illumos-utils/src/zone.rs:325
11832025-01-25T03:52:33.781ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174 file = illumos-utils/src/zone.rs:325
11842025-01-25T03:52:33.794ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b file = illumos-utils/src/zone.rs:363
11852025-01-25T03:52:33.804ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7 file = illumos-utils/src/zone.rs:363
11862025-01-25T03:52:33.825ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263 file = illumos-utils/src/zone.rs:363
11872025-01-25T03:52:33.831ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174 file = illumos-utils/src/zone.rs:363
11882025-01-25T03:52:42.064ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='40712ed7-c024-42a4-9965-fe4cdc338213'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11892025-01-25T03:52:42.065ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8cb9d667-aede-4c80-8b45-3c5fc96c57ae'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902025-01-25T03:52:42.066ZINFOSledAgent (ServiceManager): Booting oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
11912025-01-25T03:52:42.090ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='550635b0-48cd-41a1-9b25-bfa6dcd9fca6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11922025-01-25T03:52:42.090ZINFOSledAgent (ServiceManager): Booting oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
11932025-01-25T03:52:42.100ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7c701040-0c8e-4335-babd-815b82afa21d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11942025-01-25T03:52:42.101ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_30589e38-7481-4de9-b63b-77c66cbf4a51/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c3474e6f-b8d1-4465-b82a-94c7fc4fb5a0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11952025-01-25T03:52:42.102ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6f5f7189-2636-4fff-9ee7-33034751ef44'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11962025-01-25T03:52:42.102ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
11972025-01-25T03:52:42.112ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982025-01-25T03:52:42.116ZINFOSledAgent (ServiceManager): Booting oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
11992025-01-25T03:52:42.121ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12002025-01-25T03:52:42.121ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_97661079-bff0-45d9-bae2-2b9215898f21/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='41ad0b26-1ff1-4826-b8ab-9d37d6582f23'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12012025-01-25T03:52:42.122ZINFOSledAgent (ServiceManager): Booting oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
12022025-01-25T03:52:42.130ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
12032025-01-25T03:52:42.138ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
12042025-01-25T03:52:42.148ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
12052025-01-25T03:52:42.155ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
12062025-01-25T03:52:42.197ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_44c151b9-2034-4667-9c87-189bf684b2e4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='54bf4acd-f3cb-4ce9-bd03-757373dc1871'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12072025-01-25T03:52:42.198ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
12082025-01-25T03:52:42.467ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12092025-01-25T03:52:42.467ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
12102025-01-25T03:52:42.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 44.566954ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
12112025-01-25T03:52:42.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 39.052978ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
12122025-01-25T03:52:42.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 38.455033ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
12132025-01-25T03:52:42.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 51.095608ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
12142025-01-25T03:52:42.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 37.736432ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
12152025-01-25T03:52:42.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 25.76587ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
12162025-01-25T03:52:42.658ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='45616705-3a38-4350-9386-d41b563debb9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12172025-01-25T03:52:42.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 54.803745ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
12182025-01-25T03:52:42.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 47.415049ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
12192025-01-25T03:52:42.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 49.052445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
12202025-01-25T03:52:42.773ZINFOSledAgent (ServiceManager): Booting oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
12212025-01-25T03:52:47.238ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 753.425077ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
12222025-01-25T03:52:53.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 145.594906ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
12232025-01-25T03:52:53.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 54.314931ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
12242025-01-25T03:52:53.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 118.931385ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
12252025-01-25T03:52:53.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 34.468504ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
12262025-01-25T03:52:53.503ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12272025-01-25T03:52:53.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 32.299392ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
12282025-01-25T03:52:53.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 106.897246ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
12292025-01-25T03:52:53.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 94.340471ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
12302025-01-25T03:52:53.563ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12312025-01-25T03:52:53.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 59.854604ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
12322025-01-25T03:52:53.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 67.852699ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
12332025-01-25T03:52:53.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 118.233523ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
12342025-01-25T03:52:53.639ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='18379ee0-32b1-4b61-87b6-31c1ba481347'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352025-01-25T03:52:53.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 59.092049ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
12362025-01-25T03:52:53.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 169.637727ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
12372025-01-25T03:52:53.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 273.750539ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
12382025-01-25T03:52:53.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 144.157961ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
12392025-01-25T03:52:53.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 81.917024ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
12402025-01-25T03:52:53.746ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
12412025-01-25T03:52:53.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 116.583228ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
12422025-01-25T03:52:53.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 149.370463ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
12432025-01-25T03:52:53.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 231.116586ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
12442025-01-25T03:52:53.801ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
12452025-01-25T03:52:53.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 295.207541ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
12462025-01-25T03:52:53.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 207.205587ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
12472025-01-25T03:52:53.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 298.862179ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
12482025-01-25T03:52:53.849ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
12492025-01-25T03:52:53.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 116.976446ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
12502025-01-25T03:52:53.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 36.043473ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
12512025-01-25T03:52:53.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 467.570185ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
12522025-01-25T03:52:53.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 416.437081ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
12532025-01-25T03:52:53.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 288.504921ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
12542025-01-25T03:52:53.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 198.050565ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
12552025-01-25T03:52:53.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 104.175365ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
12562025-01-25T03:52:53.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 304.062302ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
12572025-01-25T03:52:53.948ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12582025-01-25T03:52:53.949ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
12592025-01-25T03:52:53.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 48.254124ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
12602025-01-25T03:52:53.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 409.6947ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
12612025-01-25T03:52:53.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 329.579764ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
12622025-01-25T03:52:54.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 60.14006ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
12632025-01-25T03:52:54.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 51.026614ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
12642025-01-25T03:52:54.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 571.243809ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
12652025-01-25T03:52:54.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 350.45659ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
12662025-01-25T03:52:54.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 66.027049ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
12672025-01-25T03:52:54.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 114.713327ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
12682025-01-25T03:52:54.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 87.950384ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
12692025-01-25T03:52:54.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 284.331782ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
12702025-01-25T03:52:54.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 43.061332ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
12712025-01-25T03:52:54.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 300.158811ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
12722025-01-25T03:52:54.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 389.671707ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
12732025-01-25T03:52:54.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 139.040048ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
12742025-01-25T03:52:54.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 401.004051ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
12752025-01-25T03:52:54.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 134.874503ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
12762025-01-25T03:52:54.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 201.875735ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
12772025-01-25T03:52:54.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 326.441942ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
12782025-01-25T03:52:54.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 234.418626ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
12792025-01-25T03:52:54.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 619.85007ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
12802025-01-25T03:52:54.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 157.783738ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
12812025-01-25T03:52:54.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 230.991779ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
12822025-01-25T03:52:54.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 736.472763ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
12832025-01-25T03:52:54.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 503.316946ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
12842025-01-25T03:52:54.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 1.099960197s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
12852025-01-25T03:52:54.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 316.662616ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
12862025-01-25T03:52:54.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 899.009253ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
12872025-01-25T03:52:54.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 954.294178ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
12882025-01-25T03:52:54.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 299.865187ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
12892025-01-25T03:52:54.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 554.371774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
12902025-01-25T03:52:54.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 250.19921ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
12912025-01-25T03:52:54.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 1.155948823s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
12922025-01-25T03:52:54.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 1.034078554s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
12932025-01-25T03:52:54.558ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12942025-01-25T03:52:54.558ZINFOSledAgent (ServiceManager): Booting oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
12952025-01-25T03:52:54.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 415.826184ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
12962025-01-25T03:52:54.582ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12972025-01-25T03:52:54.582ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
12982025-01-25T03:52:54.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 488.685075ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
12992025-01-25T03:52:54.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 912.207625ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
13002025-01-25T03:52:54.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 940.449651ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
13012025-01-25T03:52:54.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 546.50153ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
13022025-01-25T03:52:54.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 857.834049ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
13032025-01-25T03:52:54.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 1.001301907s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
13042025-01-25T03:52:54.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 29.122106ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
13052025-01-25T03:52:54.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 48.679546ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
13062025-01-25T03:52:54.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 127.920336ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
13072025-01-25T03:52:54.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 557.218967ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
13082025-01-25T03:52:54.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 99.854581ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
13092025-01-25T03:52:54.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 761.235056ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
13102025-01-25T03:52:55.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 760.802715ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
13112025-01-25T03:52:55.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 267.483193ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
13122025-01-25T03:52:55.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 619.848597ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
13132025-01-25T03:52:55.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 106.046819ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
13142025-01-25T03:52:55.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 928.193422ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
13152025-01-25T03:52:55.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 1.170267576s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
13162025-01-25T03:52:55.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 553.327085ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
13172025-01-25T03:52:55.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 382.269207ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
13182025-01-25T03:52:55.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 1.258183163s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
13192025-01-25T03:52:55.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 1.342885189s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
13202025-01-25T03:52:55.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 503.035144ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
13212025-01-25T03:52:55.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 683.845526ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
13222025-01-25T03:52:55.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 1.110443788s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
13232025-01-25T03:52:55.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 1.495357174s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
13242025-01-25T03:52:55.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 1.113936478s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
13252025-01-25T03:52:55.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 1.02826115s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
13262025-01-25T03:52:55.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 986.326349ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
13272025-01-25T03:52:55.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 1.340427993s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
13282025-01-25T03:52:55.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 662.514374ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
13292025-01-25T03:52:55.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 777.552549ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
13302025-01-25T03:52:55.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 819.708848ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
13312025-01-25T03:52:55.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 415.219625ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
13322025-01-25T03:52:55.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 1.383032737s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
13332025-01-25T03:52:55.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 1.48841574s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
13342025-01-25T03:52:55.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 1.417650691s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
13352025-01-25T03:52:56.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 1.37321781s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
13362025-01-25T03:52:56.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 641.922425ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
13372025-01-25T03:52:56.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 1.473608264s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
13382025-01-25T03:52:56.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 1.49240045s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
13392025-01-25T03:52:56.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 957.882871ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
13402025-01-25T03:52:56.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 675.077628ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
13412025-01-25T03:52:56.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 1.002149041s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
13422025-01-25T03:52:56.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 821.457129ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
13432025-01-25T03:52:56.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 1.175241461s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
13442025-01-25T03:52:56.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 974.018935ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
13452025-01-25T03:52:56.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 964.934188ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
13462025-01-25T03:52:56.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 537.002167ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
13472025-01-25T03:52:56.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 1.063858793s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
13482025-01-25T03:52:56.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 1.130518808s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
13492025-01-25T03:52:57.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 910.855624ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
13502025-01-25T03:52:57.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 941.974386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
13512025-01-25T03:52:57.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 988.53491ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
13522025-01-25T03:52:57.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 747.74051ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
13532025-01-25T03:52:57.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 860.615779ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
13542025-01-25T03:52:57.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 727.619782ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
13552025-01-25T03:52:57.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 1.231589869s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
13562025-01-25T03:52:57.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 1.303181106s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
13572025-01-25T03:52:57.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 1.383314152s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
13582025-01-25T03:52:57.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 510.519048ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
13592025-01-25T03:52:57.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 500.828831ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
13602025-01-25T03:52:57.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 1.484538654s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
13612025-01-25T03:52:57.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 1.353635926s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
13622025-01-25T03:52:57.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 914.687911ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
13632025-01-25T03:52:57.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 947.519299ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
13642025-01-25T03:52:57.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 1.360619007s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
13652025-01-25T03:52:57.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 772.435125ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
13662025-01-25T03:52:57.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 1.369376549s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
13672025-01-25T03:52:57.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 1.311075502s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
13682025-01-25T03:52:57.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 1.167483656s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
13692025-01-25T03:52:57.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 1.076190734s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
13702025-01-25T03:52:58.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 646.602286ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
13712025-01-25T03:52:58.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 885.044854ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
13722025-01-25T03:52:58.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 660.202629ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
13732025-01-25T03:52:58.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 949.035588ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
13742025-01-25T03:52:58.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 765.245ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
13752025-01-25T03:52:58.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 1.467346733s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
13762025-01-25T03:52:58.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 974.914751ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
13772025-01-25T03:52:58.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 859.755337ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
13782025-01-25T03:52:58.660ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13792025-01-25T03:52:58.660ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
13802025-01-25T03:52:58.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 758.180848ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
13812025-01-25T03:52:58.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 1.193352081s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
13822025-01-25T03:52:58.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 684.678147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
13832025-01-25T03:52:58.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 1.326827895s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
13842025-01-25T03:52:58.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 1.298527657s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
13852025-01-25T03:52:58.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 62.992829ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
13862025-01-25T03:52:58.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 1.143588921s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
13872025-01-25T03:52:59.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 149.992605ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
13882025-01-25T03:52:59.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 1.300535898s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
13892025-01-25T03:52:59.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 1.419050329s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
13902025-01-25T03:52:59.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 1.095453835s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
13912025-01-25T03:52:59.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 1.30760888s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
13922025-01-25T03:52:59.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 1.00388189s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
13932025-01-25T03:52:59.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 684.316687ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
13942025-01-25T03:52:59.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 1.343077861s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
13952025-01-25T03:52:59.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 137.707071ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
13962025-01-25T03:52:59.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 965.789711ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
13972025-01-25T03:52:59.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 780.481686ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
13982025-01-25T03:52:59.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 1.493746196s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
13992025-01-25T03:52:59.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 962.066245ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
14002025-01-25T03:52:59.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 206.513912ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
14012025-01-25T03:52:59.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 1.117760588s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
14022025-01-25T03:52:59.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 657.158995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
14032025-01-25T03:52:59.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 1.086899888s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
14042025-01-25T03:52:59.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 1.096015346s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
14052025-01-25T03:52:59.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 1.205338166s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
14062025-01-25T03:53:00.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 988.362106ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
14072025-01-25T03:53:00.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 1.336901743s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
14082025-01-25T03:53:00.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 1.113028551s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
14092025-01-25T03:53:00.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 548.010338ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
14102025-01-25T03:53:00.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 1.47995601s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
14112025-01-25T03:53:00.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 915.853984ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
14122025-01-25T03:53:00.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 1.336229455s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
14132025-01-25T03:53:00.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 1.29952243s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
14142025-01-25T03:53:00.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 946.447379ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
14152025-01-25T03:53:00.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 925.054526ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
14162025-01-25T03:53:00.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 628.500729ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
14172025-01-25T03:53:00.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 1.36872194s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
14182025-01-25T03:53:00.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 1.181563477s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
14192025-01-25T03:53:00.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 794.704604ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
14202025-01-25T03:53:00.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 1.066986646s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
14212025-01-25T03:53:00.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 1.366276001s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
14222025-01-25T03:53:00.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 668.129511ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
14232025-01-25T03:53:00.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 1.024541393s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
14242025-01-25T03:53:01.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 938.97153ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
14252025-01-25T03:53:01.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 1.399651182s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
14262025-01-25T03:53:01.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 1.371071859s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
14272025-01-25T03:53:01.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 891.163387ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
14282025-01-25T03:53:01.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 658.210092ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
14292025-01-25T03:53:01.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 557.269107ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
14302025-01-25T03:53:01.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 1.228454495s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
14312025-01-25T03:53:01.335ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39413
14322025-01-25T03:53:01.371ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 12786 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39413 req_id = c7e8ff40-cd22-4e03-8fc8-2991d0abb8f1 response_code = 200 uri = /baseboard
14332025-01-25T03:53:01.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 1.12282357s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
14342025-01-25T03:53:01.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 1.437647644s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
14352025-01-25T03:53:01.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 976.022994ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
14362025-01-25T03:53:01.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 587.691486ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
14372025-01-25T03:53:01.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 617.551651ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
14382025-01-25T03:53:01.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 1.103642464s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
14392025-01-25T03:53:01.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 1.09115666s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
14402025-01-25T03:53:01.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 1.139183629s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
14412025-01-25T03:53:01.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 1.114419425s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
14422025-01-25T03:53:01.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 1.201094907s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
14432025-01-25T03:53:01.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 653.888513ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
14442025-01-25T03:53:01.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 1.497221872s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
14452025-01-25T03:53:01.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 1.02062016s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
14462025-01-25T03:53:01.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 732.511791ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
14472025-01-25T03:53:02.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 1.39128754s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
14482025-01-25T03:53:02.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 1.366776463s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
14492025-01-25T03:53:02.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 572.263861ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
14502025-01-25T03:53:02.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 1.421211262s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
14512025-01-25T03:53:02.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 607.251456ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
14522025-01-25T03:53:02.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 1.45127801s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
14532025-01-25T03:53:02.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 1.371947325s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
14542025-01-25T03:53:02.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 1.059346537s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
14552025-01-25T03:53:02.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 1.212921918s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
14562025-01-25T03:53:02.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 1.028442734s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
14572025-01-25T03:53:02.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 827.402973ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
14582025-01-25T03:53:02.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 1.220989016s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
14592025-01-25T03:53:02.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 1.497109119s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
14602025-01-25T03:53:02.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 816.428759ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
14612025-01-25T03:53:02.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 1.293136162s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
14622025-01-25T03:53:02.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 524.561877ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
14632025-01-25T03:53:02.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 564.79024ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
14642025-01-25T03:53:02.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 790.79341ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
14652025-01-25T03:53:03.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 1.443578754s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
14662025-01-25T03:53:03.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 790.661853ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
14672025-01-25T03:53:03.088ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.05664121s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
14682025-01-25T03:53:03.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 668.646211ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
14692025-01-25T03:53:03.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 1.274050294s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
14702025-01-25T03:53:03.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 1.2602413s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
14712025-01-25T03:53:03.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 1.157245045s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
14722025-01-25T03:53:03.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 1.477270605s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
14732025-01-25T03:53:03.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 692.813822ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
14742025-01-25T03:53:03.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 611.231964ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
14752025-01-25T03:53:03.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 1.149720447s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
14762025-01-25T03:53:03.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 683.323519ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
14772025-01-25T03:53:03.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 1.063151248s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
14782025-01-25T03:53:03.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d") failed: Property not found. retry in 1.3099591s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
14792025-01-25T03:53:03.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8") failed: Property not found. retry in 1.478888974s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
14802025-01-25T03:53:03.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 1.062214141s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
14812025-01-25T03:53:03.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 1.233748587s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
14822025-01-25T03:53:03.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2") failed: Property not found. retry in 1.295585133s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
14832025-01-25T03:53:03.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 697.308767ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
14842025-01-25T03:53:04.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af") failed: Property not found. retry in 1.310878439s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
14852025-01-25T03:53:04.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 728.019585ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
14862025-01-25T03:53:04.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 742.075337ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
14872025-01-25T03:53:04.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215") failed: Property not found. retry in 1.150205167s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
14882025-01-25T03:53:04.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 1.124247773s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
14892025-01-25T03:53:04.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 851.316463ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
14902025-01-25T03:53:04.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5") failed: Property not found. retry in 697.080994ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
14912025-01-25T03:53:04.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d") failed: Property not found. retry in 867.9644ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
14922025-01-25T03:53:04.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 522.563207ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
14932025-01-25T03:53:04.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073") failed: Property not found. retry in 1.058016215s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
14942025-01-25T03:53:04.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976") failed: Property not found. retry in 1.168831739s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
14952025-01-25T03:53:04.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043") failed: Property not found. retry in 503.476316ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
14962025-01-25T03:53:04.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 1.427548605s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
14972025-01-25T03:53:04.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 1.438401272s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
14982025-01-25T03:53:04.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 933.923054ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
14992025-01-25T03:53:04.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0") failed: Property not found. retry in 873.613931ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
15002025-01-25T03:53:04.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 1.303237302s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
15012025-01-25T03:53:05.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 1.000367003s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
15022025-01-25T03:53:05.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 1.260091679s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
15032025-01-25T03:53:05.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 1.28320589s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
15042025-01-25T03:53:05.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 1.031863848s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
15052025-01-25T03:53:05.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 904.158684ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
15062025-01-25T03:53:06.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7") failed: Property not found. retry in 1.276658993s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
15072025-01-25T03:53:06.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347") failed: Property not found. retry in 641.164002ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
15082025-01-25T03:53:06.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b") failed: Property not found. retry in 692.979424ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
15092025-01-25T03:53:06.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263") failed: Property not found. retry in 935.923684ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
15102025-01-25T03:53:06.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174") failed: Property not found. retry in 1.432434432s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
15112025-01-25T03:53:06.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48") failed: Property not found. retry in 748.389799ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
15122025-01-25T03:53:06.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f") failed: Property not found. retry in 735.879551ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
15132025-01-25T03:53:06.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 1.062047562s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
15142025-01-25T03:53:07.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 669.181387ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
15152025-01-25T03:53:08.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 1.168199413s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
15162025-01-25T03:53:09.528ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.201628043s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
15172025-01-25T03:53:09.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f") failed: Property not found. retry in 842.181262ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
15182025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_5e4e1fd3-bb75-4c56-9872-89984ccd731f
15192025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_ff74059f-28eb-4407-abaa-5851cedb9976
15202025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_30be1b55-8536-417c-8d01-860ec7deb59d
15212025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_489bba1e-fda0-475b-9bf2-7a18fe2d5c3d
15222025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_230575c1-07af-4e77-84ad-e3ba8a025d48
15232025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_ee278ef4-1df8-47ae-898b-db2cb3a3b53b
15242025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_ebec9864-cc93-4890-892d-757b505e9dc5
15252025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_0ed61fdd-bc7b-48e5-a563-9b3ea7a41043
15262025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_e3432d18-2bc0-446a-aea2-d658a66b96c2
15272025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_18379ee0-32b1-4b61-87b6-31c1ba481347
15282025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_da7f70e8-8b03-46fb-9245-1f11226e49a0
15292025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_a5c2122d-6963-455b-b2f6-a7943d001ec7
15302025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_eb2795ad-9316-4f3b-94cc-368822020e5f
15312025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_06a029c2-9185-403a-918b-57bcd0084263
15322025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_45506090-398c-4f24-a8c7-f676fca18073
15332025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_8518c653-cb76-4005-ae46-03891cfb7ae8
15342025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_5215aca1-6983-4917-89ca-29d771b18215
15352025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_0c37ca13-1efb-4c99-a1f7-51107ce082af
15362025-01-25T03:53:10.624ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_e4cd66b4-cb17-454c-b8bf-90f6a89de174
15372025-01-25T03:53:10.629ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15382025-01-25T03:53:10.631ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15392025-01-25T03:53:10.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39533043 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44883 req_id = f71b855c-13f2-4dad-ba10-aef788c3fd35 response_code = 204 uri = /omicron-zones
15402025-01-25T03:53:10.643ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
15412025-01-25T03:53:10.651ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
15422025-01-25T03:53:10.656ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
15432025-01-25T03:53:10.698ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
15442025-01-25T03:53:10.702ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15452025-01-25T03:53:10.845ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15462025-01-25T03:53:11.012ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15472025-01-25T03:53:11.123ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15482025-01-25T03:53:11.254ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15492025-01-25T03:53:11.459ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15502025-01-25T03:53:11.674ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15512025-01-25T03:53:11.875ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15522025-01-25T03:53:12.225ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15532025-01-25T03:53:12.672ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15542025-01-25T03:53:12.767ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.683619744s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
15552025-01-25T03:53:13.141ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15562025-01-25T03:53:13.684ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15572025-01-25T03:53:14.489ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/42a05221-d852-42ad-b6fd-11b17ffaeead/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15582025-01-25T03:53:15.698ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "52b1c9ce-54e1-4cce-b0e3-e8bc28155cd7", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:15 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"42a05221-d852-42ad-b6fd-11b17ffaeead\"", request_id: "52b1c9ce-54e1-4cce-b0e3-e8bc28155cd7" } file = sled-agent/src/rack_setup/service.rs:1079
15592025-01-25T03:53:16.529ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "29d3bf00-7d0b-4a6b-bc96-f68d60e25814", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"42a05221-d852-42ad-b6fd-11b17ffaeead\"", request_id: "29d3bf00-7d0b-4a6b-bc96-f68d60e25814" } file = sled-agent/src/rack_setup/service.rs:1079
15602025-01-25T03:53:18.204ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d4ade9fe-0205-4de6-bdf6-7e3bc0de9e44", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:17 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "d4ade9fe-0205-4de6-bdf6-7e3bc0de9e44" } file = sled-agent/src/rack_setup/service.rs:1079
15612025-01-25T03:53:21.055ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "36badee5-78d8-4e19-9adf-cc5d98cfb90e", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "36badee5-78d8-4e19-9adf-cc5d98cfb90e" } file = sled-agent/src/rack_setup/service.rs:1079
15622025-01-25T03:53:23.594ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "deaf5c89-3843-4752-bf9d-9c9d05cd18c5", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "deaf5c89-3843-4752-bf9d-9c9d05cd18c5" } file = sled-agent/src/rack_setup/service.rs:1079
15632025-01-25T03:53:27.139ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "830a37d9-f15e-447e-b182-d5f5fed864f9", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "830a37d9-f15e-447e-b182-d5f5fed864f9" } file = sled-agent/src/rack_setup/service.rs:1079
15642025-01-25T03:53:31.249ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "02028e54-e7b1-4246-bd78-82ab8672d531", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "02028e54-e7b1-4246-bd78-82ab8672d531" } file = sled-agent/src/rack_setup/service.rs:1079
15652025-01-25T03:53:31.414ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56644
15662025-01-25T03:53:31.414ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56644 req_id = 35e3fe57-e8f4-4c70-bbf5-77eb7ee79be8 response_code = 200 uri = /baseboard
15672025-01-25T03:53:34.049ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "974942d4-2a1e-4fcb-a5d5-9beaa024413f", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "974942d4-2a1e-4fcb-a5d5-9beaa024413f" } file = sled-agent/src/rack_setup/service.rs:1079
15682025-01-25T03:53:37.029ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6a458304-b23d-4262-b846-ff014eb8f5c5", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "6a458304-b23d-4262-b846-ff014eb8f5c5" } file = sled-agent/src/rack_setup/service.rs:1079
15692025-01-25T03:53:41.967ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cb96d2bc-4d12-4d31-9d4d-7bc76e7dae32", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "cb96d2bc-4d12-4d31-9d4d-7bc76e7dae32" } file = sled-agent/src/rack_setup/service.rs:1079
15702025-01-25T03:53:45.450ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d217e1d6-c82d-473b-b077-08738628a9c2", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "d217e1d6-c82d-473b-b077-08738628a9c2" } file = sled-agent/src/rack_setup/service.rs:1079
15712025-01-25T03:53:52.499ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "14ec4ffc-06a0-4063-8fd3-b95c4a7de5bf", "content-length": "173", "date": "Sat, 25 Jan 2025 03:53:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a\"", request_id: "14ec4ffc-06a0-4063-8fd3-b95c4a7de5bf" } file = sled-agent/src/rack_setup/service.rs:1079
15722025-01-25T03:53:52.548ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
15732025-01-25T03:53:52.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39430
15742025-01-25T03:53:52.639ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15752025-01-25T03:53:52.639ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15762025-01-25T03:53:52.640ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:177
15772025-01-25T03:53:52.643ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:177
15782025-01-25T03:53:52.656ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15792025-01-25T03:53:52.656ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28
15802025-01-25T03:53:52.682ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15812025-01-25T03:53:52.682ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b
15822025-01-25T03:53:52.703ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15832025-01-25T03:53:52.703ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a
15842025-01-25T03:53:52.723ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15852025-01-25T03:53:52.723ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44c151b9-2034-4667-9c87-189bf684b2e4
15862025-01-25T03:53:52.746ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15872025-01-25T03:53:52.746ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c
15882025-01-25T03:53:52.768ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15892025-01-25T03:53:52.768ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97661079-bff0-45d9-bae2-2b9215898f21
15902025-01-25T03:53:52.790ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15912025-01-25T03:53:52.790ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3
15922025-01-25T03:53:52.811ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15932025-01-25T03:53:52.811ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f
15942025-01-25T03:53:52.830ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15952025-01-25T03:53:52.830ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30589e38-7481-4de9-b63b-77c66cbf4a51
15962025-01-25T03:53:52.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39430 req_id = 4be63913-b88e-4bf6-9e30-b1691ddbb3f8 response_code = 200 uri = /inventory
15972025-01-25T03:54:01.082ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:57087 remote_addr = [fd00:1122:3344:101::d]:58859 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
15982025-01-25T03:54:01.124ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41766 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 713ca9e0-ee14-4bd7-a9b5-64d21271950f response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
15992025-01-25T03:54:01.448ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54747
16002025-01-25T03:54:01.448ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54747 req_id = a1a0327b-0033-4a03-9b46-f827e3a6d9f1 response_code = 200 uri = /baseboard
16012025-01-25T03:54:01.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43859
16022025-01-25T03:54:01.578ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16032025-01-25T03:54:01.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16042025-01-25T03:54:01.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16052025-01-25T03:54:01.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16062025-01-25T03:54:01.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16072025-01-25T03:54:01.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16082025-01-25T03:54:01.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16092025-01-25T03:54:01.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7500 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43859 req_id = a08840fc-c253-4f09-a54f-bd510020b834 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16102025-01-25T03:54:01.581ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
16112025-01-25T03:54:01.584ZINFOSledAgent (RSS): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16122025-01-25T03:54:01.585ZINFOSledAgent (RSS): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16132025-01-25T03:54:01.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36157
16142025-01-25T03:54:01.746ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16152025-01-25T03:54:01.746ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16162025-01-25T03:54:01.746ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:177
16172025-01-25T03:54:01.747ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:177
16182025-01-25T03:54:01.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16192025-01-25T03:54:01.760ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28
16202025-01-25T03:54:01.784ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16212025-01-25T03:54:01.784ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b
16222025-01-25T03:54:01.807ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16232025-01-25T03:54:01.807ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a
16242025-01-25T03:54:01.830ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16252025-01-25T03:54:01.830ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44c151b9-2034-4667-9c87-189bf684b2e4
16262025-01-25T03:54:01.853ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16272025-01-25T03:54:01.853ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c
16282025-01-25T03:54:01.875ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16292025-01-25T03:54:01.875ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97661079-bff0-45d9-bae2-2b9215898f21
16302025-01-25T03:54:01.895ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16312025-01-25T03:54:01.895ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3
16322025-01-25T03:54:01.918ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16332025-01-25T03:54:01.918ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f
16342025-01-25T03:54:01.937ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16352025-01-25T03:54:01.937ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30589e38-7481-4de9-b63b-77c66cbf4a51
16362025-01-25T03:54:01.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202680 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36157 req_id = 1c6c479e-f20b-400f-9c08-41424a401e7d response_code = 200 uri = /inventory
16372025-01-25T03:54:03.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42984
16382025-01-25T03:54:03.135ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16392025-01-25T03:54:03.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16402025-01-25T03:54:03.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16412025-01-25T03:54:03.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16422025-01-25T03:54:03.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16432025-01-25T03:54:03.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16442025-01-25T03:54:03.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16452025-01-25T03:54:03.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42984 req_id = af28a8e7-6383-408e-93d9-ae17080c8cbd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16462025-01-25T03:54:03.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50684
16472025-01-25T03:54:03.263ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16482025-01-25T03:54:03.263ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16492025-01-25T03:54:03.263ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16502025-01-25T03:54:03.263ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16512025-01-25T03:54:03.263ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16522025-01-25T03:54:03.263ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16532025-01-25T03:54:03.263ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16542025-01-25T03:54:03.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50684 req_id = fdd5abcd-bd68-4f38-a9b9-fa9321eca020 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16552025-01-25T03:54:03.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64618
16562025-01-25T03:54:03.267ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16572025-01-25T03:54:03.267ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16582025-01-25T03:54:03.267ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16592025-01-25T03:54:03.267ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16602025-01-25T03:54:03.267ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16612025-01-25T03:54:03.267ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16622025-01-25T03:54:03.267ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16632025-01-25T03:54:03.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64618 req_id = 6ca33694-8d42-40d5-a690-3af097fd09ec response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16642025-01-25T03:54:08.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34724
16652025-01-25T03:54:08.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 738 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34724 req_id = 4841111d-9063-4f35-b35f-5c7a2adbf251 response_code = 200 uri = /vpc-routes
16662025-01-25T03:54:08.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
16672025-01-25T03:54:08.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34724 req_id = 382d8886-5a13-4f16-8b60-9a31de57744b response_code = 204 uri = /eip-gateways
16682025-01-25T03:54:08.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34724 req_id = 5676d5d0-aeb5-458c-9955-7666d817ac36 response_code = 204 uri = /vpc-routes
16692025-01-25T03:54:16.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35255
16702025-01-25T03:54:16.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35255 req_id = d6a0c732-cd57-4475-aa12-45172df06ccb response_code = 200 uri = /vpc-routes
16712025-01-25T03:54:16.524ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
16722025-01-25T03:54:16.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35255 req_id = ce8c2e32-53d2-461e-977a-e4945bf4b769 response_code = 204 uri = /eip-gateways
16732025-01-25T03:54:16.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35255 req_id = 59763fb9-1f47-4d14-8204-dda66f3f9f05 response_code = 204 uri = /vpc-routes
16742025-01-25T03:54:16.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60607
16752025-01-25T03:54:16.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 531 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60607 req_id = 4c0ad2dc-119f-472f-995a-ee5ac77b4153 response_code = 200 uri = /v2p
16762025-01-25T03:54:16.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33188
16772025-01-25T03:54:16.916ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
16782025-01-25T03:54:16.990ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
16792025-01-25T03:54:17.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135572 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33188 req_id = 1d047859-879b-4543-92fe-a398d2068fc3 response_code = 204 uri = /switch-ports
16802025-01-25T03:54:17.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33188 req_id = 4262ffa2-cb88-4434-986e-12f40cf1ce68 response_code = 200 uri = /network-bootstore-config
16812025-01-25T03:54:17.091ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
16822025-01-25T03:54:17.092ZINFOSledAgent (bootstore): Writing ledger to /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16832025-01-25T03:54:17.092ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16842025-01-25T03:54:17.093ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
16852025-01-25T03:54:17.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33188 req_id = 3543618f-fdb8-414d-942a-17de5bad067b response_code = 204 uri = /network-bootstore-config
16862025-01-25T03:54:17.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44152
16872025-01-25T03:54:17.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44152 req_id = 3a9f720f-00c0-4fc5-9e84-1a3d2178f693 response_code = 200 uri = /vpc-routes
16882025-01-25T03:54:17.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56093
16892025-01-25T03:54:17.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56093 req_id = d4c902f9-8ff1-4f59-9dba-c9bc41f197b3 response_code = 200 uri = /v2p
16902025-01-25T03:54:17.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64348
16912025-01-25T03:54:17.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64348 req_id = 8d53518e-2c7b-4015-b766-86443dd25574 response_code = 200 uri = /vpc-routes
16922025-01-25T03:54:17.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
16932025-01-25T03:54:17.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44152 req_id = e2536456-09bf-4479-acc5-4b23470c4ee3 response_code = 204 uri = /eip-gateways
16942025-01-25T03:54:17.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44152 req_id = 8f44ff06-5faf-4a85-adbe-87f9046405c5 response_code = 204 uri = /vpc-routes
16952025-01-25T03:54:17.621ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
16962025-01-25T03:54:17.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64348 req_id = ce559317-9379-4fa2-80c6-330cbeb12013 response_code = 204 uri = /eip-gateways
16972025-01-25T03:54:17.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52887
16982025-01-25T03:54:17.673ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
16992025-01-25T03:54:17.714ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17002025-01-25T03:54:17.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101945 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52887 req_id = c654feeb-3b25-4f7d-bca6-c8fd94007a3f response_code = 204 uri = /switch-ports
17012025-01-25T03:54:17.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42684
17022025-01-25T03:54:17.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64348 req_id = d6081a3a-4245-4570-b9b0-ef3d01cfbc33 response_code = 204 uri = /vpc-routes
17032025-01-25T03:54:17.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42684 req_id = b6e7f2e7-dab5-42c0-aecb-0b2bd6ba7acf response_code = 200 uri = /v2p
17042025-01-25T03:54:17.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 489 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52887 req_id = b23293c7-f7b2-45d7-a6fb-f1b004774837 response_code = 200 uri = /network-bootstore-config
17052025-01-25T03:54:17.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44995
17062025-01-25T03:54:17.883ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17072025-01-25T03:54:17.920ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17082025-01-25T03:54:17.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93050 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44995 req_id = d0508d16-b129-4aee-8d6e-a31223be14e8 response_code = 204 uri = /switch-ports
17092025-01-25T03:54:17.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44995 req_id = 068a11f2-471a-48f4-83bf-f3e68537aa6a response_code = 200 uri = /network-bootstore-config
17102025-01-25T03:54:31.090ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8789 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = b238d051-e459-4393-9481-c0919afd27ce response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
17112025-01-25T03:54:31.483ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34787
17122025-01-25T03:54:31.483ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34787 req_id = f605f2b7-c2fd-44b0-a676-8978249f1f2e response_code = 200 uri = /baseboard
17132025-01-25T03:54:46.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64881
17142025-01-25T03:54:46.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64881 req_id = bade1e3b-2c0c-4072-a27b-a8f59fd84140 response_code = 200 uri = /vpc-routes
17152025-01-25T03:54:46.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43163
17162025-01-25T03:54:46.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43163 req_id = 955852f8-62e3-40fb-972e-6728e35e1c9f response_code = 200 uri = /v2p
17172025-01-25T03:54:46.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
17182025-01-25T03:54:46.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64881 req_id = 852f0acd-26b5-4e8d-b619-67cda2211df0 response_code = 204 uri = /eip-gateways
17192025-01-25T03:54:46.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64881 req_id = 314fcd07-3650-454f-9f6b-6b1d035f3dd5 response_code = 204 uri = /vpc-routes
17202025-01-25T03:54:46.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43108
17212025-01-25T03:54:46.724ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17222025-01-25T03:54:46.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17232025-01-25T03:54:46.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89713 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43108 req_id = d072d502-2b9c-4a8a-8a43-1413372ff109 response_code = 204 uri = /switch-ports
17242025-01-25T03:54:46.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43108 req_id = 611d51e9-b4a6-4376-81f8-822d12f62235 response_code = 200 uri = /network-bootstore-config
17252025-01-25T03:54:47.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61782
17262025-01-25T03:54:47.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61782 req_id = fb7e564b-d81e-4617-b895-07c49c5025b9 response_code = 200 uri = /vpc-routes
17272025-01-25T03:54:47.279ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
17282025-01-25T03:54:47.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61782 req_id = 549f270b-9f44-49d5-8a85-01f98ce7a2f1 response_code = 204 uri = /eip-gateways
17292025-01-25T03:54:47.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61782 req_id = 4ce60695-baa6-4082-ac92-0c9f274fa302 response_code = 204 uri = /vpc-routes
17302025-01-25T03:54:47.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49127
17312025-01-25T03:54:47.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17322025-01-25T03:54:47.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17332025-01-25T03:54:47.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110019 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49127 req_id = 74be0db7-3263-4857-bc3e-58bbd4109d16 response_code = 204 uri = /switch-ports
17342025-01-25T03:54:47.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63238
17352025-01-25T03:54:47.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49127 req_id = ed5af081-e533-42a7-810f-92928695bb6d response_code = 200 uri = /network-bootstore-config
17362025-01-25T03:54:47.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63238 req_id = bd446648-8440-4d2d-a593-64b31573f664 response_code = 200 uri = /v2p
17372025-01-25T03:54:47.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51161
17382025-01-25T03:54:47.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51161 req_id = 537816fa-499c-4414-b3cf-8223f93a4486 response_code = 200 uri = /vpc-routes
17392025-01-25T03:54:47.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37065
17402025-01-25T03:54:47.561ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17412025-01-25T03:54:47.600ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17422025-01-25T03:54:47.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99308 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37065 req_id = 4361dfd2-ea00-45fc-8891-1b05f4e237df response_code = 204 uri = /switch-ports
17432025-01-25T03:54:47.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37065 req_id = 9f1575c3-cdde-4cdd-806a-8dd073713694 response_code = 200 uri = /network-bootstore-config
17442025-01-25T03:54:47.664ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
17452025-01-25T03:54:47.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51161 req_id = c1979911-2e45-4c2b-a643-489c1856e563 response_code = 204 uri = /eip-gateways
17462025-01-25T03:54:47.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65478
17472025-01-25T03:54:47.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65478 req_id = 95298eee-2604-4fb6-a6bc-9c6b6f197850 response_code = 200 uri = /v2p
17482025-01-25T03:54:47.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51161 req_id = d90dfea1-b31e-42ab-85cc-282f90dd7dd7 response_code = 204 uri = /vpc-routes
17492025-01-25T03:55:01.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6683 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 323d7cba-9516-4795-a60c-80b2988ff549 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
17502025-01-25T03:55:01.517ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45162
17512025-01-25T03:55:01.517ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45162 req_id = 7fee4fcc-e19b-41ed-b0d0-4a24ad4901ba response_code = 200 uri = /baseboard
17522025-01-25T03:55:16.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50453
17532025-01-25T03:55:16.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50453 req_id = 1b315bb1-2d9e-4b56-8abf-898f7bac8b25 response_code = 200 uri = /vpc-routes
17542025-01-25T03:55:16.642ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
17552025-01-25T03:55:16.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50453 req_id = 112e4357-2475-4352-b3ab-7e7c5ed4d612 response_code = 204 uri = /eip-gateways
17562025-01-25T03:55:16.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51991
17572025-01-25T03:55:16.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51991 req_id = 6a703de3-7567-4ce5-897e-3a00e2a0d0c7 response_code = 200 uri = /v2p
17582025-01-25T03:55:16.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50453 req_id = e15f95fb-9bec-4418-bd62-4eb274373584 response_code = 204 uri = /vpc-routes
17592025-01-25T03:55:16.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47991
17602025-01-25T03:55:16.928ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17612025-01-25T03:55:16.964ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17622025-01-25T03:55:17.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47991 req_id = c4f700a6-2f26-4ce0-bed8-8f08a7349ff9 response_code = 204 uri = /switch-ports
17632025-01-25T03:55:17.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47991 req_id = a3ecf8c1-f2c8-46f4-9134-0e6eeecbab33 response_code = 200 uri = /network-bootstore-config
17642025-01-25T03:55:17.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37582
17652025-01-25T03:55:17.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37582 req_id = f56cfb7f-c2b4-4531-b569-fc569a5ab9e4 response_code = 200 uri = /vpc-routes
17662025-01-25T03:55:17.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
17672025-01-25T03:55:17.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37582 req_id = d14b0865-3b95-40c8-bac6-07c347d6b562 response_code = 204 uri = /eip-gateways
17682025-01-25T03:55:17.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37582 req_id = 042f541f-0a78-45d4-a057-98accfb0e0d4 response_code = 204 uri = /vpc-routes
17692025-01-25T03:55:17.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62293
17702025-01-25T03:55:17.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62293 req_id = 14e5ddd4-50fc-492d-a4e9-6d29209fa990 response_code = 200 uri = /v2p
17712025-01-25T03:55:17.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40459
17722025-01-25T03:55:17.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40459 req_id = ece7f0f9-09fa-4b70-b20e-5c9720c8e79f response_code = 200 uri = /vpc-routes
17732025-01-25T03:55:17.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37850
17742025-01-25T03:55:17.631ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17752025-01-25T03:55:17.672ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17762025-01-25T03:55:17.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37850 req_id = 2f5b69c3-c7eb-43d1-8b04-791ae83f3ffd response_code = 204 uri = /switch-ports
17772025-01-25T03:55:17.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32804
17782025-01-25T03:55:17.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58833
17792025-01-25T03:55:17.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
17802025-01-25T03:55:17.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40459 req_id = f648e92b-e04e-4fb4-b7e7-d0f30df44096 response_code = 204 uri = /eip-gateways
17812025-01-25T03:55:17.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37850 req_id = 44e9430f-2480-4b66-a221-edc89ffb4d6b response_code = 200 uri = /network-bootstore-config
17822025-01-25T03:55:17.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32804 req_id = 1aab96f1-4204-4015-b1a1-9f97021704bb response_code = 200 uri = /v2p
17832025-01-25T03:55:17.728ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17842025-01-25T03:55:17.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40459 req_id = 832cc29a-cf0d-4ea0-89ee-45329224ad86 response_code = 204 uri = /vpc-routes
17852025-01-25T03:55:17.770ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17862025-01-25T03:55:17.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100084 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58833 req_id = 2982a205-2860-4eba-8d1f-9718885efdaf response_code = 204 uri = /switch-ports
17872025-01-25T03:55:17.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58833 req_id = 46a27853-169c-405e-883b-c32a8e3c3ea3 response_code = 200 uri = /network-bootstore-config
17882025-01-25T03:55:31.088ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7301 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 10ed14ff-89e8-47c7-9d30-f7e93b206d0a response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
17892025-01-25T03:55:31.551ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48183
17902025-01-25T03:55:31.551ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48183 req_id = 22c39b60-555c-42e7-bd9b-e11f8746e1b8 response_code = 200 uri = /baseboard
17912025-01-25T03:55:46.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35035
17922025-01-25T03:55:46.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35035 req_id = c60c1c57-6f59-4d7e-8eec-6cb5ce52308d response_code = 200 uri = /vpc-routes
17932025-01-25T03:55:46.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
17942025-01-25T03:55:46.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35035 req_id = 5d5626cf-39ce-4cd1-8dbc-63f9ea94323b response_code = 204 uri = /eip-gateways
17952025-01-25T03:55:46.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35035 req_id = 5710c52b-594d-4133-8261-f49fc60306b1 response_code = 204 uri = /vpc-routes
17962025-01-25T03:55:46.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60921
17972025-01-25T03:55:46.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60921 req_id = 3165f37e-f8a3-4f1c-9242-41d07a833b7c response_code = 200 uri = /v2p
17982025-01-25T03:55:46.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39219
17992025-01-25T03:55:46.610ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18002025-01-25T03:55:46.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18012025-01-25T03:55:46.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108567 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39219 req_id = 00e878d3-120b-46ca-ad7d-f6bd15120529 response_code = 204 uri = /switch-ports
18022025-01-25T03:55:46.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39219 req_id = be64247d-f85d-45cd-8dd4-b4dcb0bbeecc response_code = 200 uri = /network-bootstore-config
18032025-01-25T03:55:47.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55263
18042025-01-25T03:55:47.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55263 req_id = d2eac452-ddf0-4d9a-90c2-54fafd64e090 response_code = 200 uri = /vpc-routes
18052025-01-25T03:55:47.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
18062025-01-25T03:55:47.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55263 req_id = 64fce638-777d-43f8-89d2-d55eb228a263 response_code = 204 uri = /eip-gateways
18072025-01-25T03:55:47.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55263 req_id = b4892b36-eed1-411c-a548-78b59f8d8c0c response_code = 204 uri = /vpc-routes
18082025-01-25T03:55:47.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42735
18092025-01-25T03:55:47.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42735 req_id = 3e495227-017c-48dc-802b-e02c3092b2b7 response_code = 200 uri = /vpc-routes
18102025-01-25T03:55:47.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
18112025-01-25T03:55:47.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42735 req_id = 82586254-a31b-46c5-b6c5-57d589ec38a2 response_code = 204 uri = /eip-gateways
18122025-01-25T03:55:47.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44713
18132025-01-25T03:55:47.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44713 req_id = 2da34380-b00a-4868-a57b-9b1fed34196e response_code = 200 uri = /v2p
18142025-01-25T03:55:47.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42735 req_id = f1169d0a-edad-4db3-803c-99c8ad00452c response_code = 204 uri = /vpc-routes
18152025-01-25T03:55:47.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35636
18162025-01-25T03:55:47.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35636 req_id = fba65abf-7868-4b8b-a9bf-60838596e396 response_code = 200 uri = /v2p
18172025-01-25T03:55:47.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33526
18182025-01-25T03:55:47.573ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18192025-01-25T03:55:47.615ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18202025-01-25T03:55:47.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101775 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33526 req_id = 1e0a1be6-5060-409d-898f-4f8353980fc3 response_code = 204 uri = /switch-ports
18212025-01-25T03:55:47.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60129
18222025-01-25T03:55:47.675ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18232025-01-25T03:55:47.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33526 req_id = aad0e2ed-89e8-46fc-a937-37c38f6ccee6 response_code = 200 uri = /network-bootstore-config
18242025-01-25T03:55:47.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18252025-01-25T03:55:47.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100831 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60129 req_id = 1fd704c4-7f7b-464d-95c1-155bd897f473 response_code = 204 uri = /switch-ports
18262025-01-25T03:55:47.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60129 req_id = 7885c547-2e3d-4c67-b797-12664c8eb439 response_code = 200 uri = /network-bootstore-config
18272025-01-25T03:56:01.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6839 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 5b2676a3-ec6f-43ee-8a0c-605270fe2d3d response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
18282025-01-25T03:56:01.584ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33705
18292025-01-25T03:56:01.584ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33705 req_id = 69383954-8937-4ca9-a4c7-f1714ebb03c8 response_code = 200 uri = /baseboard
18302025-01-25T03:56:16.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55150
18312025-01-25T03:56:16.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55150 req_id = 4c53f778-4d8d-44f7-a49a-14fd8ec203ef response_code = 200 uri = /vpc-routes
18322025-01-25T03:56:16.603ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
18332025-01-25T03:56:16.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55150 req_id = a94730da-7960-43b6-b06f-23296fd29633 response_code = 204 uri = /eip-gateways
18342025-01-25T03:56:16.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59255
18352025-01-25T03:56:16.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59255 req_id = 6645c3da-5514-422a-a695-6bcc839776b6 response_code = 200 uri = /v2p
18362025-01-25T03:56:16.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55150 req_id = 255eca45-a0c4-4aad-8899-f12254e24c86 response_code = 204 uri = /vpc-routes
18372025-01-25T03:56:16.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51888
18382025-01-25T03:56:16.777ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18392025-01-25T03:56:16.818ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18402025-01-25T03:56:16.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96326 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51888 req_id = c7938c6b-675f-4912-8123-73c9f67d7f74 response_code = 204 uri = /switch-ports
18412025-01-25T03:56:16.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51888 req_id = b7f11d18-deb5-4d59-9cee-e2d02657aae7 response_code = 200 uri = /network-bootstore-config
18422025-01-25T03:56:17.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62318
18432025-01-25T03:56:17.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62318 req_id = 07a8f4ea-0ed2-479d-92f7-5f17e5624fd8 response_code = 200 uri = /vpc-routes
18442025-01-25T03:56:17.614ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
18452025-01-25T03:56:17.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62318 req_id = 2b2204ef-8b55-4041-8371-20e7a4faef90 response_code = 204 uri = /eip-gateways
18462025-01-25T03:56:17.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60189
18472025-01-25T03:56:17.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60189 req_id = a934f120-ff0e-4dfc-b32d-7d0719685543 response_code = 200 uri = /vpc-routes
18482025-01-25T03:56:17.706ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
18492025-01-25T03:56:17.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60189 req_id = 1d033de1-5bef-4cf3-9274-62163b4a7209 response_code = 204 uri = /eip-gateways
18502025-01-25T03:56:17.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65067
18512025-01-25T03:56:17.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65067 req_id = 8e8f2849-b4a3-4959-a1a8-11f325f3c3c8 response_code = 200 uri = /v2p
18522025-01-25T03:56:17.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60189 req_id = 38c610c9-b785-4e48-8658-9f0637f6fcb2 response_code = 204 uri = /vpc-routes
18532025-01-25T03:56:17.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59889
18542025-01-25T03:56:17.773ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18552025-01-25T03:56:17.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18562025-01-25T03:56:17.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59889 req_id = 66049504-088c-4953-93f2-392d642e8b5e response_code = 204 uri = /switch-ports
18572025-01-25T03:56:17.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36660
18582025-01-25T03:56:17.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33424
18592025-01-25T03:56:17.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18602025-01-25T03:56:17.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4618 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59889 req_id = 409736c7-8f11-4957-bebc-51223c0bd9f7 response_code = 200 uri = /network-bootstore-config
18612025-01-25T03:56:17.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4733 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62318 req_id = 21d4bd6a-9925-4a6f-85c4-d0c15553d52d response_code = 204 uri = /vpc-routes
18622025-01-25T03:56:17.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 943 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36660 req_id = 65c4b966-f432-45a2-a0ad-a2b7c73bef45 response_code = 200 uri = /v2p
18632025-01-25T03:56:17.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18642025-01-25T03:56:17.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92595 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33424 req_id = 336a4780-66b9-4313-8338-7f23df287d66 response_code = 204 uri = /switch-ports
18652025-01-25T03:56:17.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33424 req_id = e96bbb2d-20da-4d1f-8831-a058116d9914 response_code = 200 uri = /network-bootstore-config
18662025-01-25T03:56:20.507ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18672025-01-25T03:56:31.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7007 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 4c46ff0c-d388-4e47-9bb1-3497fdeb0784 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
18682025-01-25T03:56:31.615ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56998
18692025-01-25T03:56:31.615ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56998 req_id = 0368f705-44cb-4104-9f60-8ad2f95bbe75 response_code = 200 uri = /baseboard
18702025-01-25T03:56:46.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43757
18712025-01-25T03:56:46.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43757 req_id = 3ed81e6d-52a9-4d65-8e49-a672a6560033 response_code = 200 uri = /vpc-routes
18722025-01-25T03:56:46.476ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
18732025-01-25T03:56:46.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43757 req_id = 41203e62-e0e1-404a-872d-27e78e8e5b77 response_code = 204 uri = /eip-gateways
18742025-01-25T03:56:46.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43757 req_id = 5cdd3ed0-64bf-4093-b0db-414e932b64c4 response_code = 204 uri = /vpc-routes
18752025-01-25T03:56:46.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62775
18762025-01-25T03:56:46.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62775 req_id = 2d03efd6-3363-49d7-8147-92f6e7c9b5a8 response_code = 200 uri = /v2p
18772025-01-25T03:56:46.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62919
18782025-01-25T03:56:46.580ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18792025-01-25T03:56:46.616ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18802025-01-25T03:56:46.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92931 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62919 req_id = 4878cf3c-7afa-4ffb-8185-dad968217807 response_code = 204 uri = /switch-ports
18812025-01-25T03:56:46.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62919 req_id = 656f4ee1-09e3-42a4-a27d-f5baa6f3fcbe response_code = 200 uri = /network-bootstore-config
18822025-01-25T03:56:47.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54866
18832025-01-25T03:56:47.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54866 req_id = 7b65a8d9-4d4d-44ce-a1e3-abe04018618f response_code = 200 uri = /vpc-routes
18842025-01-25T03:56:47.331ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
18852025-01-25T03:56:47.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54866 req_id = dc6ebd1d-41bf-4035-9e7e-6ae4a0be9a3a response_code = 204 uri = /eip-gateways
18862025-01-25T03:56:47.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54866 req_id = 4d81b115-6786-4f05-9f52-f9bbaa34ea9d response_code = 204 uri = /vpc-routes
18872025-01-25T03:56:47.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43965
18882025-01-25T03:56:47.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43965 req_id = f0b7fcc9-3037-4da8-9e51-3471f864a21a response_code = 200 uri = /v2p
18892025-01-25T03:56:47.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33799
18902025-01-25T03:56:47.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18912025-01-25T03:56:47.465ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18922025-01-25T03:56:47.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33799 req_id = 81969bfa-f0e2-4f5a-87f9-ccf421717545 response_code = 204 uri = /switch-ports
18932025-01-25T03:56:47.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62840
18942025-01-25T03:56:47.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33799 req_id = 9b353e78-4840-4958-b95f-3d6634499e0a response_code = 200 uri = /network-bootstore-config
18952025-01-25T03:56:47.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62840 req_id = 6c0ace5d-f41b-4245-ad99-aec99f8e743c response_code = 200 uri = /vpc-routes
18962025-01-25T03:56:47.540ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
18972025-01-25T03:56:47.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62840 req_id = b6407e57-864e-4472-b297-b3df68bb42e0 response_code = 204 uri = /eip-gateways
18982025-01-25T03:56:47.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65534
18992025-01-25T03:56:47.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65534 req_id = 39dde50d-c108-4140-ad7f-6a3063127bb1 response_code = 200 uri = /v2p
19002025-01-25T03:56:47.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62840 req_id = eb80c374-dc9a-4f20-843a-4a574e8b0788 response_code = 204 uri = /vpc-routes
19012025-01-25T03:56:47.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43864
19022025-01-25T03:56:47.728ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19032025-01-25T03:56:47.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19042025-01-25T03:56:47.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89996 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43864 req_id = f811ec93-9044-4e79-b188-407e4fac6521 response_code = 204 uri = /switch-ports
19052025-01-25T03:56:47.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43864 req_id = 74c3541e-7b0f-4c15-aac1-a3a91725d853 response_code = 200 uri = /network-bootstore-config
19062025-01-25T03:57:01.088ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8443 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 5fa4833b-1600-48a3-9a4c-44d2adc591b3 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
19072025-01-25T03:57:01.648ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65291
19082025-01-25T03:57:01.648ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65291 req_id = 986e7ad3-5c99-4441-9bc2-02fea9dd72ee response_code = 200 uri = /baseboard
19092025-01-25T03:57:16.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61711
19102025-01-25T03:57:16.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61711 req_id = b0a4c0d3-366f-4a40-a6f5-9bbd7c5595b7 response_code = 200 uri = /vpc-routes
19112025-01-25T03:57:16.663ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
19122025-01-25T03:57:16.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61711 req_id = 887c5f45-edc9-42c8-99bc-cd7c3d13e96d response_code = 204 uri = /eip-gateways
19132025-01-25T03:57:16.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61711 req_id = aab543b3-1bb9-4f02-818b-872204b98231 response_code = 204 uri = /vpc-routes
19142025-01-25T03:57:16.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59880
19152025-01-25T03:57:16.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59880 req_id = 50e234ee-ff4c-4a36-bd11-818a05965b70 response_code = 200 uri = /v2p
19162025-01-25T03:57:16.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61968
19172025-01-25T03:57:16.824ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19182025-01-25T03:57:16.864ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19192025-01-25T03:57:16.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61968 req_id = 273e7c5a-4d37-4beb-908d-f21153007328 response_code = 204 uri = /switch-ports
19202025-01-25T03:57:16.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61968 req_id = 08d4035e-9acb-4062-8e22-be8cf552dbe9 response_code = 200 uri = /network-bootstore-config
19212025-01-25T03:57:17.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54073
19222025-01-25T03:57:17.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54073 req_id = 554c0bb5-2a43-47de-a490-01d01d38d8b6 response_code = 200 uri = /vpc-routes
19232025-01-25T03:57:17.457ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
19242025-01-25T03:57:17.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54073 req_id = c3400561-15bb-40d0-bc9a-e7668cc95082 response_code = 204 uri = /eip-gateways
19252025-01-25T03:57:17.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54073 req_id = 1bcd9010-5dcc-4025-8211-77c3a66ead34 response_code = 204 uri = /vpc-routes
19262025-01-25T03:57:17.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37360
19272025-01-25T03:57:17.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37360 req_id = d6d1345b-bb16-47df-a295-20b7499ca578 response_code = 200 uri = /vpc-routes
19282025-01-25T03:57:17.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
19292025-01-25T03:57:17.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37360 req_id = 70cfffb5-ba1f-45bc-9810-7bb0c89dabb0 response_code = 204 uri = /eip-gateways
19302025-01-25T03:57:17.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37360 req_id = f9c16ce1-b0c7-4343-8ba5-d245410a498f response_code = 204 uri = /vpc-routes
19312025-01-25T03:57:17.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54192
19322025-01-25T03:57:17.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54192 req_id = 33dfac70-1e05-44e9-bc85-5ed783e8f859 response_code = 200 uri = /v2p
19332025-01-25T03:57:17.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43013
19342025-01-25T03:57:17.622ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19352025-01-25T03:57:17.662ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19362025-01-25T03:57:17.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43013 req_id = 8e61255c-435d-42d3-bec8-ad73dd0e63a8 response_code = 204 uri = /switch-ports
19372025-01-25T03:57:17.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37516
19382025-01-25T03:57:17.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37516 req_id = a05f6944-1132-40d4-9a34-d1e6a374752c response_code = 200 uri = /v2p
19392025-01-25T03:57:17.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43013 req_id = 113dda5a-1412-43c0-bef6-315b57a7d1b1 response_code = 200 uri = /network-bootstore-config
19402025-01-25T03:57:17.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34679
19412025-01-25T03:57:17.725ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19422025-01-25T03:57:17.760ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19432025-01-25T03:57:17.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93215 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34679 req_id = f7a4af37-e35d-4f49-bc28-4c271205e84c response_code = 204 uri = /switch-ports
19442025-01-25T03:57:17.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34679 req_id = dd074939-912c-4786-9005-6ff94c0bedac response_code = 200 uri = /network-bootstore-config
19452025-01-25T03:57:31.086ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6697 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = e5827fc4-1628-42c0-8293-8288ef88ab40 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
19462025-01-25T03:57:31.682ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35118
19472025-01-25T03:57:31.682ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35118 req_id = 3ce079d5-1224-4311-9c74-2c14e4a8a102 response_code = 200 uri = /baseboard
19482025-01-25T03:57:46.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54642
19492025-01-25T03:57:46.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54642 req_id = 4d5d6dcf-632b-4d64-9d59-40d5f6db238e response_code = 200 uri = /v2p
19502025-01-25T03:57:46.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52724
19512025-01-25T03:57:46.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52724 req_id = c71717b6-b451-4915-91de-9336c7437784 response_code = 200 uri = /vpc-routes
19522025-01-25T03:57:46.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
19532025-01-25T03:57:46.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52724 req_id = 80386402-c967-4817-91dc-27b1aeb59639 response_code = 204 uri = /eip-gateways
19542025-01-25T03:57:46.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52724 req_id = 61ff58f7-c5cd-4f4f-a159-9d6acbc67d26 response_code = 204 uri = /vpc-routes
19552025-01-25T03:57:46.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34618
19562025-01-25T03:57:46.577ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19572025-01-25T03:57:46.616ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19582025-01-25T03:57:46.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96751 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34618 req_id = 817b0b45-8944-4eb4-8264-534e6be01821 response_code = 204 uri = /switch-ports
19592025-01-25T03:57:46.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34618 req_id = 5889f1b1-5add-47d3-ba08-a42846ebaeef response_code = 200 uri = /network-bootstore-config
19602025-01-25T03:57:47.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54109
19612025-01-25T03:57:47.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54109 req_id = 079d8369-66c0-4add-814f-52b72f70c216 response_code = 200 uri = /vpc-routes
19622025-01-25T03:57:47.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57846
19632025-01-25T03:57:47.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57846 req_id = 8c8cd537-b61e-4234-8517-75c329da0fdb response_code = 200 uri = /vpc-routes
19642025-01-25T03:57:47.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54776
19652025-01-25T03:57:47.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54776 req_id = a5b9566c-a1c3-4306-a01b-a40afded63b7 response_code = 200 uri = /v2p
19662025-01-25T03:57:47.497ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
19672025-01-25T03:57:47.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57846 req_id = b4f4d691-a140-45d9-83f0-78c13d714e0a response_code = 204 uri = /eip-gateways
19682025-01-25T03:57:47.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57846 req_id = 97f8ebe5-c5b2-4e6b-88c3-116216da4ee9 response_code = 204 uri = /vpc-routes
19692025-01-25T03:57:47.522ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
19702025-01-25T03:57:47.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54109 req_id = 2c03ca19-cbe3-41e4-abb4-21d674ce549c response_code = 204 uri = /eip-gateways
19712025-01-25T03:57:47.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54109 req_id = c09ee501-6041-40c7-8f8b-98eed9dba68c response_code = 204 uri = /vpc-routes
19722025-01-25T03:57:47.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42719
19732025-01-25T03:57:47.560ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19742025-01-25T03:57:47.599ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19752025-01-25T03:57:47.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42719 req_id = f75f13b4-1ef5-4925-8264-13252c575765 response_code = 204 uri = /switch-ports
19762025-01-25T03:57:47.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62273
19772025-01-25T03:57:47.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64625
19782025-01-25T03:57:47.657ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19792025-01-25T03:57:47.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42719 req_id = 03e3b026-80b0-4e9f-baec-667bd00352a4 response_code = 200 uri = /network-bootstore-config
19802025-01-25T03:57:47.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3785 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62273 req_id = 4ff48eb6-39ec-4572-9f73-f3ef86d9609e response_code = 200 uri = /v2p
19812025-01-25T03:57:47.694ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19822025-01-25T03:57:47.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64625 req_id = b5aabf31-d106-4efa-9fa0-900567a27e72 response_code = 204 uri = /switch-ports
19832025-01-25T03:57:47.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64625 req_id = e11fe763-7615-468d-8ed5-bd092a34ca83 response_code = 200 uri = /network-bootstore-config
19842025-01-25T03:58:01.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7506 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 9799ff88-fd37-4d7d-b3c4-d5e7b78a8fc2 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
19852025-01-25T03:58:01.716ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63420
19862025-01-25T03:58:01.717ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63420 req_id = 72aaff94-7cda-4d69-8639-56d44b09236b response_code = 200 uri = /baseboard
19872025-01-25T03:58:16.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36097
19882025-01-25T03:58:16.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36097 req_id = f5af81d1-ec93-4b78-8065-e899e27a2a31 response_code = 200 uri = /v2p
19892025-01-25T03:58:16.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37191
19902025-01-25T03:58:16.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37191 req_id = bb6147ae-d7ff-4071-ba89-15cd913d4dff response_code = 200 uri = /vpc-routes
19912025-01-25T03:58:16.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
19922025-01-25T03:58:16.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37191 req_id = 65e6a2be-bcdb-450b-8a23-26d1bc6fcbcb response_code = 204 uri = /eip-gateways
19932025-01-25T03:58:16.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37191 req_id = c7e72bd7-3448-4422-941a-9a82031e4739 response_code = 204 uri = /vpc-routes
19942025-01-25T03:58:17.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34200
19952025-01-25T03:58:17.024ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19962025-01-25T03:58:17.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19972025-01-25T03:58:17.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104608 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34200 req_id = 5f15a4c3-35c4-4d68-8674-457b7573d487 response_code = 204 uri = /switch-ports
19982025-01-25T03:58:17.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53410
19992025-01-25T03:58:17.129ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20002025-01-25T03:58:17.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34200 req_id = 059ff0b6-80e9-4a48-8083-3765f2cfe613 response_code = 200 uri = /network-bootstore-config
20012025-01-25T03:58:17.129ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20022025-01-25T03:58:17.129ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20032025-01-25T03:58:17.129ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20042025-01-25T03:58:17.129ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20052025-01-25T03:58:17.129ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20062025-01-25T03:58:17.129ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20072025-01-25T03:58:17.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 597 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53410 req_id = 2378a0e7-914a-4317-af00-4dc8e1f07e04 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20082025-01-25T03:58:17.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34460
20092025-01-25T03:58:17.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34460 req_id = e56d219b-919e-465f-bc16-3434a788c91b response_code = 200 uri = /vpc-routes
20102025-01-25T03:58:17.445ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
20112025-01-25T03:58:17.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34460 req_id = a723b0a2-4347-428b-8db2-23f1a7224ac4 response_code = 204 uri = /eip-gateways
20122025-01-25T03:58:17.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52036
20132025-01-25T03:58:17.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52036 req_id = 819b1e9c-78e1-47c6-98b4-f4013fad9b14 response_code = 200 uri = /v2p
20142025-01-25T03:58:17.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62376
20152025-01-25T03:58:17.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62376 req_id = ebf9f108-75b4-4a29-9c79-92e98080470d response_code = 200 uri = /v2p
20162025-01-25T03:58:17.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34460 req_id = 925bb29f-caf0-4198-838c-f8e6ff83de1b response_code = 204 uri = /vpc-routes
20172025-01-25T03:58:17.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61293
20182025-01-25T03:58:17.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61293 req_id = 903f4717-0c0a-4bef-9fc3-e0702635fd54 response_code = 200 uri = /vpc-routes
20192025-01-25T03:58:17.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61856
20202025-01-25T03:58:17.757ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20212025-01-25T03:58:17.804ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20222025-01-25T03:58:17.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117741 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61856 req_id = 830368ec-ebaf-4dde-bddc-f184315ffa10 response_code = 204 uri = /switch-ports
20232025-01-25T03:58:17.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59801
20242025-01-25T03:58:17.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
20252025-01-25T03:58:17.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61293 req_id = 3e2a0f98-630b-4858-bcab-ca08f6e08b9b response_code = 204 uri = /eip-gateways
20262025-01-25T03:58:17.876ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20272025-01-25T03:58:17.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10869 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61856 req_id = fb673198-be7b-4b72-a8b7-5b810e2ad1e2 response_code = 200 uri = /network-bootstore-config
20282025-01-25T03:58:17.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 556 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61293 req_id = ac1be1b5-616c-4062-a0b0-491d892c234d response_code = 204 uri = /vpc-routes
20292025-01-25T03:58:17.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56320
20302025-01-25T03:58:17.897ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20312025-01-25T03:58:17.897ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20322025-01-25T03:58:17.897ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20332025-01-25T03:58:17.897ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20342025-01-25T03:58:17.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20352025-01-25T03:58:17.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20362025-01-25T03:58:17.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20372025-01-25T03:58:17.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56320 req_id = be736933-bd81-422d-aae7-fcf8a7a3ee88 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20382025-01-25T03:58:17.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20392025-01-25T03:58:17.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44016
20402025-01-25T03:58:17.944ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20412025-01-25T03:58:17.944ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20422025-01-25T03:58:17.944ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20432025-01-25T03:58:17.944ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20442025-01-25T03:58:17.944ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20452025-01-25T03:58:17.944ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20462025-01-25T03:58:17.944ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20472025-01-25T03:58:17.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 687 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44016 req_id = 0a82204b-24db-4985-8991-d0c6fa043ded response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20482025-01-25T03:58:17.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97369 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59801 req_id = af566cd1-7a55-4c10-a093-8e428b14bfba response_code = 204 uri = /switch-ports
20492025-01-25T03:58:17.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59801 req_id = ed71be1c-1437-41d5-afeb-cd4bc45d9cb6 response_code = 200 uri = /network-bootstore-config
20502025-01-25T03:58:31.086ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6814 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 1ee0ad15-1c72-418f-a90a-fd389845146c response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
20512025-01-25T03:58:31.751ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33703
20522025-01-25T03:58:31.751ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33703 req_id = 251476c5-9f2c-4356-987a-7b551b39c275 response_code = 200 uri = /baseboard
20532025-01-25T03:58:46.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55532
20542025-01-25T03:58:46.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55532 req_id = 975390f3-0301-4542-ba6e-dd30f6487c58 response_code = 200 uri = /vpc-routes
20552025-01-25T03:58:46.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
20562025-01-25T03:58:46.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55532 req_id = 59609243-bac0-469e-aa78-f71a7ec0cd44 response_code = 204 uri = /eip-gateways
20572025-01-25T03:58:46.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55532 req_id = 0562a359-4830-4daf-b3a1-7a052f1782a5 response_code = 204 uri = /vpc-routes
20582025-01-25T03:58:46.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50011
20592025-01-25T03:58:46.528ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20602025-01-25T03:58:46.568ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20612025-01-25T03:58:46.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96040 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50011 req_id = b9b3d7a5-62e5-498b-a47b-bcfad8264928 response_code = 204 uri = /switch-ports
20622025-01-25T03:58:46.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44626
20632025-01-25T03:58:46.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44626 req_id = e602f3b5-e306-4be6-a285-ca9bc06a3e6e response_code = 200 uri = /v2p
20642025-01-25T03:58:46.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50011 req_id = 320495fa-70c7-474b-b88b-2fae91602d92 response_code = 200 uri = /network-bootstore-config
20652025-01-25T03:58:47.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52664
20662025-01-25T03:58:47.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52664 req_id = 10d74a3a-eee9-42e2-9c08-78ead385b4d5 response_code = 200 uri = /vpc-routes
20672025-01-25T03:58:47.283ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
20682025-01-25T03:58:47.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52664 req_id = 65d1bf08-988a-4c3a-ab9e-8ecf803fc744 response_code = 204 uri = /eip-gateways
20692025-01-25T03:58:47.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52886
20702025-01-25T03:58:47.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52886 req_id = e1b0623d-a89b-4fe6-9047-9d959885a47e response_code = 200 uri = /v2p
20712025-01-25T03:58:47.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52664 req_id = b76ea732-3e5e-4afe-a676-7d02c4ea7b87 response_code = 204 uri = /vpc-routes
20722025-01-25T03:58:47.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56017
20732025-01-25T03:58:47.420ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20742025-01-25T03:58:47.463ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20752025-01-25T03:58:47.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111181 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56017 req_id = b2f01513-3477-442c-9053-2856d40dfc22 response_code = 204 uri = /switch-ports
20762025-01-25T03:58:47.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56017 req_id = ade4d74c-5ab7-49c3-a84c-61d4a441ca1b response_code = 200 uri = /network-bootstore-config
20772025-01-25T03:58:47.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43249
20782025-01-25T03:58:47.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43249 req_id = f7c02dd2-fa32-41a1-844a-074531920694 response_code = 200 uri = /v2p
20792025-01-25T03:58:47.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48276
20802025-01-25T03:58:47.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48276 req_id = 6f0ec43c-f5a9-4c9f-b178-7ad18a48ec3d response_code = 200 uri = /vpc-routes
20812025-01-25T03:58:47.596ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
20822025-01-25T03:58:47.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48276 req_id = d7ae4f79-331a-48e7-ad43-5911261b1d86 response_code = 204 uri = /eip-gateways
20832025-01-25T03:58:47.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36755
20842025-01-25T03:58:47.596ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20852025-01-25T03:58:47.635ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20862025-01-25T03:58:47.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36755 req_id = 43940d70-d6c4-4d96-9d50-1fe3e7858208 response_code = 204 uri = /switch-ports
20872025-01-25T03:58:47.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48276 req_id = 13fa38c2-7915-48b4-9915-afd8212e4be9 response_code = 204 uri = /vpc-routes
20882025-01-25T03:58:47.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36755 req_id = f5e05570-738e-413d-a434-c4779eb8bb27 response_code = 200 uri = /network-bootstore-config
20892025-01-25T03:59:01.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7058 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 96706d7f-1368-41bd-814b-91e8173d907f response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
20902025-01-25T03:59:01.784ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41996
20912025-01-25T03:59:01.784ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41996 req_id = e465755d-2c3d-4386-a537-80ae070a8a3e response_code = 200 uri = /baseboard
20922025-01-25T03:59:16.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47170
20932025-01-25T03:59:16.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47170 req_id = 73864a39-385b-493c-bcad-98f3855033d6 response_code = 200 uri = /vpc-routes
20942025-01-25T03:59:16.633ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
20952025-01-25T03:59:16.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47170 req_id = dd7bbd75-5e06-4b69-a95f-bcf0fadadeb7 response_code = 204 uri = /eip-gateways
20962025-01-25T03:59:16.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47170 req_id = 97910914-80a4-4b26-ab63-294e35098563 response_code = 204 uri = /vpc-routes
20972025-01-25T03:59:16.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51527
20982025-01-25T03:59:16.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51527 req_id = f9628179-bad4-4617-8f9c-704d0579d76f response_code = 200 uri = /v2p
20992025-01-25T03:59:16.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64742
21002025-01-25T03:59:16.955ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21012025-01-25T03:59:16.992ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21022025-01-25T03:59:17.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96261 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64742 req_id = 629b1c50-094e-49ca-b605-dced6f758779 response_code = 204 uri = /switch-ports
21032025-01-25T03:59:17.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64742 req_id = 0678a1cc-3392-4475-83f3-35af0b04c378 response_code = 200 uri = /network-bootstore-config
21042025-01-25T03:59:17.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50317
21052025-01-25T03:59:17.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50317 req_id = b8513324-010c-4f31-8eb5-95f8d08599dd response_code = 200 uri = /vpc-routes
21062025-01-25T03:59:17.426ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
21072025-01-25T03:59:17.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50317 req_id = a5052060-8e4c-425a-a057-643e90c25d16 response_code = 204 uri = /eip-gateways
21082025-01-25T03:59:17.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50317 req_id = a5fbd16e-2050-4e75-be17-e817e44fb1c7 response_code = 204 uri = /vpc-routes
21092025-01-25T03:59:17.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40530
21102025-01-25T03:59:17.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40530 req_id = 82343962-e4d7-4acc-b5bd-3d2a35ccd4f6 response_code = 200 uri = /vpc-routes
21112025-01-25T03:59:17.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52525
21122025-01-25T03:59:17.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52525 req_id = 15781a24-e97f-4f5b-b7f8-acaa3ce254c9 response_code = 200 uri = /v2p
21132025-01-25T03:59:17.531ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
21142025-01-25T03:59:17.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40530 req_id = b6ab4e71-6cad-4942-b6f8-f24bf3c78178 response_code = 204 uri = /eip-gateways
21152025-01-25T03:59:17.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40530 req_id = e889f84c-f5f8-4938-923f-0c3c2988136c response_code = 204 uri = /vpc-routes
21162025-01-25T03:59:17.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42850
21172025-01-25T03:59:17.593ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21182025-01-25T03:59:17.635ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21192025-01-25T03:59:17.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42850 req_id = 8ac80493-01f9-478e-9d40-39776fcda69b response_code = 204 uri = /switch-ports
21202025-01-25T03:59:17.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44230
21212025-01-25T03:59:17.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45066
21222025-01-25T03:59:17.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45066 req_id = 62eafe2f-e652-4a2d-8fc1-d5e23646c917 response_code = 200 uri = /v2p
21232025-01-25T03:59:17.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42850 req_id = bd2a8db6-ded1-4f74-bf3d-d6ada148c745 response_code = 200 uri = /network-bootstore-config
21242025-01-25T03:59:17.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21252025-01-25T03:59:17.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21262025-01-25T03:59:17.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44230 req_id = 57c09e13-2c22-4698-8a22-b5ab82bf79c6 response_code = 204 uri = /switch-ports
21272025-01-25T03:59:17.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44230 req_id = ceba1448-6f3a-41e4-b437-c36f5181c4c7 response_code = 200 uri = /network-bootstore-config
21282025-01-25T03:59:31.089ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10266 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 2c82b7b9-cfdd-416b-833f-2d21ff323de0 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
21292025-01-25T03:59:31.817ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65505
21302025-01-25T03:59:31.817ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65505 req_id = cc4bdd57-983e-47d2-8bca-2490df42e71c response_code = 200 uri = /baseboard
21312025-01-25T03:59:46.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39309
21322025-01-25T03:59:46.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39309 req_id = 01f79874-e836-4097-8ca0-4b72f68e3cca response_code = 200 uri = /vpc-routes
21332025-01-25T03:59:46.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
21342025-01-25T03:59:46.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39309 req_id = eb65f462-2dda-4bb1-950b-5350a1ba291a response_code = 204 uri = /eip-gateways
21352025-01-25T03:59:46.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39309 req_id = 60e2d610-eb66-48c0-8bfc-c061d94121eb response_code = 204 uri = /vpc-routes
21362025-01-25T03:59:46.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64723
21372025-01-25T03:59:46.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64723 req_id = 4e438cbe-0c8e-4753-923e-fd08aa82d9e3 response_code = 200 uri = /v2p
21382025-01-25T03:59:46.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43500
21392025-01-25T03:59:46.600ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21402025-01-25T03:59:46.637ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21412025-01-25T03:59:46.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43500 req_id = b2472089-2c1a-498e-a6c2-4b20b04f8965 response_code = 204 uri = /switch-ports
21422025-01-25T03:59:46.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43500 req_id = 3ad422a2-7906-4bae-be81-0e5746d2d907 response_code = 200 uri = /network-bootstore-config
21432025-01-25T03:59:47.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58544
21442025-01-25T03:59:47.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58544 req_id = f10802ca-120f-4948-b828-04a627ff07bf response_code = 200 uri = /vpc-routes
21452025-01-25T03:59:47.285ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
21462025-01-25T03:59:47.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58544 req_id = a5c41e7e-bf28-46f6-af90-d32f8e7e58ea response_code = 204 uri = /eip-gateways
21472025-01-25T03:59:47.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58544 req_id = 95053d14-2d76-4371-a79f-60e39bc3d761 response_code = 204 uri = /vpc-routes
21482025-01-25T03:59:47.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42394
21492025-01-25T03:59:47.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42394 req_id = 2e647d3a-3a63-4f5b-8286-bf8ce17e7f20 response_code = 200 uri = /v2p
21502025-01-25T03:59:47.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39335
21512025-01-25T03:59:47.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39335 req_id = 5a8bc328-e96c-4464-8139-e6642650ed07 response_code = 200 uri = /vpc-routes
21522025-01-25T03:59:47.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
21532025-01-25T03:59:47.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39335 req_id = 8dc1b43f-4637-4dcc-9306-2be2aded9a97 response_code = 204 uri = /eip-gateways
21542025-01-25T03:59:47.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39335 req_id = 00f32c0e-7386-4a5b-9b2c-7875385a93e3 response_code = 204 uri = /vpc-routes
21552025-01-25T03:59:47.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52489
21562025-01-25T03:59:47.452ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21572025-01-25T03:59:47.494ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21582025-01-25T03:59:47.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52489 req_id = 4e68653c-48a0-4947-a42b-7354616e5b7d response_code = 204 uri = /switch-ports
21592025-01-25T03:59:47.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58535
21602025-01-25T03:59:47.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55969
21612025-01-25T03:59:47.555ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21622025-01-25T03:59:47.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3742 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58535 req_id = 64293946-6b8c-4710-a2ba-c9d9ad2778aa response_code = 200 uri = /v2p
21632025-01-25T03:59:47.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3727 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52489 req_id = 7ea6c636-e4cd-49eb-922b-99947ea7e23b response_code = 200 uri = /network-bootstore-config
21642025-01-25T03:59:47.592ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21652025-01-25T03:59:47.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91684 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55969 req_id = 71617177-595a-4cdf-8164-a807c8047032 response_code = 204 uri = /switch-ports
21662025-01-25T03:59:47.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55969 req_id = 79e84da1-84ac-4b5e-95a9-a1fbf94569ed response_code = 200 uri = /network-bootstore-config
21672025-01-25T04:00:01.088ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8856 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 71a6df55-4014-4899-8372-ed60f022ffd8 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
21682025-01-25T04:00:01.852ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59107
21692025-01-25T04:00:01.853ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59107 req_id = 60a06c43-31fa-4493-83bc-58c5d3ac92d9 response_code = 200 uri = /baseboard
21702025-01-25T04:00:16.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44665
21712025-01-25T04:00:16.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44665 req_id = 262239a5-6e67-41a5-a2f3-ab1549505ff3 response_code = 200 uri = /vpc-routes
21722025-01-25T04:00:16.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60843
21732025-01-25T04:00:16.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60843 req_id = c6946305-dc53-4366-8020-e71e784bf3ea response_code = 200 uri = /v2p
21742025-01-25T04:00:16.734ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
21752025-01-25T04:00:16.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44665 req_id = 66c5cd04-df37-47c5-82f7-3ab831ca4a3f response_code = 204 uri = /eip-gateways
21762025-01-25T04:00:16.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44665 req_id = ad6c5d4c-ce65-4302-b658-42ceda0bc360 response_code = 204 uri = /vpc-routes
21772025-01-25T04:00:16.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61165
21782025-01-25T04:00:16.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21792025-01-25T04:00:16.958ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21802025-01-25T04:00:17.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92697 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61165 req_id = ffe71e6d-2ff0-4701-b624-dbadcbfcf62a response_code = 204 uri = /switch-ports
21812025-01-25T04:00:17.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61165 req_id = 9860517e-9551-4965-b3f1-adf93cf11819 response_code = 200 uri = /network-bootstore-config
21822025-01-25T04:00:17.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54720
21832025-01-25T04:00:17.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54720 req_id = c5f9bf49-358a-45ea-a5d3-c6915514795c response_code = 200 uri = /vpc-routes
21842025-01-25T04:00:17.496ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
21852025-01-25T04:00:17.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54720 req_id = dd1e25c1-166b-446d-802c-7c057d5429b0 response_code = 204 uri = /eip-gateways
21862025-01-25T04:00:17.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54720 req_id = 45a70938-7f99-4fa1-858d-2bd36fffbf9b response_code = 204 uri = /vpc-routes
21872025-01-25T04:00:17.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54881
21882025-01-25T04:00:17.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54881 req_id = c943ca06-0cb8-4041-b9a0-c67fa1d14579 response_code = 200 uri = /v2p
21892025-01-25T04:00:17.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48658
21902025-01-25T04:00:17.675ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21912025-01-25T04:00:17.719ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21922025-01-25T04:00:17.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48658 req_id = c9d36b50-2871-4048-b138-488c70103726 response_code = 204 uri = /switch-ports
21932025-01-25T04:00:17.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43926
21942025-01-25T04:00:17.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34314
21952025-01-25T04:00:17.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59186
21962025-01-25T04:00:17.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48658 req_id = 406cf791-cc4c-4e87-b3ad-066e8bc15052 response_code = 200 uri = /network-bootstore-config
21972025-01-25T04:00:17.780ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21982025-01-25T04:00:17.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34314 req_id = 74bfd946-67e0-4ae3-887e-119e8761e11d response_code = 200 uri = /vpc-routes
21992025-01-25T04:00:17.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43926 req_id = 3a58d9c5-27da-4de2-8f26-1c0fda11e435 response_code = 200 uri = /v2p
22002025-01-25T04:00:17.818ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22012025-01-25T04:00:17.822ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
22022025-01-25T04:00:17.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34314 req_id = f8f4c6b5-73f9-4ed3-b0a9-9d7cb5199755 response_code = 204 uri = /eip-gateways
22032025-01-25T04:00:17.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 960 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34314 req_id = da3043be-2b15-41e7-83ff-42f41ae07b4b response_code = 204 uri = /vpc-routes
22042025-01-25T04:00:17.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95052 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59186 req_id = 73df865d-32df-4462-aa8c-d1f661d5b0e4 response_code = 204 uri = /switch-ports
22052025-01-25T04:00:17.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59186 req_id = f3225754-5eb9-4ae1-bb7b-680d0368e7d2 response_code = 200 uri = /network-bootstore-config
22062025-01-25T04:00:31.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8039 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = e17b81c8-faad-41b6-b845-cc6441bab5de response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
22072025-01-25T04:00:31.886ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45749
22082025-01-25T04:00:31.886ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45749 req_id = 53115e51-da1d-4ab8-ad63-009481f1e43c response_code = 200 uri = /baseboard
22092025-01-25T04:00:46.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54556
22102025-01-25T04:00:46.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54556 req_id = c8e3eaf7-2ebb-44bd-98ce-c4e8012bd1f4 response_code = 200 uri = /vpc-routes
22112025-01-25T04:00:46.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
22122025-01-25T04:00:46.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54556 req_id = 3216063e-f6ef-406d-88b0-58d598b2f14c response_code = 204 uri = /eip-gateways
22132025-01-25T04:00:46.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54556 req_id = 2a6ef9af-f8fb-4157-84ff-494ce9de2dbb response_code = 204 uri = /vpc-routes
22142025-01-25T04:00:46.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51405
22152025-01-25T04:00:46.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51405 req_id = 6d490cb7-e842-468b-b0c2-dc09877c9d82 response_code = 200 uri = /v2p
22162025-01-25T04:00:46.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37126
22172025-01-25T04:00:46.594ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22182025-01-25T04:00:46.633ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22192025-01-25T04:00:46.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37126 req_id = 42b66efa-d952-445d-85e2-6784a268bc50 response_code = 204 uri = /switch-ports
22202025-01-25T04:00:46.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37126 req_id = b4bbcc47-0087-44bd-adca-08ae44bc4fa2 response_code = 200 uri = /network-bootstore-config
22212025-01-25T04:00:47.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62146
22222025-01-25T04:00:47.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62146 req_id = b3543d24-c857-42f6-9f5d-9d0037fb9ecb response_code = 200 uri = /vpc-routes
22232025-01-25T04:00:47.243ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
22242025-01-25T04:00:47.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62146 req_id = 74758815-0119-43dd-acfc-5262e744fe13 response_code = 204 uri = /eip-gateways
22252025-01-25T04:00:47.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62146 req_id = f98e019d-bfb6-41b6-a987-b7a7d0c197f0 response_code = 204 uri = /vpc-routes
22262025-01-25T04:00:47.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58147
22272025-01-25T04:00:47.362ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22282025-01-25T04:00:47.401ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22292025-01-25T04:00:47.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101267 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58147 req_id = 4bb48811-1d8f-4beb-a862-1c9a23630d94 response_code = 204 uri = /switch-ports
22302025-01-25T04:00:47.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61932
22312025-01-25T04:00:47.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58147 req_id = 9ed30098-736a-4bd9-8236-b75282e64b99 response_code = 200 uri = /network-bootstore-config
22322025-01-25T04:00:47.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61932 req_id = 0c46c675-98cc-49eb-b879-935276d6ad7a response_code = 200 uri = /v2p
22332025-01-25T04:00:47.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54559
22342025-01-25T04:00:47.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54559 req_id = 01addffb-3371-4952-8037-0a6c8e991705 response_code = 200 uri = /vpc-routes
22352025-01-25T04:00:47.551ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
22362025-01-25T04:00:47.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54559 req_id = 135c34fb-05ba-4169-962f-6d9c0673027a response_code = 204 uri = /eip-gateways
22372025-01-25T04:00:47.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54559 req_id = bdb9cb4d-b5d0-40ab-b03a-d414b8e15b12 response_code = 204 uri = /vpc-routes
22382025-01-25T04:00:47.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33766
22392025-01-25T04:00:47.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33766 req_id = f36c1fa1-d142-4a42-a614-89fa5c6e935c response_code = 200 uri = /v2p
22402025-01-25T04:00:47.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60361
22412025-01-25T04:00:47.664ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22422025-01-25T04:00:47.702ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22432025-01-25T04:00:47.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94575 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60361 req_id = 4921f6af-5e62-4a2a-9551-f787d233febe response_code = 204 uri = /switch-ports
22442025-01-25T04:00:47.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60361 req_id = fd89e5b5-e637-47d9-ac76-d9c5d94abce2 response_code = 200 uri = /network-bootstore-config
22452025-01-25T04:01:01.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8172 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 2c942301-8aad-4915-a067-7cb36dccb300 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
22462025-01-25T04:01:01.920ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59538
22472025-01-25T04:01:01.920ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59538 req_id = c8ca5945-85dd-41d7-8f07-06ab37dc7247 response_code = 200 uri = /baseboard
22482025-01-25T04:01:06.231ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22492025-01-25T04:01:06.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22502025-01-25T04:01:06.260ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2010, tv_nsec: 260930709 } time_to_next_cleanup = 599.99999617s
22512025-01-25T04:01:16.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33098
22522025-01-25T04:01:16.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33098 req_id = 7ac140f2-aeba-4cd6-a30e-2246561b1610 response_code = 200 uri = /vpc-routes
22532025-01-25T04:01:16.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
22542025-01-25T04:01:16.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33098 req_id = aeca8c9d-aed1-4c30-be02-1278263e1945 response_code = 204 uri = /eip-gateways
22552025-01-25T04:01:16.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33098 req_id = 6b41169f-07bf-46b5-8a2e-f5f8abbb0f61 response_code = 204 uri = /vpc-routes
22562025-01-25T04:01:16.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49595
22572025-01-25T04:01:16.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49595 req_id = 85128bd1-c701-42a0-9a66-a6d3f572efdd response_code = 200 uri = /v2p
22582025-01-25T04:01:16.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46517
22592025-01-25T04:01:16.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22602025-01-25T04:01:16.787ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22612025-01-25T04:01:16.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99172 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46517 req_id = fd71cc70-d80a-4cf0-9b96-3815e89a2da8 response_code = 204 uri = /switch-ports
22622025-01-25T04:01:16.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46517 req_id = b7c80b0b-6daf-4b27-bf15-ab3565c661b3 response_code = 200 uri = /network-bootstore-config
22632025-01-25T04:01:17.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41297
22642025-01-25T04:01:17.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41297 req_id = 8e8339ba-a8a6-41bd-b398-33c669a64db4 response_code = 200 uri = /v2p
22652025-01-25T04:01:17.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62220
22662025-01-25T04:01:17.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62220 req_id = b1df3e40-ee3c-43f3-b856-793f50a29e39 response_code = 200 uri = /vpc-routes
22672025-01-25T04:01:17.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35360
22682025-01-25T04:01:17.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35360 req_id = 96bf61d8-b069-4fd1-a0b8-f9bc6f9a1bb6 response_code = 200 uri = /vpc-routes
22692025-01-25T04:01:17.589ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
22702025-01-25T04:01:17.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35360 req_id = 1dfd5742-7952-4794-a046-b406d6777382 response_code = 204 uri = /eip-gateways
22712025-01-25T04:01:17.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35360 req_id = 69bc4562-465e-48c6-9e51-f6765e8072c8 response_code = 204 uri = /vpc-routes
22722025-01-25T04:01:17.611ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
22732025-01-25T04:01:17.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62220 req_id = bb464a9b-29ae-430b-917c-11508d2a62b3 response_code = 204 uri = /eip-gateways
22742025-01-25T04:01:17.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62220 req_id = 7dbda04b-5a50-4280-b460-8d1c9831822c response_code = 204 uri = /vpc-routes
22752025-01-25T04:01:17.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58329
22762025-01-25T04:01:17.659ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22772025-01-25T04:01:17.700ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22782025-01-25T04:01:17.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99455 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58329 req_id = ad5bee03-3a79-4aa9-bd47-5501151227b4 response_code = 204 uri = /switch-ports
22792025-01-25T04:01:17.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58190
22802025-01-25T04:01:17.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58190 req_id = 8c9daf00-7cb7-480b-8419-8b9e428a7324 response_code = 200 uri = /v2p
22812025-01-25T04:01:17.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58329 req_id = b3ad3664-0662-4365-ae54-1d0400dbb948 response_code = 200 uri = /network-bootstore-config
22822025-01-25T04:01:17.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59677
22832025-01-25T04:01:17.878ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22842025-01-25T04:01:17.913ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22852025-01-25T04:01:17.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93268 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59677 req_id = 0c4f8f01-e446-42ec-967c-00cea74a4727 response_code = 204 uri = /switch-ports
22862025-01-25T04:01:17.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59677 req_id = 71a0e751-c2ab-4c56-bbce-fe8999935555 response_code = 200 uri = /network-bootstore-config
22872025-01-25T04:01:20.507ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22882025-01-25T04:01:31.086ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7953 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = a680a334-9a26-4580-bf26-990c04275244 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
22892025-01-25T04:01:31.953ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51200
22902025-01-25T04:01:31.953ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51200 req_id = 018fd9ca-3b51-47ff-9f35-ab696acf1859 response_code = 200 uri = /baseboard
22912025-01-25T04:01:46.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37754
22922025-01-25T04:01:46.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37754 req_id = f43f56b2-0e24-4659-8ae6-368bdc5d6bd5 response_code = 200 uri = /vpc-routes
22932025-01-25T04:01:46.500ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
22942025-01-25T04:01:46.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37754 req_id = 207906ed-3cd8-41d8-afeb-c71c3385d8cd response_code = 204 uri = /eip-gateways
22952025-01-25T04:01:46.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46647
22962025-01-25T04:01:46.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46647 req_id = f24cb2b6-4c3d-4203-8418-8095c99d1f51 response_code = 200 uri = /v2p
22972025-01-25T04:01:46.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37754 req_id = 9c5983f4-edef-4eda-bf87-eeacbf05fced response_code = 204 uri = /vpc-routes
22982025-01-25T04:01:46.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50604
22992025-01-25T04:01:46.612ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23002025-01-25T04:01:46.650ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23012025-01-25T04:01:46.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93022 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50604 req_id = 26f5a70f-90b7-4acd-97d0-81a64eec68da response_code = 204 uri = /switch-ports
23022025-01-25T04:01:46.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50604 req_id = b926520a-8af4-4937-9bba-0d57746d8017 response_code = 200 uri = /network-bootstore-config
23032025-01-25T04:01:47.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33653
23042025-01-25T04:01:47.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33653 req_id = 1e7efa73-7f6a-4f70-844c-3eb4527f4e06 response_code = 200 uri = /vpc-routes
23052025-01-25T04:01:47.334ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
23062025-01-25T04:01:47.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33653 req_id = 65445c7c-ae51-4291-adef-a063954c8f78 response_code = 204 uri = /eip-gateways
23072025-01-25T04:01:47.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33653 req_id = 4070a4a7-da91-42a4-b3cd-25deb98a2c7e response_code = 204 uri = /vpc-routes
23082025-01-25T04:01:47.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50112
23092025-01-25T04:01:47.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50112 req_id = cab4fc50-a52d-4fd8-bffe-bf0dd575a2d0 response_code = 200 uri = /v2p
23102025-01-25T04:01:47.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39585
23112025-01-25T04:01:47.438ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23122025-01-25T04:01:47.482ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23132025-01-25T04:01:47.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106674 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39585 req_id = 2ec4abf9-1208-4675-9f08-c5a80b9f6274 response_code = 204 uri = /switch-ports
23142025-01-25T04:01:47.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52375
23152025-01-25T04:01:47.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33149
23162025-01-25T04:01:47.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52375 req_id = 220bd201-42eb-4b55-a318-1e57053b7e92 response_code = 200 uri = /vpc-routes
23172025-01-25T04:01:47.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39585 req_id = 4c93ba30-7ff0-4885-a89e-424379c55972 response_code = 200 uri = /network-bootstore-config
23182025-01-25T04:01:47.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33149 req_id = 75ee28ce-8e1d-43b3-8938-d8e1e6f47850 response_code = 200 uri = /v2p
23192025-01-25T04:01:47.559ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
23202025-01-25T04:01:47.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52375 req_id = 5f2a0c1d-8b02-4d74-b659-192ce8c1980e response_code = 204 uri = /eip-gateways
23212025-01-25T04:01:47.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52375 req_id = 5da01745-5701-48e6-8702-d84308056447 response_code = 204 uri = /vpc-routes
23222025-01-25T04:01:47.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38905
23232025-01-25T04:01:47.616ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23242025-01-25T04:01:47.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23252025-01-25T04:01:47.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38905 req_id = 2784377c-55cd-44a3-afb0-bd005fc598a2 response_code = 204 uri = /switch-ports
23262025-01-25T04:01:47.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38905 req_id = d19ba1e7-0d15-4ddf-ac6a-94463aedcf72 response_code = 200 uri = /network-bootstore-config
23272025-01-25T04:02:01.086ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7546 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = cd66903c-4810-4e5a-a5f8-25b439b3630e response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
23282025-01-25T04:02:01.987ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47065
23292025-01-25T04:02:01.987ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47065 req_id = 3688dad8-9f78-4a3f-b3c1-bf4825a0c02f response_code = 200 uri = /baseboard
23302025-01-25T04:02:16.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36716
23312025-01-25T04:02:16.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36716 req_id = 9a66f7ab-016e-4706-b79e-f2690e68bc06 response_code = 200 uri = /vpc-routes
23322025-01-25T04:02:16.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35944
23332025-01-25T04:02:16.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35944 req_id = fdca2d87-c08a-4623-b58c-4bfbca7658eb response_code = 200 uri = /v2p
23342025-01-25T04:02:16.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
23352025-01-25T04:02:16.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36716 req_id = c9df9e64-44d6-4045-9ad7-d9e738985f5d response_code = 204 uri = /eip-gateways
23362025-01-25T04:02:16.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36716 req_id = 6a8f5add-25b4-426c-874a-cf64702eb1c5 response_code = 204 uri = /vpc-routes
23372025-01-25T04:02:16.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61895
23382025-01-25T04:02:16.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23392025-01-25T04:02:16.855ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23402025-01-25T04:02:16.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61895 req_id = 83eb32e6-48ab-4a98-9c30-90ce5dd65229 response_code = 204 uri = /switch-ports
23412025-01-25T04:02:16.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61895 req_id = 9b310f84-620f-4de2-bee2-de140253edbe response_code = 200 uri = /network-bootstore-config
23422025-01-25T04:02:17.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53441
23432025-01-25T04:02:17.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53441 req_id = d1585e7b-0cf1-41f8-84e8-bec8e701e7e7 response_code = 200 uri = /vpc-routes
23442025-01-25T04:02:17.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
23452025-01-25T04:02:17.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53441 req_id = 5fe14099-f18a-4080-8f3e-9c8693babb5a response_code = 204 uri = /eip-gateways
23462025-01-25T04:02:17.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53441 req_id = 91ea0e7a-5144-4f56-b46b-0809eb33bec5 response_code = 204 uri = /vpc-routes
23472025-01-25T04:02:17.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38232
23482025-01-25T04:02:17.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38232 req_id = e16d062c-058d-4db9-9544-677cc05103a9 response_code = 200 uri = /v2p
23492025-01-25T04:02:17.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57936
23502025-01-25T04:02:17.613ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23512025-01-25T04:02:17.654ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23522025-01-25T04:02:17.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95733 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57936 req_id = ab6846e2-6db9-4de6-a371-f4224d0cafd5 response_code = 204 uri = /switch-ports
23532025-01-25T04:02:17.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45263
23542025-01-25T04:02:17.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57936 req_id = 8c4f6e27-1e6e-4ec4-9027-ceec48ad3ce3 response_code = 200 uri = /network-bootstore-config
23552025-01-25T04:02:17.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45263 req_id = 9af7270e-7b20-49f5-8ee5-37a722a46b5e response_code = 200 uri = /v2p
23562025-01-25T04:02:17.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33578
23572025-01-25T04:02:17.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33578 req_id = 12e3f532-db28-4344-933d-27a5946fafaf response_code = 200 uri = /vpc-routes
23582025-01-25T04:02:17.766ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
23592025-01-25T04:02:17.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33578 req_id = 240ba940-7feb-4577-a756-fb8925168efe response_code = 204 uri = /eip-gateways
23602025-01-25T04:02:17.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33578 req_id = 409518c8-5144-424c-b5f6-f2fd6b93fc94 response_code = 204 uri = /vpc-routes
23612025-01-25T04:02:17.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57134
23622025-01-25T04:02:17.821ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23632025-01-25T04:02:17.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23642025-01-25T04:02:17.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89805 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57134 req_id = 8aa2e3ad-7917-4195-9598-7195cbf96731 response_code = 204 uri = /switch-ports
23652025-01-25T04:02:17.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57134 req_id = 0fbee7d8-db3d-49df-93a2-6a320ab82f5e response_code = 200 uri = /network-bootstore-config
23662025-01-25T04:02:31.086ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7977 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = d63d4872-9879-4784-b640-b288347c593f response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
23672025-01-25T04:02:32.020ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41362
23682025-01-25T04:02:32.020ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41362 req_id = e44093ec-aa8a-42bd-862a-f02ad97a96e4 response_code = 200 uri = /baseboard
23692025-01-25T04:02:46.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33230
23702025-01-25T04:02:46.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33230 req_id = c39fc0db-9522-4dd8-b2c4-2a706f2f46fa response_code = 200 uri = /vpc-routes
23712025-01-25T04:02:46.490ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
23722025-01-25T04:02:46.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33230 req_id = 30c586af-e8d1-419d-817f-ce384f51c220 response_code = 204 uri = /eip-gateways
23732025-01-25T04:02:46.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33230 req_id = 4b412604-09fc-4db3-a57e-d5f115cb4cb2 response_code = 204 uri = /vpc-routes
23742025-01-25T04:02:46.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64249
23752025-01-25T04:02:46.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64249 req_id = 94ee181d-11e3-40ab-bf6b-692731351f29 response_code = 200 uri = /v2p
23762025-01-25T04:02:46.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41199
23772025-01-25T04:02:46.563ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23782025-01-25T04:02:46.622ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23792025-01-25T04:02:46.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116515 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41199 req_id = cd295aea-d89b-41e5-be80-546a0af5ca53 response_code = 204 uri = /switch-ports
23802025-01-25T04:02:46.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41199 req_id = d599d878-9701-4a13-9d24-115df246ac13 response_code = 200 uri = /network-bootstore-config
23812025-01-25T04:02:47.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52442
23822025-01-25T04:02:47.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52442 req_id = 83721567-ad8d-479f-b77a-94ff26e05851 response_code = 200 uri = /vpc-routes
23832025-01-25T04:02:47.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
23842025-01-25T04:02:47.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52442 req_id = 33ee33a0-1ded-43b6-98ca-af357bc51283 response_code = 204 uri = /eip-gateways
23852025-01-25T04:02:47.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52442 req_id = b7903f09-84a1-48a1-911c-8bd435362ea0 response_code = 204 uri = /vpc-routes
23862025-01-25T04:02:47.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53065
23872025-01-25T04:02:47.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53065 req_id = 3930b7d6-c046-4eac-9190-a25bf98514e1 response_code = 200 uri = /vpc-routes
23882025-01-25T04:02:47.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62535
23892025-01-25T04:02:47.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62535 req_id = 7d12042d-6563-47ef-af0c-fc96587b56cb response_code = 200 uri = /v2p
23902025-01-25T04:02:47.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
23912025-01-25T04:02:47.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53065 req_id = 46f84568-7aeb-4bb2-96c2-3fd99a3209d1 response_code = 204 uri = /eip-gateways
23922025-01-25T04:02:47.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34717
23932025-01-25T04:02:47.497ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23942025-01-25T04:02:47.537ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23952025-01-25T04:02:47.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97844 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34717 req_id = c19ef839-4d0f-4199-97c4-c4d627c03370 response_code = 204 uri = /switch-ports
23962025-01-25T04:02:47.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53799
23972025-01-25T04:02:47.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40086
23982025-01-25T04:02:47.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34717 req_id = 1b2f05ff-3b99-401d-8e19-ce6e2829a7ec response_code = 200 uri = /network-bootstore-config
23992025-01-25T04:02:47.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53065 req_id = 497630fe-d3c9-4ca2-871c-e445cee06e1d response_code = 204 uri = /vpc-routes
24002025-01-25T04:02:47.596ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24012025-01-25T04:02:47.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53799 req_id = 48703b01-2ebf-4236-9d0d-38191c09b8a2 response_code = 200 uri = /v2p
24022025-01-25T04:02:47.633ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24032025-01-25T04:02:47.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40086 req_id = dc68ccaa-9652-42c6-a23e-49e63538a12d response_code = 204 uri = /switch-ports
24042025-01-25T04:02:47.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40086 req_id = 9ccf49c6-c8ab-437e-9b30-ef4558d64e66 response_code = 200 uri = /network-bootstore-config
24052025-01-25T04:03:01.086ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7694 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 09f1ae2e-f003-4045-bc6f-680c865993f1 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
24062025-01-25T04:03:02.053ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52362
24072025-01-25T04:03:02.053ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52362 req_id = 4b338d73-fcf4-4d6b-b000-827ed83b034a response_code = 200 uri = /baseboard
24082025-01-25T04:03:16.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34275
24092025-01-25T04:03:16.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34275 req_id = f640999f-d90f-4c58-90f1-8fad88e4e922 response_code = 200 uri = /vpc-routes
24102025-01-25T04:03:16.564ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
24112025-01-25T04:03:16.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34275 req_id = 8dd77737-cd29-4750-a1c3-8bb6b38f6f7f response_code = 204 uri = /eip-gateways
24122025-01-25T04:03:16.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34275 req_id = fc970364-7d23-4b24-b350-1050f79ab399 response_code = 204 uri = /vpc-routes
24132025-01-25T04:03:16.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48911
24142025-01-25T04:03:16.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48911 req_id = fc8b286c-5708-4a4d-a8a7-58060ef8ed82 response_code = 200 uri = /v2p
24152025-01-25T04:03:16.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49205
24162025-01-25T04:03:16.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24172025-01-25T04:03:16.808ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24182025-01-25T04:03:16.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99146 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49205 req_id = 268938ad-5699-4c59-bb6d-3d165d9df677 response_code = 204 uri = /switch-ports
24192025-01-25T04:03:16.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33539
24202025-01-25T04:03:16.867ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24212025-01-25T04:03:16.867ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24222025-01-25T04:03:16.867ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:177
24232025-01-25T04:03:16.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49205 req_id = 8c25c7ba-0fbc-47ce-b923-4e3495002573 response_code = 200 uri = /network-bootstore-config
24242025-01-25T04:03:16.869ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:177
24252025-01-25T04:03:16.881ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24262025-01-25T04:03:16.881ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28
24272025-01-25T04:03:16.906ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24282025-01-25T04:03:16.906ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b
24292025-01-25T04:03:16.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43600
24302025-01-25T04:03:16.912ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24312025-01-25T04:03:16.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24322025-01-25T04:03:16.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24332025-01-25T04:03:16.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24342025-01-25T04:03:16.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24352025-01-25T04:03:16.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24362025-01-25T04:03:16.912ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24372025-01-25T04:03:16.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43600 req_id = e01cf6d9-21e4-4bf5-88df-ba778abddf96 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24382025-01-25T04:03:16.929ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24392025-01-25T04:03:16.929ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a
24402025-01-25T04:03:16.950ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24412025-01-25T04:03:16.950ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44c151b9-2034-4667-9c87-189bf684b2e4
24422025-01-25T04:03:16.971ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24432025-01-25T04:03:16.971ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c
24442025-01-25T04:03:16.991ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24452025-01-25T04:03:16.991ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97661079-bff0-45d9-bae2-2b9215898f21
24462025-01-25T04:03:17.014ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24472025-01-25T04:03:17.015ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3
24482025-01-25T04:03:17.038ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24492025-01-25T04:03:17.038ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f
24502025-01-25T04:03:17.058ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24512025-01-25T04:03:17.058ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30589e38-7481-4de9-b63b-77c66cbf4a51
24522025-01-25T04:03:17.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33539 req_id = 7ee356e7-20e9-4025-8a61-ca21b7a627cc response_code = 200 uri = /inventory
24532025-01-25T04:03:17.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54561
24542025-01-25T04:03:17.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54561 req_id = 84d45cae-5483-4684-abba-3da98d8387c9 response_code = 200 uri = /vpc-routes
24552025-01-25T04:03:17.477ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
24562025-01-25T04:03:17.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54561 req_id = df8a4539-211c-4c22-a925-9ac3d6e5f435 response_code = 204 uri = /eip-gateways
24572025-01-25T04:03:17.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54561 req_id = ce9acb28-e782-403d-ad7d-5b1cec70a7d1 response_code = 204 uri = /vpc-routes
24582025-01-25T04:03:17.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64255
24592025-01-25T04:03:17.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64255 req_id = 6bdb806f-f0a9-4cbe-b706-6d99d5927d3f response_code = 200 uri = /v2p
24602025-01-25T04:03:17.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61688
24612025-01-25T04:03:17.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61688 req_id = 9f9f3035-2844-4500-ae03-736388718f0e response_code = 200 uri = /vpc-routes
24622025-01-25T04:03:17.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65499
24632025-01-25T04:03:17.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24642025-01-25T04:03:17.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24652025-01-25T04:03:17.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65499 req_id = 597088fe-4d11-4499-938f-4bc248adcf6a response_code = 204 uri = /switch-ports
24662025-01-25T04:03:17.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53712
24672025-01-25T04:03:17.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65477
24682025-01-25T04:03:17.778ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
24692025-01-25T04:03:17.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61688 req_id = 3b740496-84b8-4e94-9077-27eed43bd392 response_code = 204 uri = /eip-gateways
24702025-01-25T04:03:17.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65499 req_id = b9d99e83-f46b-4b21-82e5-fbe36bdc39d0 response_code = 200 uri = /network-bootstore-config
24712025-01-25T04:03:17.779ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24722025-01-25T04:03:17.779ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24732025-01-25T04:03:17.779ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24742025-01-25T04:03:17.779ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:177
24752025-01-25T04:03:17.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24762025-01-25T04:03:17.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24772025-01-25T04:03:17.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24782025-01-25T04:03:17.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24792025-01-25T04:03:17.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24802025-01-25T04:03:17.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24812025-01-25T04:03:17.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 515 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53712 req_id = a6d832bc-e17e-44e5-8ae0-be244e8d25e9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24822025-01-25T04:03:17.779ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:177
24832025-01-25T04:03:17.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46652
24842025-01-25T04:03:17.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46652 req_id = ba746cb6-c0b4-49c2-b9b3-f0ad7da1f4a0 response_code = 200 uri = /v2p
24852025-01-25T04:03:17.791ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24862025-01-25T04:03:17.791ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28
24872025-01-25T04:03:17.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61688 req_id = 2ed9b492-b63b-44c2-81f1-de46f91a421e response_code = 204 uri = /vpc-routes
24882025-01-25T04:03:17.818ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24892025-01-25T04:03:17.818ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b
24902025-01-25T04:03:17.842ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24912025-01-25T04:03:17.842ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a
24922025-01-25T04:03:17.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61052
24932025-01-25T04:03:17.849ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24942025-01-25T04:03:17.869ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24952025-01-25T04:03:17.869ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44c151b9-2034-4667-9c87-189bf684b2e4
24962025-01-25T04:03:17.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48902
24972025-01-25T04:03:17.886ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24982025-01-25T04:03:17.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62626
24992025-01-25T04:03:17.892ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25002025-01-25T04:03:17.892ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25012025-01-25T04:03:17.892ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/config/omicron-zones.json file = common/src/ledger.rs:177
25022025-01-25T04:03:17.892ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0dfad96-f6c6-4d8a-973f-27610028e1d0, kind: Service { id: e4cd66b4-cb17-454c-b8bf-90f6a89de174 }, name: Name("external-dns-e4cd66b4-cb17-454c-b8bf-90f6a89de174"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6ec643e-5c5c-427c-b2aa-5379bc0f89b8, kind: Service { id: 230575c1-07af-4e77-84ad-e3ba8a025d48 }, name: Name("external-dns-230575c1-07af-4e77-84ad-e3ba8a025d48"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 093a4a66-ed5a-44c5-a533-d933fda515d8, kind: Service { id: ee278ef4-1df8-47ae-898b-db2cb3a3b53b }, name: Name("nexus-ee278ef4-1df8-47ae-898b-db2cb3a3b53b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 198])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60667c3c-258d-49ec-bf38-933bd1178ccc, kind: Service { id: a5c2122d-6963-455b-b2f6-a7943d001ec7 }, name: Name("nexus-a5c2122d-6963-455b-b2f6-a7943d001ec7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 160])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cbce006b-bd81-4ae1-afe6-c1fd6f1f34b7, kind: Service { id: 06a029c2-9185-403a-918b-57bcd0084263 }, name: Name("nexus-06a029c2-9185-403a-918b-57bcd0084263"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 158])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25032025-01-25T04:03:17.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25042025-01-25T04:03:17.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25052025-01-25T04:03:17.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25062025-01-25T04:03:17.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25072025-01-25T04:03:17.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25082025-01-25T04:03:17.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25092025-01-25T04:03:17.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 756 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62626 req_id = 7bbb92a0-28c2-444e-a832-20a9903de69d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25102025-01-25T04:03:17.892ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/config/omicron-zones.json file = common/src/ledger.rs:177
25112025-01-25T04:03:17.896ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25122025-01-25T04:03:17.897ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c
25132025-01-25T04:03:17.911ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 066cb075-3ce4-42e3-8879-3ad7d6a5cc28 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25142025-01-25T04:03:17.911ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_066cb075-3ce4-42e3-8879-3ad7d6a5cc28
25152025-01-25T04:03:17.936ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed06efc8-6c57-4076-806f-3a742bb46e6b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25162025-01-25T04:03:17.936ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed06efc8-6c57-4076-806f-3a742bb46e6b
25172025-01-25T04:03:17.949ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25182025-01-25T04:03:17.949ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97661079-bff0-45d9-bae2-2b9215898f21
25192025-01-25T04:03:17.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61052 req_id = 5f81ae94-b3e1-494d-87c3-36c9a1ef8019 response_code = 204 uri = /switch-ports
25202025-01-25T04:03:17.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61052 req_id = 4b175853-8559-47dd-be05-f8b92244dd3a response_code = 200 uri = /network-bootstore-config
25212025-01-25T04:03:17.967ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a23e7ed6-7d83-458b-8c71-7390568d1c9a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25222025-01-25T04:03:17.967ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a23e7ed6-7d83-458b-8c71-7390568d1c9a
25232025-01-25T04:03:17.984ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25242025-01-25T04:03:17.984ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3
25252025-01-25T04:03:18.010ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25262025-01-25T04:03:18.010ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f
25272025-01-25T04:03:18.021ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 44c151b9-2034-4667-9c87-189bf684b2e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25282025-01-25T04:03:18.021ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_44c151b9-2034-4667-9c87-189bf684b2e4
25292025-01-25T04:03:18.035ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25302025-01-25T04:03:18.035ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30589e38-7481-4de9-b63b-77c66cbf4a51
25312025-01-25T04:03:18.051ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 222406a2-a5b7-4a99-b6de-a4467bfdbe5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25322025-01-25T04:03:18.051ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_222406a2-a5b7-4a99-b6de-a4467bfdbe5c
25332025-01-25T04:03:18.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 277614 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65477 req_id = c1852ef0-b530-4b05-8037-c136fa8f491b response_code = 200 uri = /inventory
25342025-01-25T04:03:18.074ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 97661079-bff0-45d9-bae2-2b9215898f21 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25352025-01-25T04:03:18.074ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_97661079-bff0-45d9-bae2-2b9215898f21
25362025-01-25T04:03:18.097ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ea12aaae-9944-46a8-baba-6b89a1925bc3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25372025-01-25T04:03:18.097ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ea12aaae-9944-46a8-baba-6b89a1925bc3
25382025-01-25T04:03:18.123ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35b7f17f-2139-4f31-b2d5-c4c76891288f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25392025-01-25T04:03:18.123ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_35b7f17f-2139-4f31-b2d5-c4c76891288f
25402025-01-25T04:03:18.147ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30589e38-7481-4de9-b63b-77c66cbf4a51 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25412025-01-25T04:03:18.147ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30589e38-7481-4de9-b63b-77c66cbf4a51
25422025-01-25T04:03:18.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 268756 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48902 req_id = 553e3ac5-fa81-4dde-a86c-385f6079571d response_code = 200 uri = /inventory
25432025-01-25T04:03:31.085ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8010 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 4c1efba6-228c-4189-9524-88b2a2c7d376 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
25442025-01-25T04:03:32.087ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60411
25452025-01-25T04:03:32.087ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60411 req_id = 01193ebe-b28d-497b-af56-68828594cf69 response_code = 200 uri = /baseboard
25462025-01-25T04:03:46.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47994
25472025-01-25T04:03:46.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47994 req_id = b2fb6a6e-3286-403c-94a5-5c4cbbfbd274 response_code = 200 uri = /vpc-routes
25482025-01-25T04:03:46.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
25492025-01-25T04:03:46.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47994 req_id = 5cdb7f9c-4845-4e99-a34d-4298c8cde289 response_code = 204 uri = /eip-gateways
25502025-01-25T04:03:46.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47994 req_id = ad424177-2b20-44e9-8bc8-ccd59f5e7f2b response_code = 204 uri = /vpc-routes
25512025-01-25T04:03:46.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46268
25522025-01-25T04:03:46.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46268 req_id = 61d5b252-2d73-460e-9f43-f83bcab7ffc8 response_code = 200 uri = /v2p
25532025-01-25T04:03:46.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45638
25542025-01-25T04:03:46.574ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25552025-01-25T04:03:46.613ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25562025-01-25T04:03:46.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97816 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45638 req_id = 8ae25024-473a-4bfc-ac9a-c6481c513188 response_code = 204 uri = /switch-ports
25572025-01-25T04:03:46.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45638 req_id = 40fe92d1-c6bd-4764-a66a-fd7db2461c4a response_code = 200 uri = /network-bootstore-config
25582025-01-25T04:03:47.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37512
25592025-01-25T04:03:47.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37512 req_id = 5a53bc58-591f-44c9-8c97-7eef2b1bbea9 response_code = 200 uri = /vpc-routes
25602025-01-25T04:03:47.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35789
25612025-01-25T04:03:47.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25622025-01-25T04:03:47.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25632025-01-25T04:03:47.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119516 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35789 req_id = 202529b9-2b7a-46ef-b1b1-4829debcc8ec response_code = 204 uri = /switch-ports
25642025-01-25T04:03:47.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38273
25652025-01-25T04:03:47.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53657
25662025-01-25T04:03:47.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
25672025-01-25T04:03:47.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37512 req_id = bc0d8a45-1f1a-4dc8-addd-6b6a43efd817 response_code = 204 uri = /eip-gateways
25682025-01-25T04:03:47.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35789 req_id = 711e1fd5-c849-440b-9355-5a1e784e1955 response_code = 200 uri = /network-bootstore-config
25692025-01-25T04:03:47.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38273 req_id = a0aeefb7-a721-4549-8194-021c0729b3f4 response_code = 200 uri = /vpc-routes
25702025-01-25T04:03:47.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53657 req_id = 66d9361c-07ba-4a75-80fd-6ab52732a031 response_code = 200 uri = /v2p
25712025-01-25T04:03:47.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37512 req_id = 4a85c000-c99e-4e10-b0b3-c2087002c3d5 response_code = 204 uri = /vpc-routes
25722025-01-25T04:03:47.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
25732025-01-25T04:03:47.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38273 req_id = 5d36dd4f-07b1-4de2-b12b-0927d2548b0e response_code = 204 uri = /eip-gateways
25742025-01-25T04:03:47.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38273 req_id = 6ffc13b8-3bf0-4ea9-829e-97877db0c0eb response_code = 204 uri = /vpc-routes
25752025-01-25T04:03:47.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37707
25762025-01-25T04:03:47.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37707 req_id = 765d04df-2bf9-4618-ab81-3dd6ebed7e99 response_code = 200 uri = /v2p
25772025-01-25T04:03:47.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56399
25782025-01-25T04:03:47.539ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25792025-01-25T04:03:47.576ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25802025-01-25T04:03:47.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88419 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56399 req_id = b24021f1-21ae-48f9-b176-9ce3e1cf840c response_code = 204 uri = /switch-ports
25812025-01-25T04:03:47.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56399 req_id = 6938a0a6-bb2a-4653-bafe-4819c28162ae response_code = 200 uri = /network-bootstore-config
25822025-01-25T04:04:01.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7552 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = 4cfd9d3f-0102-4f76-848b-e819975e178e response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
25832025-01-25T04:04:02.120ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45712
25842025-01-25T04:04:02.121ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45712 req_id = b97a1aa3-0e25-402a-93e1-7f6c2a66df4d response_code = 200 uri = /baseboard
25852025-01-25T04:04:16.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36778
25862025-01-25T04:04:16.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36778 req_id = fa8058e3-a871-4159-a488-f1754395336a response_code = 200 uri = /vpc-routes
25872025-01-25T04:04:16.619ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
25882025-01-25T04:04:16.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36778 req_id = bec76acd-4143-41e4-b062-2e7f37bdcb90 response_code = 204 uri = /eip-gateways
25892025-01-25T04:04:16.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38888
25902025-01-25T04:04:16.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38888 req_id = 243dc82d-6e12-4c3e-b8d5-a82d107261cf response_code = 200 uri = /v2p
25912025-01-25T04:04:16.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36778 req_id = 6f3cc145-661b-4947-a04c-0bd771948a33 response_code = 204 uri = /vpc-routes
25922025-01-25T04:04:16.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47553
25932025-01-25T04:04:16.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25942025-01-25T04:04:16.852ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25952025-01-25T04:04:16.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90395 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47553 req_id = 5b8ef96f-eb0b-4497-972a-9b19f0169858 response_code = 204 uri = /switch-ports
25962025-01-25T04:04:16.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47553 req_id = e1e31756-19ab-469b-bc50-dd8ca2be418b response_code = 200 uri = /network-bootstore-config
25972025-01-25T04:04:17.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45960
25982025-01-25T04:04:17.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45960 req_id = e96ffd69-b798-4815-baec-f7795d6282db response_code = 200 uri = /vpc-routes
25992025-01-25T04:04:17.439ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
26002025-01-25T04:04:17.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45960 req_id = c11022e6-6733-46f8-a764-46e8dcf8fc50 response_code = 204 uri = /eip-gateways
26012025-01-25T04:04:17.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45960 req_id = 1dbfa784-adaf-4cde-99c3-0969a157862e response_code = 204 uri = /vpc-routes
26022025-01-25T04:04:17.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32889
26032025-01-25T04:04:17.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32889 req_id = cd9da679-b96a-4f7e-bfdd-936f4d262366 response_code = 200 uri = /v2p
26042025-01-25T04:04:17.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46390
26052025-01-25T04:04:17.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 21 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46390 req_id = ebc9ceb0-8e83-4f79-a756-1bcf6640f2fe response_code = 200 uri = /vpc-routes
26062025-01-25T04:04:17.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34265
26072025-01-25T04:04:17.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26082025-01-25T04:04:17.654ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26092025-01-25T04:04:17.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97159 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34265 req_id = f5b05625-179e-45dd-a2b0-04cde903c218 response_code = 204 uri = /switch-ports
26102025-01-25T04:04:17.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60853
26112025-01-25T04:04:17.712ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
26122025-01-25T04:04:17.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46390 req_id = dd677b2f-7b30-404f-8c7d-d7499b01051d response_code = 204 uri = /eip-gateways
26132025-01-25T04:04:17.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34265 req_id = 318f776f-978a-4571-9aaf-f96cce2f1411 response_code = 200 uri = /network-bootstore-config
26142025-01-25T04:04:17.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60853 req_id = 2a3da947-7e88-4337-a6af-e7efd7022713 response_code = 200 uri = /v2p
26152025-01-25T04:04:17.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46390 req_id = 0fd4bd6b-d024-47b0-ac06-88b04de4cfa7 response_code = 204 uri = /vpc-routes
26162025-01-25T04:04:17.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52069
26172025-01-25T04:04:17.753ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26182025-01-25T04:04:17.791ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26192025-01-25T04:04:17.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92519 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52069 req_id = 0b5b00b9-d0f0-42a5-8470-169d2f849d2d response_code = 204 uri = /switch-ports
26202025-01-25T04:04:17.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52069 req_id = 4d3f6e43-4d0c-47c3-a04e-d4bedb37b639 response_code = 200 uri = /network-bootstore-config
26212025-01-25T04:04:31.085ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6515 local_addr = [fd00:1122:3344:101::1]:57087 method = GET remote_addr = [fd00:1122:3344:101::d]:58859 req_id = e30e533c-2917-451b-af27-217b23889927 response_code = 200 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a uri = /7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
26222025-01-25T04:04:32.155ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63404
26232025-01-25T04:04:32.155ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63404 req_id = bf7db73a-f617-43e7-b0c8-27440388b996 response_code = 200 uri = /baseboard
26242025-01-25T04:04:36.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52118
26252025-01-25T04:04:36.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52118 req_id = 1d239b8b-6536-485e-af70-fa64d8959c61 response_code = 200 uri = /v2p
26262025-01-25T04:04:36.365ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6978056) }
26272025-01-25T04:04:36.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 945 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52118 req_id = 74a84cbb-b1ba-48d9-9bf4-f24cd0860fe6 response_code = 204 uri = /v2p
26282025-01-25T04:04:36.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57803
26292025-01-25T04:04:36.489ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5d44b51a-e1e0-44a0-b66f-038356ac15be, kind: Instance { id: 48f29078-27e9-4a9a-918f-5e44d6ed67b4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6978056), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5d44b51a-e1e0-44a0-b66f-038356ac15be, kind: Instance { id: 48f29078-27e9-4a9a-918f-5e44d6ed67b4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6978056), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5d44b51a-e1e0-44a0-b66f-038356ac15be, kind: Instance { id: 48f29078-27e9-4a9a-918f-5e44d6ed67b4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6978056), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6978056))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5d44b51a-e1e0-44a0-b66f-038356ac15be, kind: Instance { id: 48f29078-27e9-4a9a-918f-5e44d6ed67b4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6978056), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 91c5d88f-85f0-47a0-90f4-b242bfec2f48, slot: 0, read_only: false, vcr_json: .., name: "disk-515ebe6cf95" }], boot_settings: Some(InstanceBootSettings { order: [91c5d88f-85f0-47a0-90f4-b242bfec2f48] }), cloud_init_bytes: Some(..) } instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 metadata = InstanceMetadata { silo_id: 16df83a4-1b6e-4e3f-8e74-b797711f20d1, project_id: 8a4c185a-734d-4aa5-a38c-b9351527b633 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-25T04:04:36.484048366Z }
26302025-01-25T04:04:36.489ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 migration_id = None propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26312025-01-25T04:04:36.489ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 migration_id = None propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5d44b51a-e1e0-44a0-b66f-038356ac15be, kind: Instance { id: 48f29078-27e9-4a9a-918f-5e44d6ed67b4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6978056), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5d44b51a-e1e0-44a0-b66f-038356ac15be, kind: Instance { id: 48f29078-27e9-4a9a-918f-5e44d6ed67b4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6978056), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5d44b51a-e1e0-44a0-b66f-038356ac15be, kind: Instance { id: 48f29078-27e9-4a9a-918f-5e44d6ed67b4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6978056), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6978056))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5d44b51a-e1e0-44a0-b66f-038356ac15be, kind: Instance { id: 48f29078-27e9-4a9a-918f-5e44d6ed67b4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6978056), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 91c5d88f-85f0-47a0-90f4-b242bfec2f48, slot: 0, read_only: false, vcr_json: .., name: "disk-515ebe6cf95" }], boot_settings: Some(InstanceBootSettings { order: [91c5d88f-85f0-47a0-90f4-b242bfec2f48] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-25T04:04:36.484048366Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26322025-01-25T04:04:36.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57803 req_id = 1de6645f-85bc-4497-84ff-3253c6b5d00e response_code = 200 uri = /vmms/ebcc8204-1236-488e-b4c6-0a6244e99049
26332025-01-25T04:04:36.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37556
26342025-01-25T04:04:36.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 654 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37556 req_id = c74552c7-de4f-4d1f-9e2f-e7ca2d71b14f response_code = 200 uri = /vmms/ebcc8204-1236-488e-b4c6-0a6244e99049/state
26352025-01-25T04:04:36.586ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 6978056 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26362025-01-25T04:04:36.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26372025-01-25T04:04:36.622ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049 file = illumos-utils/src/zone.rs:325 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26382025-01-25T04:04:36.646ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049 file = illumos-utils/src/zone.rs:363 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26392025-01-25T04:04:36.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40374
26402025-01-25T04:04:36.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40374 req_id = 45b9d0f0-e285-4f5f-8efa-a1d089ce46bc response_code = 200 uri = /vpc-routes
26412025-01-25T04:04:36.693ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {5d44b51a-e1e0-44a0-b66f-038356ac15be: {10.151.2.176: {3499fa93-baac-4783-8fee-aa9ec725eb78}, 10.151.2.175: {3499fa93-baac-4783-8fee-aa9ec725eb78}}} }
26422025-01-25T04:04:38.117ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26432025-01-25T04:04:38.117ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 zone = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
26442025-01-25T04:04:38.296ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 25.300179ms file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 zone = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
26452025-01-25T04:04:38.331ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 118.640055ms file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 zone = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
26462025-01-25T04:04:38.467ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 212.605089ms file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 zone = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
26472025-01-25T04:04:38.693ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 528.257381ms file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 zone = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
26482025-01-25T04:04:39.238ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 652.180917ms file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 zone = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
26492025-01-25T04:04:39.904ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 1.262920494s file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 zone = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
26502025-01-25T04:04:41.180ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 1.27169797s file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 zone = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
26512025-01-25T04:04:42.463ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 1.259409989s file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 zone = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
26522025-01-25T04:04:43.751ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049 file = sled-agent/src/instance.rs:2068 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26532025-01-25T04:04:43.762ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 38.237282ms file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26542025-01-25T04:04:43.810ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049") failed: Property not found. retry in 64.500054ms file = illumos-utils/src/svc.rs:42 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26552025-01-25T04:04:43.885ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26562025-01-25T04:04:43.924ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26572025-01-25T04:04:44.062ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26582025-01-25T04:04:44.063ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-25T04:04:44.063024439Z } file = sled-agent/src/instance.rs:781 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26592025-01-25T04:04:44.063ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-25T04:04:44.063024439Z } propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26602025-01-25T04:04:44.063ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-25T04:04:44.063024439Z }, migration_in: None, migration_out: None }
26612025-01-25T04:04:44.076ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
26622025-01-25T04:04:44.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7383837 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40374 req_id = ddb332f0-666a-4da1-a47b-d3ca17582381 response_code = 204 uri = /eip-gateways
26632025-01-25T04:04:44.077ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-25T04:04:44.077184362Z } file = sled-agent/src/instance.rs:781 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26642025-01-25T04:04:44.077ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-25T04:04:44.077184362Z } propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
26652025-01-25T04:04:44.077ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-25T04:04:44.077184362Z }, migration_in: None, migration_out: None }
26662025-01-25T04:04:44.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40374 req_id = 4f5786f4-950a-4481-930e-dd5afbaff9bc response_code = 204 uri = /vpc-routes
26672025-01-25T04:04:46.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38227
26682025-01-25T04:04:46.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 646 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38227 req_id = 1b04dea5-dfab-4aa2-8ce3-c6d9c83a2f8a response_code = 200 uri = /vmms/ebcc8204-1236-488e-b4c6-0a6244e99049/state
26692025-01-25T04:04:46.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32886
26702025-01-25T04:04:46.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32886 req_id = 9b665ab4-041c-4bd6-b45a-65da519978bd response_code = 200 uri = /vpc-routes
26712025-01-25T04:04:46.482ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {5d44b51a-e1e0-44a0-b66f-038356ac15be: {10.151.2.176: {3499fa93-baac-4783-8fee-aa9ec725eb78}, 10.151.2.175: {3499fa93-baac-4783-8fee-aa9ec725eb78}}} }
26722025-01-25T04:04:46.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32886 req_id = a63e05e8-d2f4-4ed6-8c0e-69339b314ec0 response_code = 204 uri = /eip-gateways
26732025-01-25T04:04:46.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32886 req_id = 4192ccbc-3ab7-4271-aead-6e402945a3a8 response_code = 204 uri = /vpc-routes
26742025-01-25T04:04:46.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64454
26752025-01-25T04:04:46.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64454 req_id = 50a4ff94-7242-4dc2-b298-fe8ef85cb506 response_code = 200 uri = /v2p
26762025-01-25T04:04:46.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48971
26772025-01-25T04:04:46.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26782025-01-25T04:04:46.634ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26792025-01-25T04:04:46.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48971 req_id = 64015d41-7864-44e9-85e0-67378c0835da response_code = 204 uri = /switch-ports
26802025-01-25T04:04:46.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48971 req_id = 52665e05-d98e-4d2e-b358-efc6bd2094e0 response_code = 200 uri = /network-bootstore-config
26812025-01-25T04:04:47.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52240
26822025-01-25T04:04:47.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52240 req_id = 94462b77-c3a1-48aa-b1a3-7a8c3851212e response_code = 200 uri = /vmms/ebcc8204-1236-488e-b4c6-0a6244e99049/state
26832025-01-25T04:04:47.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39449
26842025-01-25T04:04:47.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39449 req_id = d52e7581-61d4-456e-b0d6-44b711876051 response_code = 200 uri = /vpc-routes
26852025-01-25T04:04:47.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {5d44b51a-e1e0-44a0-b66f-038356ac15be: {10.151.2.175: {3499fa93-baac-4783-8fee-aa9ec725eb78}, 10.151.2.176: {3499fa93-baac-4783-8fee-aa9ec725eb78}}} }
26862025-01-25T04:04:47.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39449 req_id = 8ed4d272-c0d1-44e9-b01f-d97349da6e75 response_code = 204 uri = /eip-gateways
26872025-01-25T04:04:47.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39449 req_id = f303d497-f876-44ba-9d6a-6b0d5883f265 response_code = 204 uri = /vpc-routes
26882025-01-25T04:04:47.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36722
26892025-01-25T04:04:47.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36722 req_id = 5c70e069-b515-4953-a642-288eda1446e3 response_code = 200 uri = /vmms/ebcc8204-1236-488e-b4c6-0a6244e99049/state
26902025-01-25T04:04:47.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43003
26912025-01-25T04:04:47.462ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26922025-01-25T04:04:47.509ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26932025-01-25T04:04:47.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43003 req_id = f14abdb1-b0f4-4cc7-8452-219529fd62bc response_code = 204 uri = /switch-ports
26942025-01-25T04:04:47.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59403
26952025-01-25T04:04:47.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62784
26962025-01-25T04:04:47.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47129
26972025-01-25T04:04:47.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48014
26982025-01-25T04:04:47.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59403 req_id = af0d16c7-0e29-4c9f-bc56-ee1d163aa2e8 response_code = 200 uri = /vpc-routes
26992025-01-25T04:04:47.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43003 req_id = 0aa538ad-b63b-4fb7-a892-5d2a8791772c response_code = 200 uri = /network-bootstore-config
27002025-01-25T04:04:47.576ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27012025-01-25T04:04:47.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62784 req_id = 85ee362b-b738-4b62-b700-d0a8e45f71c8 response_code = 200 uri = /v2p
27022025-01-25T04:04:47.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6834 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47129 req_id = f97ba8b6-a88a-44ff-b522-49f310932a2a response_code = 200 uri = /v2p
27032025-01-25T04:04:47.619ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27042025-01-25T04:04:47.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {5d44b51a-e1e0-44a0-b66f-038356ac15be: {10.151.2.175: {3499fa93-baac-4783-8fee-aa9ec725eb78}, 10.151.2.176: {3499fa93-baac-4783-8fee-aa9ec725eb78}}} }
27052025-01-25T04:04:47.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59403 req_id = fbbe3654-451b-4089-8a74-1e2b4dd47292 response_code = 204 uri = /eip-gateways
27062025-01-25T04:04:47.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 488 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59403 req_id = 7d5f5fc4-08da-4a41-8f64-52a2d4f905a2 response_code = 204 uri = /vpc-routes
27072025-01-25T04:04:47.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48014 req_id = 9f3f3f21-7380-4906-8682-356ddb576e74 response_code = 204 uri = /switch-ports
27082025-01-25T04:04:47.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48014 req_id = d328879a-fac5-40b8-8dff-2d902510d957 response_code = 200 uri = /network-bootstore-config
27092025-01-25T04:04:54.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54030
27102025-01-25T04:04:54.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 462 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54030 req_id = 640888cb-bb88-451e-ad0b-5d5f1a7e149f response_code = 200 uri = /vmms/ebcc8204-1236-488e-b4c6-0a6244e99049/state
27112025-01-25T04:04:54.088ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-25T04:04:54.088532755Z } file = sled-agent/src/instance.rs:781 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
27122025-01-25T04:04:54.088ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-25T04:04:54.088532755Z } propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
27132025-01-25T04:04:54.088ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-25T04:04:54.088532755Z }, migration_in: None, migration_out: None }
27142025-01-25T04:04:54.128ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-25T04:04:54.128855613Z } file = sled-agent/src/instance.rs:781 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
27152025-01-25T04:04:54.128ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-25T04:04:54.128855613Z } propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
27162025-01-25T04:04:54.128ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
27172025-01-25T04:04:54.128ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27182025-01-25T04:04:54.129ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10459410940299564447 n_samples = 6 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
27192025-01-25T04:04:54.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27202025-01-25T04:04:54.129ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/04cd7a7f-a882-495d-8185-a9a5ea285a59/debug/bundle/zone", "/pool/int/b504f21a-ab7c-41ff-9869-9461f9b13936/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/066cb075-3ce4-42e3-8879-3ad7d6a5cc28/crypt/debug", "/pool/ext/ed06efc8-6c57-4076-806f-3a742bb46e6b/crypt/debug", "/pool/ext/a23e7ed6-7d83-458b-8c71-7390568d1c9a/crypt/debug", "/pool/ext/44c151b9-2034-4667-9c87-189bf684b2e4/crypt/debug", "/pool/ext/222406a2-a5b7-4a99-b6de-a4467bfdbe5c/crypt/debug", "/pool/ext/97661079-bff0-45d9-bae2-2b9215898f21/crypt/debug", "/pool/ext/ea12aaae-9944-46a8-baba-6b89a1925bc3/crypt/debug", "/pool/ext/35b7f17f-2139-4f31-b2d5-c4c76891288f/crypt/debug", "/pool/ext/30589e38-7481-4de9-b63b-77c66cbf4a51/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049
27212025-01-25T04:04:54.129ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 16734183901580609750 n_samples = 6 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
27222025-01-25T04:04:54.749ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049", bundle_id: 11f76629-e95b-47f0-b22e-053c6e581e13 }, time_created: 2025-01-25T04:04:54.130196686Z, version: 0, cause: TerminatedInstance }
27232025-01-25T04:04:54.749ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_ebcc8204-1236-488e-b4c6-0a6244e99049 file = sled-agent/src/instance.rs:1314 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
27242025-01-25T04:04:56.514ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
27252025-01-25T04:04:56.533ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6978056), kind: System }
27262025-01-25T04:04:56.533ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6978056), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27272025-01-25T04:04:56.533ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-25T04:04:56.533865498Z }, migration_in: None, migration_out: None }
27282025-01-25T04:04:56.561ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-25T04:04:56.533865498Z }, migration_in: None, migration_out: None }
27292025-01-25T04:04:56.565ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = 48f29078-27e9-4a9a-918f-5e44d6ed67b4 propolis_id = ebcc8204-1236-488e-b4c6-0a6244e99049
27302025-01-25T04:04:56.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61355
27312025-01-25T04:04:56.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61355 req_id = 7f756554-8980-4487-8791-4f9a1d8b3fd9 response_code = 200 uri = /vpc-routes
27322025-01-25T04:04:56.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {5d44b51a-e1e0-44a0-b66f-038356ac15be: {10.151.2.176: {3499fa93-baac-4783-8fee-aa9ec725eb78}, 10.151.2.175: {3499fa93-baac-4783-8fee-aa9ec725eb78}}} }
27332025-01-25T04:04:56.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61355 req_id = 00ce582e-29ff-4961-b17c-f0c7f0bba109 response_code = 204 uri = /eip-gateways
27342025-01-25T04:04:56.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61355 req_id = b83c3db0-55fa-4184-b5e1-48b419a2f1e8 response_code = 204 uri = /vpc-routes
27352025-01-25T04:04:56.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46801
27362025-01-25T04:04:56.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46801 req_id = ebfeca06-a0aa-4fc8-90ef-ec25e9adc9d7 response_code = 200 uri = /v2p
27372025-01-25T04:04:57.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62098
27382025-01-25T04:04:57.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62098 req_id = 20577ed0-6c1b-43cd-a757-3ced46672276 response_code = 200 uri = /v2p
27392025-01-25T04:04:57.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49140
27402025-01-25T04:04:57.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49140 req_id = 3841107a-a876-44df-a879-30085bda9f0f response_code = 200 uri = /vpc-routes
27412025-01-25T04:04:57.530ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
27422025-01-25T04:04:57.530ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a
27432025-01-25T04:04:57.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49140 req_id = 795c6f22-43cb-4420-b31d-ba44514409f4 response_code = 204 uri = /eip-gateways
27442025-01-25T04:04:57.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49140 req_id = 3f861130-7d62-41f5-a869-36371f93822a response_code = 204 uri = /vpc-routes
27452025-01-25T04:04:58.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49414
27462025-01-25T04:04:58.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49414 req_id = 78db0ed6-6342-4426-bc38-285177cdd931 response_code = 200 uri = /vpc-routes
27472025-01-25T04:04:58.146ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 7d0d7aa8-e50b-43a0-a4d9-2719dcd0810a values = ExternalIpGatewayMap { mappings: {} }
27482025-01-25T04:04:58.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49414 req_id = 4e55d8de-c167-4c15-b528-1f9b0b875eca response_code = 204 uri = /eip-gateways
27492025-01-25T04:04:58.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49414 req_id = 5dabb16f-4a68-4169-963b-16ce3c0cbfc4 response_code = 204 uri = /vpc-routes